2024-09-22T03:38:42.542 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-22T03:38:42.561 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-22T03:38:42.653 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-21_20:56:02-crimson-rados-main-distro-crimson-smithi/7914381 branch: main description: crimson-rados/thrash_simple/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore thrashers/simple thrashosds-health workloads/radosbench} email: ceph-qa@ceph.com first_in_suite: false job_id: '7914381' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi name: teuthology-2024-09-21_20:56:02-crimson-rados-main-distro-crimson-smithi no_nested_subset: false os_type: centos os_version: 9.stream overrides: admin_socket: branch: main ceph: conf: client.0: debug ms: 1 debug objecter: 20 debug rados: 20 global: enable experimental unrecoverable data corrupting features: crimson ms client mode: crc ms cluster mode: crc ms mon client mode: crc ms mon cluster mode: crc ms mon service mode: crc ms service mode: crc osd_pool_default_min_size: 2 osd_pool_default_size: 3 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon min osdmap epochs: 50 mon osdmap full prune interval: 2 mon osdmap full prune min: 15 mon osdmap full prune txsize: 2 osd pool default crimson: true paxos service trim min: 10 osd: bluestore block size: 96636764160 bluestore compression algorithm: snappy bluestore compression mode: aggressive bluestore fsck on mount: true bluestore rocksdb cf: false crimson alien thread cpu cores: 6-7 crimson osd obc lru size: 10 debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 err to stderr: true log flush on exit: true log to file: false log to stderr: true mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd debug reject backfill probability: 0.3 osd delete sleep: 1 osd failsafe full ratio: 0.95 osd max backfills: 3 osd max markdown count: 1000 osd objectstore: bluestore osd scrub max interval: 120 osd scrub min interval: 60 osd shutdown pgref assert: true osd snap trim sleep: 2 osd.0: crimson seastar cpu cores: 0-2 osd.1: crimson seastar cpu cores: 3-5 osd.2: crimson seastar cpu cores: 0-2 osd.3: crimson seastar cpu cores: 3-5 flavor: crimson fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(POOL_APP_NOT_ENABLED\) - but it is still running - objects unfound and apparently lost - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - SLOW_OPS - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum - noscrub - nodeep-scrub sha1: 62da54b4b83a96ca9976b7e1d0c8272a564a2208 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: crimson sha1: 62da54b4b83a96ca9976b7e1d0c8272a564a2208 thrashosds: min_in: 4 workunit: branch: main env: CRIMSON_COMPAT: '1' sha1: 62da54b4b83a96ca9976b7e1d0c8272a564a2208 owner: scheduled_teuthology@teuthology priority: 101 repo: https://git.ceph.com/ceph.git roles: - - mon.a - osd.0 - osd.1 - client.0 - node-exporter.a - - mgr.x - osd.2 - osd.3 - client.1 - prometheus.a - node-exporter.b seed: 2950 sha1: 62da54b4b83a96ca9976b7e1d0c8272a564a2208 sleep_before_teardown: 0 subset: 0/1 suite: crimson-rados suite_branch: main suite_path: /home/teuthworker/src/git.ceph.com_ceph_62da54b4b83a96ca9976b7e1d0c8272a564a2208/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 62da54b4b83a96ca9976b7e1d0c8272a564a2208 targets: smithi037.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC1Suj3tpSL6tNWBBvV4xEUtk4NqLjmnfN9L1rz8pr2+Kf+O4QQVbT2Pb1ZJl/k770ZjvRSI75x+rfPAF2Bn7fw= smithi098.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBI/gqTqAsK8EhVyWFtGDRZYFDH35ajID2WfpTMs5fA9Sm6zJ8pX7Z0lbZizgkhsh0EfvEsoobBxjcAKdPKjO/yY= tasks: - install: null - ceph: conf: osd: debug monc: 20 flavor: crimson - thrashosds: ceph_objectstore_tool: false chance_down: 0 chance_inject_pause_short: 0 chance_reset_purged_snaps_last: 0 chance_thrash_cluster_full: 0 chance_thrash_pg_upmap: 0 dump_ops_enable: false min_in: 3 noscrub_toggle_delay: 0 reweight_osd: 0 sighup_delay: 0 thrash_primary_affinity: false timeout: 2400 - full_sequential: - radosbench: clients: - client.0 time: 90 - radosbench: clients: - client.0 time: 90 - radosbench: clients: - client.0 time: 90 - radosbench: clients: - client.0 time: 90 - radosbench: clients: - client.0 time: 90 teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-21_20:56:02 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2902 2024-09-22T03:38:42.653 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_62da54b4b83a96ca9976b7e1d0c8272a564a2208/qa; will attempt to use it 2024-09-22T03:38:42.654 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_62da54b4b83a96ca9976b7e1d0c8272a564a2208/qa/tasks 2024-09-22T03:38:42.654 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-22T03:38:42.656 INFO:teuthology.task.internal:Checking packages... 2024-09-22T03:38:42.676 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'crimson' and ceph hash '62da54b4b83a96ca9976b7e1d0c8272a564a2208' 2024-09-22T03:38:42.676 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-22T03:38:42.676 INFO:teuthology.packaging:ref: None 2024-09-22T03:38:42.676 INFO:teuthology.packaging:tag: None 2024-09-22T03:38:42.676 INFO:teuthology.packaging:branch: main 2024-09-22T03:38:42.676 INFO:teuthology.packaging:sha1: 62da54b4b83a96ca9976b7e1d0c8272a564a2208 2024-09-22T03:38:42.676 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&ref=main 2024-09-22T03:38:42.897 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-5092.g62da54b4 2024-09-22T03:38:42.898 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-22T03:38:42.905 INFO:teuthology.task.internal:no buildpackages task found 2024-09-22T03:38:42.905 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-22T03:38:42.910 INFO:teuthology.task.internal:Saving configuration 2024-09-22T03:38:42.925 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-22T03:38:42.933 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-22T03:38:42.959 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi037.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-21_20:56:02-crimson-rados-main-distro-crimson-smithi/7914381', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-22 03:33:45.801822', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC1Suj3tpSL6tNWBBvV4xEUtk4NqLjmnfN9L1rz8pr2+Kf+O4QQVbT2Pb1ZJl/k770ZjvRSI75x+rfPAF2Bn7fw='} 2024-09-22T03:38:42.981 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi098.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-21_20:56:02-crimson-rados-main-distro-crimson-smithi/7914381', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-22 03:33:45.800074', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBI/gqTqAsK8EhVyWFtGDRZYFDH35ajID2WfpTMs5fA9Sm6zJ8pX7Z0lbZizgkhsh0EfvEsoobBxjcAKdPKjO/yY='} 2024-09-22T03:38:42.981 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-22T03:38:42.993 INFO:teuthology.task.internal:roles: ubuntu@smithi037.front.sepia.ceph.com - ['mon.a', 'osd.0', 'osd.1', 'client.0', 'node-exporter.a'] 2024-09-22T03:38:42.993 INFO:teuthology.task.internal:roles: ubuntu@smithi098.front.sepia.ceph.com - ['mgr.x', 'osd.2', 'osd.3', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-22T03:38:42.993 INFO:teuthology.run_tasks:Running task console_log... 2024-09-22T03:38:43.067 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f9a5ec04160>, signals=[15]) 2024-09-22T03:38:43.067 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-22T03:38:43.073 INFO:teuthology.task.internal:Opening connections... 2024-09-22T03:38:43.073 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi037.front.sepia.ceph.com 2024-09-22T03:38:43.074 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-22T03:38:43.152 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi098.front.sepia.ceph.com 2024-09-22T03:38:43.152 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-22T03:38:43.225 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-22T03:38:43.232 DEBUG:teuthology.orchestra.run.smithi037:> uname -m 2024-09-22T03:38:43.250 INFO:teuthology.orchestra.run.smithi037.stdout:x86_64 2024-09-22T03:38:43.251 DEBUG:teuthology.orchestra.run.smithi037:> cat /etc/os-release 2024-09-22T03:38:43.307 INFO:teuthology.orchestra.run.smithi037.stdout:NAME="CentOS Stream" 2024-09-22T03:38:43.307 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION="9" 2024-09-22T03:38:43.307 INFO:teuthology.orchestra.run.smithi037.stdout:ID="centos" 2024-09-22T03:38:43.307 INFO:teuthology.orchestra.run.smithi037.stdout:ID_LIKE="rhel fedora" 2024-09-22T03:38:43.307 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION_ID="9" 2024-09-22T03:38:43.307 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM_ID="platform:el9" 2024-09-22T03:38:43.308 INFO:teuthology.orchestra.run.smithi037.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-22T03:38:43.308 INFO:teuthology.orchestra.run.smithi037.stdout:ANSI_COLOR="0;31" 2024-09-22T03:38:43.308 INFO:teuthology.orchestra.run.smithi037.stdout:LOGO="fedora-logo-icon" 2024-09-22T03:38:43.308 INFO:teuthology.orchestra.run.smithi037.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-22T03:38:43.308 INFO:teuthology.orchestra.run.smithi037.stdout:HOME_URL="https://centos.org/" 2024-09-22T03:38:43.308 INFO:teuthology.orchestra.run.smithi037.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-22T03:38:43.308 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-22T03:38:43.308 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-22T03:38:43.308 INFO:teuthology.lock.ops:Updating smithi037.front.sepia.ceph.com on lock server 2024-09-22T03:38:43.327 DEBUG:teuthology.orchestra.run.smithi098:> uname -m 2024-09-22T03:38:43.344 INFO:teuthology.orchestra.run.smithi098.stdout:x86_64 2024-09-22T03:38:43.344 DEBUG:teuthology.orchestra.run.smithi098:> cat /etc/os-release 2024-09-22T03:38:43.401 INFO:teuthology.orchestra.run.smithi098.stdout:NAME="CentOS Stream" 2024-09-22T03:38:43.401 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION="9" 2024-09-22T03:38:43.401 INFO:teuthology.orchestra.run.smithi098.stdout:ID="centos" 2024-09-22T03:38:43.401 INFO:teuthology.orchestra.run.smithi098.stdout:ID_LIKE="rhel fedora" 2024-09-22T03:38:43.401 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION_ID="9" 2024-09-22T03:38:43.401 INFO:teuthology.orchestra.run.smithi098.stdout:PLATFORM_ID="platform:el9" 2024-09-22T03:38:43.401 INFO:teuthology.orchestra.run.smithi098.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-22T03:38:43.401 INFO:teuthology.orchestra.run.smithi098.stdout:ANSI_COLOR="0;31" 2024-09-22T03:38:43.401 INFO:teuthology.orchestra.run.smithi098.stdout:LOGO="fedora-logo-icon" 2024-09-22T03:38:43.401 INFO:teuthology.orchestra.run.smithi098.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-22T03:38:43.402 INFO:teuthology.orchestra.run.smithi098.stdout:HOME_URL="https://centos.org/" 2024-09-22T03:38:43.402 INFO:teuthology.orchestra.run.smithi098.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-22T03:38:43.402 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-22T03:38:43.402 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-22T03:38:43.402 INFO:teuthology.lock.ops:Updating smithi098.front.sepia.ceph.com on lock server 2024-09-22T03:38:43.418 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-22T03:38:43.427 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-22T03:38:43.433 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-22T03:38:43.433 DEBUG:teuthology.orchestra.run.smithi037:> test '!' -e /home/ubuntu/cephtest 2024-09-22T03:38:43.436 DEBUG:teuthology.orchestra.run.smithi098:> test '!' -e /home/ubuntu/cephtest 2024-09-22T03:38:43.457 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-22T03:38:43.463 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-22T03:38:43.463 DEBUG:teuthology.orchestra.run.smithi037:> test -z $(ls -A /var/lib/ceph) 2024-09-22T03:38:43.493 DEBUG:teuthology.orchestra.run.smithi098:> test -z $(ls -A /var/lib/ceph) 2024-09-22T03:38:43.517 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-22T03:38:43.567 INFO:teuthology.run_tasks:Running task kernel... 2024-09-22T03:38:43.580 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-22T03:38:43.580 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mgr.x': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-22T03:38:43.580 DEBUG:teuthology.orchestra.run.smithi037:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-22T03:38:43.581 DEBUG:teuthology.orchestra.run.smithi098:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-22T03:38:43.596 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-22T03:38:43.597 DEBUG:teuthology.orchestra.run.smithi098:> uname -r 2024-09-22T03:38:43.597 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-22T03:38:43.598 DEBUG:teuthology.orchestra.run.smithi037:> uname -r 2024-09-22T03:38:43.653 INFO:teuthology.orchestra.run.smithi098.stdout:5.14.0-503.el9.x86_64 2024-09-22T03:38:43.653 INFO:teuthology.task.kernel:Running kernel on smithi098: 5.14.0-503.el9.x86_64 2024-09-22T03:38:43.653 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum install -y kernel 2024-09-22T03:38:43.656 INFO:teuthology.orchestra.run.smithi037.stdout:5.14.0-503.el9.x86_64 2024-09-22T03:38:43.656 INFO:teuthology.task.kernel:Running kernel on smithi037: 5.14.0-503.el9.x86_64 2024-09-22T03:38:43.656 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum install -y kernel 2024-09-22T03:38:45.917 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.3 MB 00:00 2024-09-22T03:38:46.959 INFO:teuthology.orchestra.run.smithi098.stdout:CentOS Stream 9 - BaseOS 5.4 MB/s | 8.3 MB 00:01 2024-09-22T03:38:47.885 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - AppStream 24 MB/s | 20 MB 00:00 2024-09-22T03:38:48.702 INFO:teuthology.orchestra.run.smithi098.stdout:CentOS Stream 9 - AppStream 30 MB/s | 20 MB 00:00 2024-09-22T03:38:52.436 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - CRB 10 MB/s | 6.5 MB 00:00 2024-09-22T03:38:52.978 INFO:teuthology.orchestra.run.smithi098.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.5 MB 00:00 2024-09-22T03:38:54.137 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - Extras packages 43 kB/s | 19 kB 00:00 2024-09-22T03:38:54.446 INFO:teuthology.orchestra.run.smithi098.stdout:CentOS Stream 9 - Extras packages 75 kB/s | 19 kB 00:00 2024-09-22T03:38:55.716 INFO:teuthology.orchestra.run.smithi037.stdout:Extra Packages for Enterprise Linux 16 MB/s | 23 MB 00:01 2024-09-22T03:38:55.933 INFO:teuthology.orchestra.run.smithi098.stdout:Extra Packages for Enterprise Linux 17 MB/s | 23 MB 00:01 2024-09-22T03:39:01.305 INFO:teuthology.orchestra.run.smithi098.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-22T03:39:01.338 INFO:teuthology.orchestra.run.smithi037.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-22T03:39:03.254 INFO:teuthology.orchestra.run.smithi098.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-22T03:39:03.254 INFO:teuthology.orchestra.run.smithi098.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-22T03:39:03.319 INFO:teuthology.orchestra.run.smithi037.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-22T03:39:03.320 INFO:teuthology.orchestra.run.smithi037.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-22T03:39:03.334 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-22T03:39:03.344 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-22T03:39:03.344 INFO:teuthology.orchestra.run.smithi098.stdout: Package Architecture Version Repository Size 2024-09-22T03:39:03.344 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-22T03:39:03.344 INFO:teuthology.orchestra.run.smithi098.stdout:Installing: 2024-09-22T03:39:03.344 INFO:teuthology.orchestra.run.smithi098.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-22T03:39:03.344 INFO:teuthology.orchestra.run.smithi098.stdout:Installing dependencies: 2024-09-22T03:39:03.344 INFO:teuthology.orchestra.run.smithi098.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-22T03:39:03.344 INFO:teuthology.orchestra.run.smithi098.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-22T03:39:03.344 INFO:teuthology.orchestra.run.smithi098.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-22T03:39:03.345 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-22T03:39:03.345 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction Summary 2024-09-22T03:39:03.345 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-22T03:39:03.345 INFO:teuthology.orchestra.run.smithi098.stdout:Install 4 Packages 2024-09-22T03:39:03.345 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-22T03:39:03.345 INFO:teuthology.orchestra.run.smithi098.stdout:Total download size: 79 M 2024-09-22T03:39:03.345 INFO:teuthology.orchestra.run.smithi098.stdout:Installed size: 126 M 2024-09-22T03:39:03.346 INFO:teuthology.orchestra.run.smithi098.stdout:Downloading Packages: 2024-09-22T03:39:03.424 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-09-22T03:39:03.436 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-09-22T03:39:03.436 INFO:teuthology.orchestra.run.smithi037.stdout: Package Architecture Version Repository Size 2024-09-22T03:39:03.436 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-09-22T03:39:03.436 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2024-09-22T03:39:03.437 INFO:teuthology.orchestra.run.smithi037.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-22T03:39:03.437 INFO:teuthology.orchestra.run.smithi037.stdout:Installing dependencies: 2024-09-22T03:39:03.437 INFO:teuthology.orchestra.run.smithi037.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-22T03:39:03.437 INFO:teuthology.orchestra.run.smithi037.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-22T03:39:03.437 INFO:teuthology.orchestra.run.smithi037.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-22T03:39:03.437 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:39:03.437 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2024-09-22T03:39:03.437 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-09-22T03:39:03.437 INFO:teuthology.orchestra.run.smithi037.stdout:Install 4 Packages 2024-09-22T03:39:03.437 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:39:03.438 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 79 M 2024-09-22T03:39:03.438 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 126 M 2024-09-22T03:39:03.438 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2024-09-22T03:39:03.574 INFO:teuthology.orchestra.run.smithi098.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 342 kB/s | 36 kB 00:00 2024-09-22T03:39:03.631 INFO:teuthology.orchestra.run.smithi037.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 447 kB/s | 36 kB 00:00 2024-09-22T03:39:04.032 INFO:teuthology.orchestra.run.smithi037.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 33 MB/s | 16 MB 00:00 2024-09-22T03:39:04.482 INFO:teuthology.orchestra.run.smithi037.stdout:(3/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 37 MB/s | 35 MB 00:00 2024-09-22T03:39:04.732 INFO:teuthology.orchestra.run.smithi037.stdout:(4/4): kernel-modules-core-5.14.0-508.el9.x86_6 26 MB/s | 29 MB 00:01 2024-09-22T03:39:04.732 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2024-09-22T03:39:04.732 INFO:teuthology.orchestra.run.smithi037.stdout:Total 61 MB/s | 79 MB 00:01 2024-09-22T03:39:05.442 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2024-09-22T03:39:05.799 INFO:teuthology.orchestra.run.smithi098.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 6.7 MB/s | 16 MB 00:02 2024-09-22T03:39:05.813 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2024-09-22T03:39:05.813 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2024-09-22T03:39:06.796 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2024-09-22T03:39:06.796 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2024-09-22T03:39:07.965 INFO:teuthology.orchestra.run.smithi098.stdout:(3/4): kernel-modules-core-5.14.0-508.el9.x86_6 6.5 MB/s | 29 MB 00:04 2024-09-22T03:39:08.715 INFO:teuthology.orchestra.run.smithi098.stdout:(4/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 6.6 MB/s | 35 MB 00:05 2024-09-22T03:39:08.716 INFO:teuthology.orchestra.run.smithi098.stdout:-------------------------------------------------------------------------------- 2024-09-22T03:39:08.716 INFO:teuthology.orchestra.run.smithi098.stdout:Total 15 MB/s | 79 MB 00:05 2024-09-22T03:39:09.355 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2024-09-22T03:39:09.395 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction check 2024-09-22T03:39:09.750 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction check succeeded. 2024-09-22T03:39:09.750 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction test 2024-09-22T03:39:10.036 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-22T03:39:10.116 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-22T03:39:10.709 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction test succeeded. 2024-09-22T03:39:10.709 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction 2024-09-22T03:39:12.896 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-22T03:39:13.028 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-22T03:39:13.157 INFO:teuthology.orchestra.run.smithi098.stdout: Preparing : 1/1 2024-09-22T03:39:13.789 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-22T03:39:13.876 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-22T03:39:16.635 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-22T03:39:16.771 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-22T03:39:18.155 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-22T03:39:18.195 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-22T03:39:21.586 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-22T03:39:21.706 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-22T03:39:23.336 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-22T03:39:26.558 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-22T03:40:02.116 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-22T03:40:02.157 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-22T03:40:02.587 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-22T03:40:02.587 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-22T03:40:02.587 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-22T03:40:02.587 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-22T03:40:03.460 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-22T03:40:03.460 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:40:03.460 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2024-09-22T03:40:03.460 INFO:teuthology.orchestra.run.smithi037.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-22T03:40:03.460 INFO:teuthology.orchestra.run.smithi037.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-22T03:40:03.460 INFO:teuthology.orchestra.run.smithi037.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-22T03:40:03.460 INFO:teuthology.orchestra.run.smithi037.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-22T03:40:03.460 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:40:03.461 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-09-22T03:40:03.825 DEBUG:teuthology.orchestra.run.smithi037:> rpm -q kernel | sort -rV | head -n 1 2024-09-22T03:40:03.912 INFO:teuthology.orchestra.run.smithi037.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-22T03:40:03.912 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-22T03:40:03.912 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-22T03:40:03.912 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-22T03:40:03.912 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-22T03:40:03.912 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-22T03:40:03.913 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi037.front.sepia.ceph.com, path=None, version=distro) 2024-09-22T03:40:03.913 DEBUG:teuthology.orchestra.run.smithi037:> rpm -q kernel | sort -rV | head -n 1 2024-09-22T03:40:03.971 INFO:teuthology.orchestra.run.smithi037.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-22T03:40:03.971 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-22T03:40:03.972 DEBUG:teuthology.orchestra.run.smithi037:> sudo rpm -qi grub2-tools 2024-09-22T03:40:04.002 INFO:teuthology.orchestra.run.smithi037.stdout:Name : grub2-tools 2024-09-22T03:40:04.002 INFO:teuthology.orchestra.run.smithi037.stdout:Epoch : 1 2024-09-22T03:40:04.002 INFO:teuthology.orchestra.run.smithi037.stdout:Version : 2.06 2024-09-22T03:40:04.003 INFO:teuthology.orchestra.run.smithi037.stdout:Release : 82.el9 2024-09-22T03:40:04.003 INFO:teuthology.orchestra.run.smithi037.stdout:Architecture: x86_64 2024-09-22T03:40:04.003 INFO:teuthology.orchestra.run.smithi037.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-22T03:40:04.003 INFO:teuthology.orchestra.run.smithi037.stdout:Group : Unspecified 2024-09-22T03:40:04.003 INFO:teuthology.orchestra.run.smithi037.stdout:Size : 8274670 2024-09-22T03:40:04.003 INFO:teuthology.orchestra.run.smithi037.stdout:License : GPLv3+ 2024-09-22T03:40:04.003 INFO:teuthology.orchestra.run.smithi037.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-22T03:40:04.003 INFO:teuthology.orchestra.run.smithi037.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-22T03:40:04.003 INFO:teuthology.orchestra.run.smithi037.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-22T03:40:04.003 INFO:teuthology.orchestra.run.smithi037.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-22T03:40:04.003 INFO:teuthology.orchestra.run.smithi037.stdout:Packager : builder@centos.org 2024-09-22T03:40:04.003 INFO:teuthology.orchestra.run.smithi037.stdout:Vendor : CentOS 2024-09-22T03:40:04.003 INFO:teuthology.orchestra.run.smithi037.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-22T03:40:04.003 INFO:teuthology.orchestra.run.smithi037.stdout:Summary : Support tools for GRUB. 2024-09-22T03:40:04.004 INFO:teuthology.orchestra.run.smithi037.stdout:Description : 2024-09-22T03:40:04.004 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:40:04.004 INFO:teuthology.orchestra.run.smithi037.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-22T03:40:04.004 INFO:teuthology.orchestra.run.smithi037.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-22T03:40:04.004 INFO:teuthology.orchestra.run.smithi037.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-22T03:40:04.004 INFO:teuthology.orchestra.run.smithi037.stdout:hardware devices. 2024-09-22T03:40:04.004 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:40:04.004 INFO:teuthology.orchestra.run.smithi037.stdout:This subpackage provides tools for support of all platforms. 2024-09-22T03:40:04.005 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-22T03:40:04.005 INFO:teuthology.task.kernel:Updating grub on smithi037 to boot 5.14.0-508.el9.x86_64 2024-09-22T03:40:04.005 DEBUG:teuthology.orchestra.run.smithi037:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-22T03:40:04.755 INFO:teuthology.orchestra.run.smithi037.stderr:Generating grub configuration file ... 2024-09-22T03:40:04.926 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-22T03:40:04.967 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-22T03:40:05.339 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-22T03:40:05.339 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-22T03:40:05.339 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-22T03:40:05.339 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-22T03:40:06.058 INFO:teuthology.orchestra.run.smithi037.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-22T03:40:06.086 INFO:teuthology.orchestra.run.smithi037.stderr:done 2024-09-22T03:40:06.091 DEBUG:teuthology.orchestra.run.smithi037:> mktemp 2024-09-22T03:40:06.117 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/tmp.wp1fMD4Xwa 2024-09-22T03:40:06.118 DEBUG:teuthology.orchestra.run.smithi037:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.wp1fMD4Xwa 2024-09-22T03:40:06.192 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 0666 /tmp/tmp.wp1fMD4Xwa 2024-09-22T03:40:06.201 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-22T03:40:06.201 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-22T03:40:06.201 INFO:teuthology.orchestra.run.smithi098.stdout:Installed: 2024-09-22T03:40:06.201 INFO:teuthology.orchestra.run.smithi098.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-22T03:40:06.202 INFO:teuthology.orchestra.run.smithi098.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-22T03:40:06.202 INFO:teuthology.orchestra.run.smithi098.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-22T03:40:06.202 INFO:teuthology.orchestra.run.smithi098.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-22T03:40:06.202 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-22T03:40:06.202 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-22T03:40:06.341 DEBUG:teuthology.orchestra.remote:smithi037:/tmp/tmp.wp1fMD4Xwa is 6KB 2024-09-22T03:40:06.390 DEBUG:teuthology.orchestra.run.smithi037:> rm -fr /tmp/tmp.wp1fMD4Xwa 2024-09-22T03:40:06.404 DEBUG:teuthology.orchestra.run.smithi037:> sudo /bin/ls /boot/loader/entries || true 2024-09-22T03:40:06.467 INFO:teuthology.orchestra.run.smithi037.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-22T03:40:06.467 INFO:teuthology.orchestra.run.smithi037.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-22T03:40:06.467 INFO:teuthology.orchestra.run.smithi037.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-22T03:40:06.467 INFO:teuthology.orchestra.run.smithi037.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-22T03:40:06.468 DEBUG:teuthology.orchestra.run.smithi037:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-22T03:40:06.547 DEBUG:teuthology.orchestra.run.smithi098:> rpm -q kernel | sort -rV | head -n 1 2024-09-22T03:40:06.613 DEBUG:teuthology.orchestra.run.smithi037:> sudo shutdown -r now 2024-09-22T03:40:06.621 INFO:teuthology.orchestra.run.smithi098.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-22T03:40:06.622 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-22T03:40:06.622 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-22T03:40:06.622 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-22T03:40:06.622 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-22T03:40:06.622 INFO:teuthology.task.kernel:Installing distro kernel on mgr.x... 2024-09-22T03:40:06.622 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi098.front.sepia.ceph.com, path=None, version=distro) 2024-09-22T03:40:06.623 DEBUG:teuthology.orchestra.run.smithi098:> rpm -q kernel | sort -rV | head -n 1 2024-09-22T03:40:06.682 INFO:teuthology.orchestra.run.smithi098.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-22T03:40:06.682 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-22T03:40:06.682 DEBUG:teuthology.orchestra.run.smithi098:> sudo rpm -qi grub2-tools 2024-09-22T03:40:06.713 INFO:teuthology.orchestra.run.smithi098.stdout:Name : grub2-tools 2024-09-22T03:40:06.713 INFO:teuthology.orchestra.run.smithi098.stdout:Epoch : 1 2024-09-22T03:40:06.714 INFO:teuthology.orchestra.run.smithi098.stdout:Version : 2.06 2024-09-22T03:40:06.714 INFO:teuthology.orchestra.run.smithi098.stdout:Release : 82.el9 2024-09-22T03:40:06.714 INFO:teuthology.orchestra.run.smithi098.stdout:Architecture: x86_64 2024-09-22T03:40:06.714 INFO:teuthology.orchestra.run.smithi098.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-22T03:40:06.714 INFO:teuthology.orchestra.run.smithi098.stdout:Group : Unspecified 2024-09-22T03:40:06.714 INFO:teuthology.orchestra.run.smithi098.stdout:Size : 8274670 2024-09-22T03:40:06.714 INFO:teuthology.orchestra.run.smithi098.stdout:License : GPLv3+ 2024-09-22T03:40:06.714 INFO:teuthology.orchestra.run.smithi098.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-22T03:40:06.714 INFO:teuthology.orchestra.run.smithi098.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-22T03:40:06.714 INFO:teuthology.orchestra.run.smithi098.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-22T03:40:06.714 INFO:teuthology.orchestra.run.smithi098.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-22T03:40:06.714 INFO:teuthology.orchestra.run.smithi098.stdout:Packager : builder@centos.org 2024-09-22T03:40:06.714 INFO:teuthology.orchestra.run.smithi098.stdout:Vendor : CentOS 2024-09-22T03:40:06.714 INFO:teuthology.orchestra.run.smithi098.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-22T03:40:06.715 INFO:teuthology.orchestra.run.smithi098.stdout:Summary : Support tools for GRUB. 2024-09-22T03:40:06.715 INFO:teuthology.orchestra.run.smithi098.stdout:Description : 2024-09-22T03:40:06.715 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-22T03:40:06.715 INFO:teuthology.orchestra.run.smithi098.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-22T03:40:06.715 INFO:teuthology.orchestra.run.smithi098.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-22T03:40:06.715 INFO:teuthology.orchestra.run.smithi098.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-22T03:40:06.715 INFO:teuthology.orchestra.run.smithi098.stdout:hardware devices. 2024-09-22T03:40:06.715 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-22T03:40:06.715 INFO:teuthology.orchestra.run.smithi098.stdout:This subpackage provides tools for support of all platforms. 2024-09-22T03:40:06.716 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-22T03:40:06.716 INFO:teuthology.task.kernel:Updating grub on smithi098 to boot 5.14.0-508.el9.x86_64 2024-09-22T03:40:06.716 DEBUG:teuthology.orchestra.run.smithi098:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-22T03:40:07.445 INFO:teuthology.orchestra.run.smithi098.stderr:Generating grub configuration file ... 2024-09-22T03:40:08.802 INFO:teuthology.orchestra.run.smithi098.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-22T03:40:08.838 INFO:teuthology.orchestra.run.smithi098.stderr:done 2024-09-22T03:40:08.840 DEBUG:teuthology.orchestra.run.smithi098:> mktemp 2024-09-22T03:40:08.856 INFO:teuthology.orchestra.run.smithi098.stdout:/tmp/tmp.ynC8KCli3W 2024-09-22T03:40:08.857 DEBUG:teuthology.orchestra.run.smithi098:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.ynC8KCli3W 2024-09-22T03:40:08.923 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod 0666 /tmp/tmp.ynC8KCli3W 2024-09-22T03:40:09.067 DEBUG:teuthology.orchestra.remote:smithi098:/tmp/tmp.ynC8KCli3W is 6KB 2024-09-22T03:40:09.115 DEBUG:teuthology.orchestra.run.smithi098:> rm -fr /tmp/tmp.ynC8KCli3W 2024-09-22T03:40:09.130 DEBUG:teuthology.orchestra.run.smithi098:> sudo /bin/ls /boot/loader/entries || true 2024-09-22T03:40:09.192 INFO:teuthology.orchestra.run.smithi098.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-22T03:40:09.193 INFO:teuthology.orchestra.run.smithi098.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-22T03:40:09.193 INFO:teuthology.orchestra.run.smithi098.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-22T03:40:09.193 INFO:teuthology.orchestra.run.smithi098.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-22T03:40:09.194 DEBUG:teuthology.orchestra.run.smithi098:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-22T03:40:09.351 DEBUG:teuthology.orchestra.run.smithi098:> sudo shutdown -r now 2024-09-22T03:40:36.642 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-22T03:40:36.643 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com' 2024-09-22T03:40:36.643 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-22T03:40:39.358 INFO:teuthology.task.kernel:Checking client mgr.x for new kernel version... 2024-09-22T03:40:39.358 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi098.front.sepia.ceph.com' 2024-09-22T03:40:39.358 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-22T03:40:55.155 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.37 2024-09-22T03:40:57.711 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.98 2024-09-22T03:41:04.158 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com' 2024-09-22T03:41:04.159 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-22T03:41:06.714 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi098.front.sepia.ceph.com' 2024-09-22T03:41:06.715 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-22T03:41:09.775 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.98 2024-09-22T03:41:21.786 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi098.front.sepia.ceph.com' 2024-09-22T03:41:21.787 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-22T03:41:22.543 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.37 2024-09-22T03:41:34.551 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com' 2024-09-22T03:41:34.552 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-22T03:41:37.615 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.37 2024-09-22T03:41:52.629 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com' 2024-09-22T03:41:52.630 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-22T03:41:52.899 DEBUG:teuthology.orchestra.run.smithi037:> true 2024-09-22T03:41:53.247 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi037.front.sepia.ceph.com' 2024-09-22T03:41:53.247 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-508.el9.x86_64"... 2024-09-22T03:41:53.247 DEBUG:teuthology.orchestra.run.smithi037:> uname -r 2024-09-22T03:41:53.264 INFO:teuthology.orchestra.run.smithi037.stdout:5.14.0-508.el9.x86_64 2024-09-22T03:41:53.264 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-22T03:41:53.264 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-22T03:41:53.264 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-22T03:41:53.594 DEBUG:teuthology.orchestra.run.smithi098:> true 2024-09-22T03:41:53.952 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi098.front.sepia.ceph.com' 2024-09-22T03:41:53.952 INFO:teuthology.task.kernel:Checking kernel version of mgr.x, want "5.14.0-508.el9.x86_64"... 2024-09-22T03:41:53.952 DEBUG:teuthology.orchestra.run.smithi098:> uname -r 2024-09-22T03:41:53.966 INFO:teuthology.orchestra.run.smithi098.stdout:5.14.0-508.el9.x86_64 2024-09-22T03:41:53.966 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-22T03:41:53.967 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-22T03:41:53.967 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-22T03:41:54.265 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-22T03:41:54.266 DEBUG:teuthology.orchestra.run.smithi037:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-22T03:41:54.346 INFO:teuthology.orchestra.run.smithi037.stdout:ttyS1 2024-09-22T03:41:54.369 DEBUG:teuthology.parallel:result is None 2024-09-22T03:41:54.967 INFO:teuthology.task.kernel:Enabling kdb on mgr.x... 2024-09-22T03:41:54.967 DEBUG:teuthology.orchestra.run.smithi098:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-22T03:41:55.087 INFO:teuthology.orchestra.run.smithi098.stdout:ttyS1 2024-09-22T03:41:55.108 DEBUG:teuthology.parallel:result is None 2024-09-22T03:41:55.108 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-22T03:41:55.117 INFO:teuthology.task.internal:Creating test directory... 2024-09-22T03:41:55.117 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-22T03:41:55.121 DEBUG:teuthology.orchestra.run.smithi098:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-22T03:41:55.139 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-22T03:41:55.146 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-22T03:41:55.156 INFO:teuthology.task.internal:Creating archive directory... 2024-09-22T03:41:55.157 DEBUG:teuthology.orchestra.run.smithi037:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-22T03:41:55.181 DEBUG:teuthology.orchestra.run.smithi098:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-22T03:41:55.213 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-22T03:41:55.219 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-22T03:41:55.220 DEBUG:teuthology.orchestra.run.smithi037:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-22T03:41:55.251 DEBUG:teuthology.orchestra.run.smithi098:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-22T03:41:55.286 INFO:teuthology.orchestra.run.smithi098.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-22T03:41:55.287 INFO:teuthology.orchestra.run.smithi037.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-22T03:41:55.297 INFO:teuthology.orchestra.run.smithi098.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-22T03:41:55.298 INFO:teuthology.orchestra.run.smithi037.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-22T03:41:55.300 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-22T03:41:55.307 INFO:teuthology.task.internal:Configuring sudo... 2024-09-22T03:41:55.307 DEBUG:teuthology.orchestra.run.smithi037:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-22T03:41:55.343 DEBUG:teuthology.orchestra.run.smithi098:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-22T03:41:55.368 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-22T03:41:55.383 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-22T03:41:55.383 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-22T03:41:55.411 DEBUG:teuthology.orchestra.run.smithi098:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-22T03:41:55.426 DEBUG:teuthology.orchestra.run.smithi037:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-22T03:41:55.503 DEBUG:teuthology.orchestra.run.smithi037:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-22T03:41:55.566 DEBUG:teuthology.orchestra.run.smithi037:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-22T03:41:55.647 DEBUG:teuthology.orchestra.run.smithi037:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-22T03:41:55.694 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-22T03:41:55.694 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-22T03:41:55.761 DEBUG:teuthology.orchestra.run.smithi098:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-22T03:41:55.801 DEBUG:teuthology.orchestra.run.smithi098:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-22T03:41:55.863 DEBUG:teuthology.orchestra.run.smithi098:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-22T03:41:55.898 DEBUG:teuthology.orchestra.run.smithi098:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-22T03:41:55.944 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-22T03:41:55.944 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-22T03:41:56.009 DEBUG:teuthology.orchestra.run.smithi037:> sudo service rsyslog restart 2024-09-22T03:41:56.011 DEBUG:teuthology.orchestra.run.smithi098:> sudo service rsyslog restart 2024-09-22T03:41:56.059 INFO:teuthology.orchestra.run.smithi037.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-22T03:41:56.119 INFO:teuthology.orchestra.run.smithi098.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-22T03:41:56.568 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-22T03:41:56.582 INFO:teuthology.task.internal:Starting timer... 2024-09-22T03:41:56.582 INFO:teuthology.run_tasks:Running task pcp... 2024-09-22T03:41:56.592 INFO:teuthology.run_tasks:Running task selinux... 2024-09-22T03:41:56.622 DEBUG:teuthology.orchestra.run.smithi037:> sudo service auditd rotate 2024-09-22T03:41:56.692 INFO:teuthology.orchestra.run.smithi037.stdout:Rotating logs: 2024-09-22T03:41:56.694 DEBUG:teuthology.orchestra.run.smithi098:> sudo service auditd rotate 2024-09-22T03:41:56.783 INFO:teuthology.orchestra.run.smithi098.stdout:Rotating logs: 2024-09-22T03:41:56.785 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-22T03:41:56.785 DEBUG:teuthology.orchestra.run.smithi037:> /usr/sbin/getenforce 2024-09-22T03:41:56.812 INFO:teuthology.orchestra.run.smithi037.stdout:Permissive 2024-09-22T03:41:56.812 DEBUG:teuthology.orchestra.run.smithi098:> /usr/sbin/getenforce 2024-09-22T03:41:56.874 INFO:teuthology.orchestra.run.smithi098.stdout:Permissive 2024-09-22T03:41:56.874 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi037.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi098.front.sepia.ceph.com': 'permissive'} 2024-09-22T03:41:56.875 DEBUG:teuthology.orchestra.run.smithi037:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-22T03:41:56.904 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-22T03:41:56.904 DEBUG:teuthology.orchestra.run.smithi098:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-22T03:41:56.973 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-22T03:41:56.973 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-22T03:41:56.974 DEBUG:teuthology.orchestra.run.smithi037:> sudo /usr/sbin/setenforce permissive 2024-09-22T03:41:57.007 DEBUG:teuthology.orchestra.run.smithi098:> sudo /usr/sbin/setenforce permissive 2024-09-22T03:41:57.268 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-22T03:41:57.277 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-22T03:41:57.288 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-22T03:41:57.290 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi037.front.sepia.ceph.com,smithi098.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-22T03:45:42.080 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi037.front.sepia.ceph.com'), Remote(name='ubuntu@smithi098.front.sepia.ceph.com')] 2024-09-22T03:45:42.081 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com' 2024-09-22T03:45:42.082 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-22T03:45:42.160 DEBUG:teuthology.orchestra.run.smithi037:> true 2024-09-22T03:45:42.238 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi037.front.sepia.ceph.com' 2024-09-22T03:45:42.239 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi098.front.sepia.ceph.com' 2024-09-22T03:45:42.239 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-22T03:45:42.313 DEBUG:teuthology.orchestra.run.smithi098:> true 2024-09-22T03:45:42.394 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi098.front.sepia.ceph.com' 2024-09-22T03:45:42.394 INFO:teuthology.run_tasks:Running task clock... 2024-09-22T03:45:42.415 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-22T03:45:42.415 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-22T03:45:42.415 DEBUG:teuthology.orchestra.run.smithi037:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-22T03:45:42.418 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-22T03:45:42.418 DEBUG:teuthology.orchestra.run.smithi098:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-22T03:45:42.448 INFO:teuthology.orchestra.run.smithi037.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-22T03:45:42.465 INFO:teuthology.orchestra.run.smithi037.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-22T03:45:42.466 INFO:teuthology.orchestra.run.smithi098.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-22T03:45:42.481 INFO:teuthology.orchestra.run.smithi098.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-22T03:45:42.491 INFO:teuthology.orchestra.run.smithi037.stderr:sudo: ntpd: command not found 2024-09-22T03:45:42.503 INFO:teuthology.orchestra.run.smithi037.stdout:506 Cannot talk to daemon 2024-09-22T03:45:42.506 INFO:teuthology.orchestra.run.smithi098.stderr:sudo: ntpd: command not found 2024-09-22T03:45:42.517 INFO:teuthology.orchestra.run.smithi098.stdout:506 Cannot talk to daemon 2024-09-22T03:45:42.518 INFO:teuthology.orchestra.run.smithi037.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-22T03:45:42.531 INFO:teuthology.orchestra.run.smithi098.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-22T03:45:42.533 INFO:teuthology.orchestra.run.smithi037.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-22T03:45:42.544 INFO:teuthology.orchestra.run.smithi098.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-22T03:45:42.589 INFO:teuthology.orchestra.run.smithi037.stderr:bash: line 1: ntpq: command not found 2024-09-22T03:45:42.593 INFO:teuthology.orchestra.run.smithi037.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-22T03:45:42.593 INFO:teuthology.orchestra.run.smithi037.stdout:=============================================================================== 2024-09-22T03:45:42.594 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-22T03:45:42.594 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-22T03:45:42.594 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-22T03:45:42.594 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-22T03:45:42.599 INFO:teuthology.orchestra.run.smithi098.stderr:bash: line 1: ntpq: command not found 2024-09-22T03:45:42.603 INFO:teuthology.orchestra.run.smithi098.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-22T03:45:42.603 INFO:teuthology.orchestra.run.smithi098.stdout:=============================================================================== 2024-09-22T03:45:42.603 INFO:teuthology.orchestra.run.smithi098.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-22T03:45:42.603 INFO:teuthology.orchestra.run.smithi098.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-22T03:45:42.603 INFO:teuthology.orchestra.run.smithi098.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-22T03:45:42.603 INFO:teuthology.orchestra.run.smithi098.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-22T03:45:42.604 INFO:teuthology.run_tasks:Running task install... 2024-09-22T03:45:42.612 DEBUG:teuthology.task.install:project ceph 2024-09-22T03:45:42.613 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'crimson', 'sha1': '62da54b4b83a96ca9976b7e1d0c8272a564a2208'}} 2024-09-22T03:45:42.613 DEBUG:teuthology.task.install:config {'flavor': 'crimson', 'sha1': '62da54b4b83a96ca9976b7e1d0c8272a564a2208'} 2024-09-22T03:45:42.613 INFO:teuthology.task.install:Using flavor: crimson 2024-09-22T03:45:42.618 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-22T03:45:42.618 INFO:teuthology.task.install:extra packages: [] 2024-09-22T03:45:42.619 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'crimson', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '62da54b4b83a96ca9976b7e1d0c8272a564a2208', 'tag': None, 'wait_for_package': False} 2024-09-22T03:45:42.619 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=62da54b4b83a96ca9976b7e1d0c8272a564a2208 2024-09-22T03:45:42.620 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'crimson', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '62da54b4b83a96ca9976b7e1d0c8272a564a2208', 'tag': None, 'wait_for_package': False} 2024-09-22T03:45:42.621 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=62da54b4b83a96ca9976b7e1d0c8272a564a2208 2024-09-22T03:45:42.762 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/main/62da54b4b83a96ca9976b7e1d0c8272a564a2208/centos/9/flavors/crimson/ 2024-09-22T03:45:42.762 INFO:teuthology.task.install.rpm:Package version is 19.3.0-5092.g62da54b4 2024-09-22T03:45:42.777 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/main/62da54b4b83a96ca9976b7e1d0c8272a564a2208/centos/9/flavors/crimson/ 2024-09-22T03:45:42.778 INFO:teuthology.task.install.rpm:Package version is 19.3.0-5092.g62da54b4 2024-09-22T03:45:42.883 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/main/62da54b4b83a96ca9976b7e1d0c8272a564a2208/centos/9/flavors/crimson/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/main/62da54b4b83a96ca9976b7e1d0c8272a564a2208/centos/9/flavors/crimson/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/main/62da54b4b83a96ca9976b7e1d0c8272a564a2208/centos/9/flavors/crimson/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-22T03:45:42.883 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-22T03:45:42.883 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-22T03:45:42.901 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/main/62da54b4b83a96ca9976b7e1d0c8272a564a2208/centos/9/flavors/crimson/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/main/62da54b4b83a96ca9976b7e1d0c8272a564a2208/centos/9/flavors/crimson/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/main/62da54b4b83a96ca9976b7e1d0c8272a564a2208/centos/9/flavors/crimson/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-22T03:45:42.901 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-22T03:45:42.901 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-22T03:45:42.910 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-22T03:45:42.911 DEBUG:teuthology.orchestra.run.smithi037:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/62da54b4b83a96ca9976b7e1d0c8272a564a2208/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-22T03:45:42.928 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-22T03:45:42.928 DEBUG:teuthology.orchestra.run.smithi098:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/62da54b4b83a96ca9976b7e1d0c8272a564a2208/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-22T03:45:42.978 DEBUG:teuthology.orchestra.run.smithi037:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-22T03:45:42.994 DEBUG:teuthology.orchestra.run.smithi098:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-22T03:45:43.056 DEBUG:teuthology.orchestra.run.smithi037:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-22T03:45:43.069 DEBUG:teuthology.orchestra.run.smithi098:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-22T03:45:43.121 INFO:teuthology.orchestra.run.smithi037.stdout:check_obsoletes = 1 2024-09-22T03:45:43.123 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum clean all 2024-09-22T03:45:43.134 INFO:teuthology.orchestra.run.smithi098.stdout:check_obsoletes = 1 2024-09-22T03:45:43.136 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum clean all 2024-09-22T03:45:43.364 INFO:teuthology.orchestra.run.smithi037.stdout:45 files removed 2024-09-22T03:45:43.374 INFO:teuthology.orchestra.run.smithi098.stdout:45 files removed 2024-09-22T03:45:43.391 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install ceph-radosgw 2024-09-22T03:45:43.402 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install ceph-radosgw 2024-09-22T03:45:43.967 INFO:teuthology.orchestra.run.smithi037.stdout:ceph packages for x86_64 319 kB/s | 88 kB 00:00 2024-09-22T03:45:43.975 INFO:teuthology.orchestra.run.smithi098.stdout:ceph packages for x86_64 306 kB/s | 88 kB 00:00 2024-09-22T03:45:44.268 INFO:teuthology.orchestra.run.smithi098.stdout:ceph noarch packages 98 kB/s | 24 kB 00:00 2024-09-22T03:45:44.268 INFO:teuthology.orchestra.run.smithi037.stdout:ceph noarch packages 95 kB/s | 24 kB 00:00 2024-09-22T03:45:44.543 INFO:teuthology.orchestra.run.smithi098.stdout:ceph source packages 8.7 kB/s | 2.1 kB 00:00 2024-09-22T03:45:44.543 INFO:teuthology.orchestra.run.smithi037.stdout:ceph source packages 8.8 kB/s | 2.1 kB 00:00 2024-09-22T03:45:45.085 INFO:teuthology.orchestra.run.smithi098.stdout:CentOS Stream 9 - BaseOS 16 MB/s | 8.3 MB 00:00 2024-09-22T03:45:47.085 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - BaseOS 3.3 MB/s | 8.3 MB 00:02 2024-09-22T03:45:48.953 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - AppStream 28 MB/s | 20 MB 00:00 2024-09-22T03:45:49.928 INFO:teuthology.orchestra.run.smithi098.stdout:CentOS Stream 9 - AppStream 5.4 MB/s | 20 MB 00:03 2024-09-22T03:45:53.379 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.5 MB 00:00 2024-09-22T03:45:54.120 INFO:teuthology.orchestra.run.smithi098.stdout:CentOS Stream 9 - CRB 17 MB/s | 6.5 MB 00:00 2024-09-22T03:45:55.179 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - Extras packages 40 kB/s | 19 kB 00:00 2024-09-22T03:45:55.546 INFO:teuthology.orchestra.run.smithi098.stdout:CentOS Stream 9 - Extras packages 105 kB/s | 19 kB 00:00 2024-09-22T03:45:56.785 INFO:teuthology.orchestra.run.smithi037.stdout:Extra Packages for Enterprise Linux 15 MB/s | 23 MB 00:01 2024-09-22T03:45:56.993 INFO:teuthology.orchestra.run.smithi098.stdout:Extra Packages for Enterprise Linux 17 MB/s | 23 MB 00:01 2024-09-22T03:46:02.381 INFO:teuthology.orchestra.run.smithi098.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-09-22T03:46:02.440 INFO:teuthology.orchestra.run.smithi037.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-22T03:46:04.633 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-22T03:46:04.647 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-22T03:46:04.647 INFO:teuthology.orchestra.run.smithi098.stdout: Package Arch Version Repository Size 2024-09-22T03:46:04.647 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-22T03:46:04.647 INFO:teuthology.orchestra.run.smithi098.stdout:Installing: 2024-09-22T03:46:04.647 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-radosgw x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 10 M 2024-09-22T03:46:04.647 INFO:teuthology.orchestra.run.smithi098.stdout:Upgrading: 2024-09-22T03:46:04.647 INFO:teuthology.orchestra.run.smithi098.stdout: librados2 x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 3.5 M 2024-09-22T03:46:04.648 INFO:teuthology.orchestra.run.smithi098.stdout: librbd1 x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 3.8 M 2024-09-22T03:46:04.648 INFO:teuthology.orchestra.run.smithi098.stdout:Installing dependencies: 2024-09-22T03:46:04.648 INFO:teuthology.orchestra.run.smithi098.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-22T03:46:04.648 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-base x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 6.1 M 2024-09-22T03:46:04.648 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-common x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 20 M 2024-09-22T03:46:04.648 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-selinux x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 25 k 2024-09-22T03:46:04.648 INFO:teuthology.orchestra.run.smithi098.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-22T03:46:04.648 INFO:teuthology.orchestra.run.smithi098.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-22T03:46:04.648 INFO:teuthology.orchestra.run.smithi098.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-22T03:46:04.648 INFO:teuthology.orchestra.run.smithi098.stdout: libcephfs2 x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 808 k 2024-09-22T03:46:04.648 INFO:teuthology.orchestra.run.smithi098.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-22T03:46:04.648 INFO:teuthology.orchestra.run.smithi098.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-22T03:46:04.649 INFO:teuthology.orchestra.run.smithi098.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-22T03:46:04.649 INFO:teuthology.orchestra.run.smithi098.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-22T03:46:04.649 INFO:teuthology.orchestra.run.smithi098.stdout: libradosstriper1 x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 558 k 2024-09-22T03:46:04.649 INFO:teuthology.orchestra.run.smithi098.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-22T03:46:04.649 INFO:teuthology.orchestra.run.smithi098.stdout: librgw2 x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 5.4 M 2024-09-22T03:46:04.649 INFO:teuthology.orchestra.run.smithi098.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-22T03:46:04.649 INFO:teuthology.orchestra.run.smithi098.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-22T03:46:04.649 INFO:teuthology.orchestra.run.smithi098.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-22T03:46:04.649 INFO:teuthology.orchestra.run.smithi098.stdout: python3-ceph-argparse x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 45 k 2024-09-22T03:46:04.649 INFO:teuthology.orchestra.run.smithi098.stdout: python3-ceph-common x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 148 k 2024-09-22T03:46:04.649 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cephfs x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 159 k 2024-09-22T03:46:04.649 INFO:teuthology.orchestra.run.smithi098.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-22T03:46:04.649 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rados x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 314 k 2024-09-22T03:46:04.650 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rbd x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 302 k 2024-09-22T03:46:04.650 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rgw x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 99 k 2024-09-22T03:46:04.650 INFO:teuthology.orchestra.run.smithi098.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-22T03:46:04.650 INFO:teuthology.orchestra.run.smithi098.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-22T03:46:04.650 INFO:teuthology.orchestra.run.smithi098.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-22T03:46:04.650 INFO:teuthology.orchestra.run.smithi098.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-22T03:46:04.650 INFO:teuthology.orchestra.run.smithi098.stdout:Installing weak dependencies: 2024-09-22T03:46:04.650 INFO:teuthology.orchestra.run.smithi098.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-22T03:46:04.650 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-22T03:46:04.650 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction Summary 2024-09-22T03:46:04.650 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-22T03:46:04.650 INFO:teuthology.orchestra.run.smithi098.stdout:Install 31 Packages 2024-09-22T03:46:04.651 INFO:teuthology.orchestra.run.smithi098.stdout:Upgrade 2 Packages 2024-09-22T03:46:04.651 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-22T03:46:04.651 INFO:teuthology.orchestra.run.smithi098.stdout:Total download size: 60 M 2024-09-22T03:46:04.651 INFO:teuthology.orchestra.run.smithi098.stdout:Downloading Packages: 2024-09-22T03:46:04.737 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-09-22T03:46:04.758 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-09-22T03:46:04.759 INFO:teuthology.orchestra.run.smithi037.stdout: Package Arch Version Repository Size 2024-09-22T03:46:04.759 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-09-22T03:46:04.759 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2024-09-22T03:46:04.759 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-radosgw x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 10 M 2024-09-22T03:46:04.759 INFO:teuthology.orchestra.run.smithi037.stdout:Upgrading: 2024-09-22T03:46:04.759 INFO:teuthology.orchestra.run.smithi037.stdout: librados2 x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 3.5 M 2024-09-22T03:46:04.759 INFO:teuthology.orchestra.run.smithi037.stdout: librbd1 x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 3.8 M 2024-09-22T03:46:04.759 INFO:teuthology.orchestra.run.smithi037.stdout:Installing dependencies: 2024-09-22T03:46:04.759 INFO:teuthology.orchestra.run.smithi037.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-22T03:46:04.759 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-base x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 6.1 M 2024-09-22T03:46:04.759 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-common x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 20 M 2024-09-22T03:46:04.759 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-selinux x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 25 k 2024-09-22T03:46:04.760 INFO:teuthology.orchestra.run.smithi037.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-22T03:46:04.760 INFO:teuthology.orchestra.run.smithi037.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-22T03:46:04.760 INFO:teuthology.orchestra.run.smithi037.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-22T03:46:04.760 INFO:teuthology.orchestra.run.smithi037.stdout: libcephfs2 x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 808 k 2024-09-22T03:46:04.760 INFO:teuthology.orchestra.run.smithi037.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-22T03:46:04.760 INFO:teuthology.orchestra.run.smithi037.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-22T03:46:04.760 INFO:teuthology.orchestra.run.smithi037.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-22T03:46:04.760 INFO:teuthology.orchestra.run.smithi037.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-22T03:46:04.760 INFO:teuthology.orchestra.run.smithi037.stdout: libradosstriper1 x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 558 k 2024-09-22T03:46:04.760 INFO:teuthology.orchestra.run.smithi037.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-22T03:46:04.760 INFO:teuthology.orchestra.run.smithi037.stdout: librgw2 x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 5.4 M 2024-09-22T03:46:04.760 INFO:teuthology.orchestra.run.smithi037.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-22T03:46:04.760 INFO:teuthology.orchestra.run.smithi037.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-22T03:46:04.761 INFO:teuthology.orchestra.run.smithi037.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-22T03:46:04.761 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ceph-argparse x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 45 k 2024-09-22T03:46:04.761 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ceph-common x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 148 k 2024-09-22T03:46:04.761 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cephfs x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 159 k 2024-09-22T03:46:04.761 INFO:teuthology.orchestra.run.smithi037.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-22T03:46:04.761 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rados x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 314 k 2024-09-22T03:46:04.761 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rbd x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 302 k 2024-09-22T03:46:04.761 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rgw x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 99 k 2024-09-22T03:46:04.761 INFO:teuthology.orchestra.run.smithi037.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-22T03:46:04.761 INFO:teuthology.orchestra.run.smithi037.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-22T03:46:04.761 INFO:teuthology.orchestra.run.smithi037.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-22T03:46:04.761 INFO:teuthology.orchestra.run.smithi037.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-22T03:46:04.761 INFO:teuthology.orchestra.run.smithi037.stdout:Installing weak dependencies: 2024-09-22T03:46:04.761 INFO:teuthology.orchestra.run.smithi037.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-22T03:46:04.761 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:46:04.762 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2024-09-22T03:46:04.762 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-09-22T03:46:04.762 INFO:teuthology.orchestra.run.smithi037.stdout:Install 31 Packages 2024-09-22T03:46:04.762 INFO:teuthology.orchestra.run.smithi037.stdout:Upgrade 2 Packages 2024-09-22T03:46:04.762 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:46:04.762 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 60 M 2024-09-22T03:46:04.762 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2024-09-22T03:46:05.941 INFO:teuthology.orchestra.run.smithi037.stdout:(1/33): ceph-base-19.3.0-5092.g62da54b4.el9.x86 6.8 MB/s | 6.1 MB 00:00 2024-09-22T03:46:05.941 INFO:teuthology.orchestra.run.smithi098.stdout:(1/33): ceph-base-19.3.0-5092.g62da54b4.el9.x86 6.7 MB/s | 6.1 MB 00:00 2024-09-22T03:46:06.008 INFO:teuthology.orchestra.run.smithi037.stdout:(2/33): ceph-selinux-19.3.0-5092.g62da54b4.el9. 378 kB/s | 25 kB 00:00 2024-09-22T03:46:06.024 INFO:teuthology.orchestra.run.smithi098.stdout:(2/33): ceph-selinux-19.3.0-5092.g62da54b4.el9. 302 kB/s | 25 kB 00:00 2024-09-22T03:46:06.233 INFO:teuthology.orchestra.run.smithi098.stdout:(3/33): ceph-radosgw-19.3.0-5092.g62da54b4.el9. 8.7 MB/s | 10 MB 00:01 2024-09-22T03:46:06.258 INFO:teuthology.orchestra.run.smithi037.stdout:(3/33): libcephfs2-19.3.0-5092.g62da54b4.el9.x8 3.2 MB/s | 808 kB 00:00 2024-09-22T03:46:06.300 INFO:teuthology.orchestra.run.smithi098.stdout:(4/33): libradosstriper1-19.3.0-5092.g62da54b4. 8.2 MB/s | 558 kB 00:00 2024-09-22T03:46:06.433 INFO:teuthology.orchestra.run.smithi037.stdout:(4/33): libradosstriper1-19.3.0-5092.g62da54b4. 3.1 MB/s | 558 kB 00:00 2024-09-22T03:46:06.450 INFO:teuthology.orchestra.run.smithi098.stdout:(5/33): libcephfs2-19.3.0-5092.g62da54b4.el9.x8 1.9 MB/s | 808 kB 00:00 2024-09-22T03:46:06.517 INFO:teuthology.orchestra.run.smithi098.stdout:(6/33): python3-ceph-argparse-19.3.0-5092.g62da 677 kB/s | 45 kB 00:00 2024-09-22T03:46:06.618 INFO:teuthology.orchestra.run.smithi098.stdout:(7/33): python3-ceph-common-19.3.0-5092.g62da54 1.4 MB/s | 148 kB 00:00 2024-09-22T03:46:06.659 INFO:teuthology.orchestra.run.smithi037.stdout:(5/33): ceph-radosgw-19.3.0-5092.g62da54b4.el9. 6.4 MB/s | 10 MB 00:01 2024-09-22T03:46:06.810 INFO:teuthology.orchestra.run.smithi098.stdout:(8/33): ceph-common-19.3.0-5092.g62da54b4.el9.x 11 MB/s | 20 MB 00:01 2024-09-22T03:46:06.835 INFO:teuthology.orchestra.run.smithi098.stdout:(9/33): python3-cephfs-19.3.0-5092.g62da54b4.el 735 kB/s | 159 kB 00:00 2024-09-22T03:46:06.859 INFO:teuthology.orchestra.run.smithi037.stdout:(6/33): ceph-common-19.3.0-5092.g62da54b4.el9.x 11 MB/s | 20 MB 00:01 2024-09-22T03:46:06.860 INFO:teuthology.orchestra.run.smithi098.stdout:(10/33): python3-rados-19.3.0-5092.g62da54b4.el 6.1 MB/s | 314 kB 00:00 2024-09-22T03:46:06.884 INFO:teuthology.orchestra.run.smithi037.stdout:(7/33): python3-ceph-argparse-19.3.0-5092.g62da 200 kB/s | 45 kB 00:00 2024-09-22T03:46:06.909 INFO:teuthology.orchestra.run.smithi037.stdout:(8/33): python3-ceph-common-19.3.0-5092.g62da54 2.9 MB/s | 148 kB 00:00 2024-09-22T03:46:06.934 INFO:teuthology.orchestra.run.smithi037.stdout:(9/33): python3-cephfs-19.3.0-5092.g62da54b4.el 3.1 MB/s | 159 kB 00:00 2024-09-22T03:46:06.944 INFO:teuthology.orchestra.run.smithi098.stdout:(11/33): librgw2-19.3.0-5092.g62da54b4.el9.x86_ 8.3 MB/s | 5.4 MB 00:00 2024-09-22T03:46:06.960 INFO:teuthology.orchestra.run.smithi037.stdout:(10/33): python3-rados-19.3.0-5092.g62da54b4.el 6.1 MB/s | 314 kB 00:00 2024-09-22T03:46:06.960 INFO:teuthology.orchestra.run.smithi098.stdout:(12/33): python3-rgw-19.3.0-5092.g62da54b4.el9. 991 kB/s | 99 kB 00:00 2024-09-22T03:46:06.985 INFO:teuthology.orchestra.run.smithi037.stdout:(11/33): python3-rbd-19.3.0-5092.g62da54b4.el9. 5.9 MB/s | 302 kB 00:00 2024-09-22T03:46:06.986 INFO:teuthology.orchestra.run.smithi098.stdout:(13/33): python3-rbd-19.3.0-5092.g62da54b4.el9. 2.0 MB/s | 302 kB 00:00 2024-09-22T03:46:07.011 INFO:teuthology.orchestra.run.smithi037.stdout:(12/33): python3-rgw-19.3.0-5092.g62da54b4.el9. 1.9 MB/s | 99 kB 00:00 2024-09-22T03:46:07.103 INFO:teuthology.orchestra.run.smithi098.stdout:(14/33): boost-program-options-1.75.0-8.el9.x86 673 kB/s | 107 kB 00:00 2024-09-22T03:46:07.119 INFO:teuthology.orchestra.run.smithi037.stdout:(13/33): libnbd-1.20.2-2.el9.x86_64.rpm 1.5 MB/s | 171 kB 00:00 2024-09-22T03:46:07.128 INFO:teuthology.orchestra.run.smithi098.stdout:(15/33): libnbd-1.20.2-2.el9.x86_64.rpm 1.0 MB/s | 171 kB 00:00 2024-09-22T03:46:07.144 INFO:teuthology.orchestra.run.smithi037.stdout:(14/33): boost-program-options-1.75.0-8.el9.x86 673 kB/s | 107 kB 00:00 2024-09-22T03:46:07.153 INFO:teuthology.orchestra.run.smithi098.stdout:(16/33): libpmemobj-1.12.1-1.el9.x86_64.rpm 958 kB/s | 160 kB 00:00 2024-09-22T03:46:07.179 INFO:teuthology.orchestra.run.smithi098.stdout:(17/33): librabbitmq-0.11.0-7.el9.x86_64.rpm 600 kB/s | 45 kB 00:00 2024-09-22T03:46:07.186 INFO:teuthology.orchestra.run.smithi037.stdout:(15/33): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.3 MB/s | 160 kB 00:00 2024-09-22T03:46:07.220 INFO:teuthology.orchestra.run.smithi037.stdout:(16/33): librabbitmq-0.11.0-7.el9.x86_64.rpm 600 kB/s | 45 kB 00:00 2024-09-22T03:46:07.229 INFO:teuthology.orchestra.run.smithi098.stdout:(18/33): python3-prettytable-0.7.2-27.el9.noarc 843 kB/s | 42 kB 00:00 2024-09-22T03:46:07.254 INFO:teuthology.orchestra.run.smithi098.stdout:(19/33): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.8 MB/s | 292 kB 00:00 2024-09-22T03:46:07.270 INFO:teuthology.orchestra.run.smithi037.stdout:(17/33): librdkafka-1.6.1-102.el9.x86_64.rpm 7.7 MB/s | 662 kB 00:00 2024-09-22T03:46:07.280 INFO:teuthology.orchestra.run.smithi098.stdout:(20/33): librdkafka-1.6.1-102.el9.x86_64.rpm 4.3 MB/s | 662 kB 00:00 2024-09-22T03:46:07.305 INFO:teuthology.orchestra.run.smithi098.stdout:(21/33): qatlib-service-24.02.0-1.el9.x86_64.rp 713 kB/s | 36 kB 00:00 2024-09-22T03:46:07.321 INFO:teuthology.orchestra.run.smithi037.stdout:(18/33): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.8 MB/s | 292 kB 00:00 2024-09-22T03:46:07.330 INFO:teuthology.orchestra.run.smithi098.stdout:(22/33): qatzip-libs-1.2.0-1.el9.x86_64.rpm 944 kB/s | 47 kB 00:00 2024-09-22T03:46:07.346 INFO:teuthology.orchestra.run.smithi037.stdout:(19/33): python3-prettytable-0.7.2-27.el9.noarc 560 kB/s | 42 kB 00:00 2024-09-22T03:46:07.355 INFO:teuthology.orchestra.run.smithi098.stdout:(23/33): qatlib-24.02.0-1.el9.x86_64.rpm 1.7 MB/s | 221 kB 00:00 2024-09-22T03:46:07.414 INFO:teuthology.orchestra.run.smithi098.stdout:(24/33): gperftools-libs-2.9.1-3.el9.x86_64.rpm 2.8 MB/s | 308 kB 00:00 2024-09-22T03:46:07.430 INFO:teuthology.orchestra.run.smithi037.stdout:(20/33): librgw2-19.3.0-5092.g62da54b4.el9.x86_ 5.4 MB/s | 5.4 MB 00:00 2024-09-22T03:46:07.439 INFO:teuthology.orchestra.run.smithi098.stdout:(25/33): liboath-2.6.7-2.el9.x86_64.rpm 2.1 MB/s | 49 kB 00:00 2024-09-22T03:46:07.455 INFO:teuthology.orchestra.run.smithi037.stdout:(21/33): qatlib-service-24.02.0-1.el9.x86_64.rp 331 kB/s | 36 kB 00:00 2024-09-22T03:46:07.465 INFO:teuthology.orchestra.run.smithi098.stdout:(26/33): libarrow-doc-9.0.0-11.el9.noarch.rpm 275 kB/s | 26 kB 00:00 2024-09-22T03:46:07.480 INFO:teuthology.orchestra.run.smithi037.stdout:(22/33): qatlib-24.02.0-1.el9.x86_64.rpm 1.4 MB/s | 221 kB 00:00 2024-09-22T03:46:07.490 INFO:teuthology.orchestra.run.smithi098.stdout:(27/33): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-22T03:46:07.524 INFO:teuthology.orchestra.run.smithi098.stdout:(28/33): re2-20211101-20.el9.x86_64.rpm 5.6 MB/s | 191 kB 00:00 2024-09-22T03:46:07.539 INFO:teuthology.orchestra.run.smithi037.stdout:(23/33): qatzip-libs-1.2.0-1.el9.x86_64.rpm 436 kB/s | 47 kB 00:00 2024-09-22T03:46:07.581 INFO:teuthology.orchestra.run.smithi037.stdout:(24/33): gperftools-libs-2.9.1-3.el9.x86_64.rpm 2.4 MB/s | 308 kB 00:00 2024-09-22T03:46:07.607 INFO:teuthology.orchestra.run.smithi098.stdout:(29/33): parquet-libs-9.0.0-11.el9.x86_64.rpm 5.8 MB/s | 839 kB 00:00 2024-09-22T03:46:07.614 INFO:teuthology.orchestra.run.smithi037.stdout:(25/33): liboath-2.6.7-2.el9.x86_64.rpm 1.5 MB/s | 49 kB 00:00 2024-09-22T03:46:07.640 INFO:teuthology.orchestra.run.smithi037.stdout:(26/33): libarrow-doc-9.0.0-11.el9.noarch.rpm 259 kB/s | 26 kB 00:00 2024-09-22T03:46:07.665 INFO:teuthology.orchestra.run.smithi037.stdout:(27/33): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-22T03:46:07.674 INFO:teuthology.orchestra.run.smithi098.stdout:(30/33): thrift-0.15.0-2.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-09-22T03:46:07.706 INFO:teuthology.orchestra.run.smithi037.stdout:(28/33): re2-20211101-20.el9.x86_64.rpm 4.5 MB/s | 191 kB 00:00 2024-09-22T03:46:07.774 INFO:teuthology.orchestra.run.smithi037.stdout:(29/33): parquet-libs-9.0.0-11.el9.x86_64.rpm 6.1 MB/s | 839 kB 00:00 2024-09-22T03:46:07.800 INFO:teuthology.orchestra.run.smithi098.stdout:(31/33): libarrow-9.0.0-11.el9.x86_64.rpm 9.4 MB/s | 4.4 MB 00:00 2024-09-22T03:46:07.883 INFO:teuthology.orchestra.run.smithi037.stdout:(30/33): thrift-0.15.0-2.el9.x86_64.rpm 9.0 MB/s | 1.6 MB 00:00 2024-09-22T03:46:07.941 INFO:teuthology.orchestra.run.smithi098.stdout:(32/33): librbd1-19.3.0-5092.g62da54b4.el9.x86_ 14 MB/s | 3.8 MB 00:00 2024-09-22T03:46:08.024 INFO:teuthology.orchestra.run.smithi037.stdout:(31/33): libarrow-9.0.0-11.el9.x86_64.rpm 8.2 MB/s | 4.4 MB 00:00 2024-09-22T03:46:08.200 INFO:teuthology.orchestra.run.smithi037.stdout:(32/33): librbd1-19.3.0-5092.g62da54b4.el9.x86_ 12 MB/s | 3.8 MB 00:00 2024-09-22T03:46:08.217 INFO:teuthology.orchestra.run.smithi098.stdout:(33/33): librados2-19.3.0-5092.g62da54b4.el9.x8 5.7 MB/s | 3.5 MB 00:00 2024-09-22T03:46:08.222 INFO:teuthology.orchestra.run.smithi098.stdout:-------------------------------------------------------------------------------- 2024-09-22T03:46:08.222 INFO:teuthology.orchestra.run.smithi098.stdout:Total 17 MB/s | 60 MB 00:03 2024-09-22T03:46:08.258 INFO:teuthology.orchestra.run.smithi037.stdout:(33/33): librados2-19.3.0-5092.g62da54b4.el9.x8 7.2 MB/s | 3.5 MB 00:00 2024-09-22T03:46:08.264 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2024-09-22T03:46:08.264 INFO:teuthology.orchestra.run.smithi037.stdout:Total 17 MB/s | 60 MB 00:03 2024-09-22T03:46:08.336 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction check 2024-09-22T03:46:08.372 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction check succeeded. 2024-09-22T03:46:08.373 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction test 2024-09-22T03:46:08.382 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2024-09-22T03:46:08.425 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2024-09-22T03:46:08.425 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2024-09-22T03:46:09.058 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction test succeeded. 2024-09-22T03:46:09.059 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction 2024-09-22T03:46:09.142 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2024-09-22T03:46:09.142 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2024-09-22T03:46:10.585 INFO:teuthology.orchestra.run.smithi098.stdout: Preparing : 1/1 2024-09-22T03:46:10.672 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2024-09-22T03:46:11.086 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/35 2024-09-22T03:46:11.177 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : librados2-2:19.3.0-5092.g62da54b4.el9.x86_64 2/35 2024-09-22T03:46:11.223 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/35 2024-09-22T03:46:11.252 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: librados2-2:19.3.0-5092.g62da54b4.el9.x86_64 2/35 2024-09-22T03:46:11.268 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : librados2-2:19.3.0-5092.g62da54b4.el9.x86_64 2/35 2024-09-22T03:46:11.351 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-rados-2:19.3.0-5092.g62da54b4.el9.x86_64 3/35 2024-09-22T03:46:11.378 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libcephfs2-2:19.3.0-5092.g62da54b4.el9.x86_64 4/35 2024-09-22T03:46:11.441 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: libcephfs2-2:19.3.0-5092.g62da54b4.el9.x86_64 4/35 2024-09-22T03:46:11.487 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : liboath-2.6.7-2.el9.x86_64 5/35 2024-09-22T03:46:11.490 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librados2-2:19.3.0-5092.g62da54b4.el9.x86_64 2/35 2024-09-22T03:46:11.525 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/35 2024-09-22T03:46:11.551 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/35 2024-09-22T03:46:11.573 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 8/35 2024-09-22T03:46:11.595 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 8/35 2024-09-22T03:46:11.595 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-rados-2:19.3.0-5092.g62da54b4.el9.x86_64 3/35 2024-09-22T03:46:11.620 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libcephfs2-2:19.3.0-5092.g62da54b4.el9.x86_64 4/35 2024-09-22T03:46:11.683 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libcephfs2-2:19.3.0-5092.g62da54b4.el9.x86_64 4/35 2024-09-22T03:46:11.729 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : liboath-2.6.7-2.el9.x86_64 5/35 2024-09-22T03:46:11.766 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/35 2024-09-22T03:46:11.792 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/35 2024-09-22T03:46:11.814 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 8/35 2024-09-22T03:46:11.826 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 9/35 2024-09-22T03:46:11.838 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 8/35 2024-09-22T03:46:11.856 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 9/35 2024-09-22T03:46:11.892 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 10/35 2024-09-22T03:46:11.934 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-ceph-argparse-2:19.3.0-5092.g62da54b4.el9. 11/35 2024-09-22T03:46:11.964 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cephfs-2:19.3.0-5092.g62da54b4.el9.x86_64 12/35 2024-09-22T03:46:12.034 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 9/35 2024-09-22T03:46:12.052 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 13/35 2024-09-22T03:46:12.072 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 9/35 2024-09-22T03:46:12.078 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libradosstriper1-2:19.3.0-5092.g62da54b4.el9.x86_6 14/35 2024-09-22T03:46:12.107 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 10/35 2024-09-22T03:46:12.151 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-ceph-argparse-2:19.3.0-5092.g62da54b4.el9. 11/35 2024-09-22T03:46:12.166 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: libradosstriper1-2:19.3.0-5092.g62da54b4.el9.x86_6 14/35 2024-09-22T03:46:12.180 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cephfs-2:19.3.0-5092.g62da54b4.el9.x86_64 12/35 2024-09-22T03:46:12.202 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : thrift-0.15.0-2.el9.x86_64 15/35 2024-09-22T03:46:12.271 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 13/35 2024-09-22T03:46:12.293 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libradosstriper1-2:19.3.0-5092.g62da54b4.el9.x86_6 14/35 2024-09-22T03:46:12.313 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : re2-1:20211101-20.el9.x86_64 16/35 2024-09-22T03:46:12.345 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 17/35 2024-09-22T03:46:12.365 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libradosstriper1-2:19.3.0-5092.g62da54b4.el9.x86_6 14/35 2024-09-22T03:46:12.395 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 18/35 2024-09-22T03:46:12.409 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : thrift-0.15.0-2.el9.x86_64 15/35 2024-09-22T03:46:12.427 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 19/35 2024-09-22T03:46:12.456 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 20/35 2024-09-22T03:46:12.493 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 21/35 2024-09-22T03:46:12.531 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : re2-1:20211101-20.el9.x86_64 16/35 2024-09-22T03:46:12.560 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 17/35 2024-09-22T03:46:12.607 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 18/35 2024-09-22T03:46:12.642 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 19/35 2024-09-22T03:46:12.672 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 20/35 2024-09-22T03:46:12.708 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 21/35 2024-09-22T03:46:12.864 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 22/35 2024-09-22T03:46:12.918 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : librbd1-2:19.3.0-5092.g62da54b4.el9.x86_64 23/35 2024-09-22T03:46:13.010 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: librbd1-2:19.3.0-5092.g62da54b4.el9.x86_64 23/35 2024-09-22T03:46:13.040 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-rbd-2:19.3.0-5092.g62da54b4.el9.x86_64 24/35 2024-09-22T03:46:13.076 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 25/35 2024-09-22T03:46:13.087 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 22/35 2024-09-22T03:46:13.142 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : librbd1-2:19.3.0-5092.g62da54b4.el9.x86_64 23/35 2024-09-22T03:46:13.251 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librbd1-2:19.3.0-5092.g62da54b4.el9.x86_64 23/35 2024-09-22T03:46:13.280 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-rbd-2:19.3.0-5092.g62da54b4.el9.x86_64 24/35 2024-09-22T03:46:13.316 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 25/35 2024-09-22T03:46:13.657 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 26/35 2024-09-22T03:46:13.688 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : librgw2-2:19.3.0-5092.g62da54b4.el9.x86_64 27/35 2024-09-22T03:46:13.759 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: librgw2-2:19.3.0-5092.g62da54b4.el9.x86_64 27/35 2024-09-22T03:46:13.841 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-rgw-2:19.3.0-5092.g62da54b4.el9.x86_64 28/35 2024-09-22T03:46:13.882 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-ceph-common-2:19.3.0-5092.g62da54b4.el9.x8 29/35 2024-09-22T03:46:13.930 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 26/35 2024-09-22T03:46:13.964 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : librgw2-2:19.3.0-5092.g62da54b4.el9.x86_64 27/35 2024-09-22T03:46:14.033 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librgw2-2:19.3.0-5092.g62da54b4.el9.x86_64 27/35 2024-09-22T03:46:14.118 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-rgw-2:19.3.0-5092.g62da54b4.el9.x86_64 28/35 2024-09-22T03:46:14.147 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-ceph-common-2:19.3.0-5092.g62da54b4.el9.x8 29/35 2024-09-22T03:46:16.282 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-common-2:19.3.0-5092.g62da54b4.el9.x86_64 30/35 2024-09-22T03:46:16.320 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-common-2:19.3.0-5092.g62da54b4.el9.x86_64 30/35 2024-09-22T03:46:16.756 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-common-2:19.3.0-5092.g62da54b4.el9.x86_64 30/35 2024-09-22T03:46:16.793 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-common-2:19.3.0-5092.g62da54b4.el9.x86_64 30/35 2024-09-22T03:46:17.021 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-common-2:19.3.0-5092.g62da54b4.el9.x86_64 30/35 2024-09-22T03:46:17.066 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-base-2:19.3.0-5092.g62da54b4.el9.x86_64 31/35 2024-09-22T03:46:17.156 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-base-2:19.3.0-5092.g62da54b4.el9.x86_64 31/35 2024-09-22T03:46:17.157 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-22T03:46:17.157 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-22T03:46:17.157 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-22T03:46:17.184 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-selinux-2:19.3.0-5092.g62da54b4.el9.x86_64 32/35 2024-09-22T03:46:17.537 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-common-2:19.3.0-5092.g62da54b4.el9.x86_64 30/35 2024-09-22T03:46:17.571 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-base-2:19.3.0-5092.g62da54b4.el9.x86_64 31/35 2024-09-22T03:46:17.673 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-base-2:19.3.0-5092.g62da54b4.el9.x86_64 31/35 2024-09-22T03:46:17.673 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-22T03:46:17.673 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-22T03:46:17.673 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:46:17.706 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-selinux-2:19.3.0-5092.g62da54b4.el9.x86_64 32/35 2024-09-22T03:46:27.501 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-selinux-2:19.3.0-5092.g62da54b4.el9.x86_64 32/35 2024-09-22T03:46:27.501 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /sys 2024-09-22T03:46:27.501 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /proc 2024-09-22T03:46:27.501 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /mnt 2024-09-22T03:46:27.501 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /var/tmp 2024-09-22T03:46:27.502 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /home 2024-09-22T03:46:27.502 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /root 2024-09-22T03:46:27.502 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /tmp 2024-09-22T03:46:27.502 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-22T03:46:28.631 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-radosgw-2:19.3.0-5092.g62da54b4.el9.x86_64 33/35 2024-09-22T03:46:28.656 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-5092.g62da54b4.el9.x86_64 33/35 2024-09-22T03:46:28.656 INFO:teuthology.orchestra.run.smithi098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T03:46:28.656 INFO:teuthology.orchestra.run.smithi098.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-22T03:46:28.656 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-22T03:46:28.656 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-22T03:46:28.656 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-22T03:46:28.658 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-22T03:46:28.741 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-22T03:46:28.741 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-22T03:46:28.744 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-selinux-2:19.3.0-5092.g62da54b4.el9.x86_64 32/35 2024-09-22T03:46:28.744 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /sys 2024-09-22T03:46:28.744 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /proc 2024-09-22T03:46:28.744 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /mnt 2024-09-22T03:46:28.744 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /var/tmp 2024-09-22T03:46:28.744 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /home 2024-09-22T03:46:28.744 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /root 2024-09-22T03:46:28.744 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /tmp 2024-09-22T03:46:28.744 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:46:29.880 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-radosgw-2:19.3.0-5092.g62da54b4.el9.x86_64 33/35 2024-09-22T03:46:29.907 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-5092.g62da54b4.el9.x86_64 33/35 2024-09-22T03:46:29.907 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T03:46:29.907 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-22T03:46:29.907 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-22T03:46:29.907 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-22T03:46:29.907 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:46:29.910 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-22T03:46:30.007 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-22T03:46:30.007 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-22T03:46:30.151 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-22T03:46:30.152 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-base-2:19.3.0-5092.g62da54b4.el9.x86_64 1/35 2024-09-22T03:46:30.152 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-common-2:19.3.0-5092.g62da54b4.el9.x86_64 2/35 2024-09-22T03:46:30.152 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-radosgw-2:19.3.0-5092.g62da54b4.el9.x86_64 3/35 2024-09-22T03:46:30.152 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-selinux-2:19.3.0-5092.g62da54b4.el9.x86_64 4/35 2024-09-22T03:46:30.152 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libcephfs2-2:19.3.0-5092.g62da54b4.el9.x86_64 5/35 2024-09-22T03:46:30.152 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libradosstriper1-2:19.3.0-5092.g62da54b4.el9.x86_6 6/35 2024-09-22T03:46:30.152 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librgw2-2:19.3.0-5092.g62da54b4.el9.x86_64 7/35 2024-09-22T03:46:30.152 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-ceph-argparse-2:19.3.0-5092.g62da54b4.el9. 8/35 2024-09-22T03:46:30.152 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-ceph-common-2:19.3.0-5092.g62da54b4.el9.x8 9/35 2024-09-22T03:46:30.152 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cephfs-2:19.3.0-5092.g62da54b4.el9.x86_64 10/35 2024-09-22T03:46:30.152 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-rados-2:19.3.0-5092.g62da54b4.el9.x86_64 11/35 2024-09-22T03:46:30.153 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-rbd-2:19.3.0-5092.g62da54b4.el9.x86_64 12/35 2024-09-22T03:46:30.153 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-rgw-2:19.3.0-5092.g62da54b4.el9.x86_64 13/35 2024-09-22T03:46:30.153 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/35 2024-09-22T03:46:30.153 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 15/35 2024-09-22T03:46:30.153 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 16/35 2024-09-22T03:46:30.153 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 17/35 2024-09-22T03:46:30.153 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 18/35 2024-09-22T03:46:30.153 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 19/35 2024-09-22T03:46:30.153 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 20/35 2024-09-22T03:46:30.153 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 21/35 2024-09-22T03:46:30.153 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 22/35 2024-09-22T03:46:30.153 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 23/35 2024-09-22T03:46:30.153 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 24/35 2024-09-22T03:46:30.153 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 25/35 2024-09-22T03:46:30.154 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 26/35 2024-09-22T03:46:30.154 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 27/35 2024-09-22T03:46:30.154 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 28/35 2024-09-22T03:46:30.154 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 29/35 2024-09-22T03:46:30.155 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : re2-1:20211101-20.el9.x86_64 30/35 2024-09-22T03:46:30.155 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 31/35 2024-09-22T03:46:30.155 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librados2-2:19.3.0-5092.g62da54b4.el9.x86_64 32/35 2024-09-22T03:46:30.155 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 33/35 2024-09-22T03:46:30.155 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librbd1-2:19.3.0-5092.g62da54b4.el9.x86_64 34/35 2024-09-22T03:46:31.257 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 35/35 2024-09-22T03:46:31.257 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-22T03:46:31.257 INFO:teuthology.orchestra.run.smithi098.stdout:Upgraded: 2024-09-22T03:46:31.257 INFO:teuthology.orchestra.run.smithi098.stdout: librados2-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-22T03:46:31.257 INFO:teuthology.orchestra.run.smithi098.stdout: librbd1-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-22T03:46:31.257 INFO:teuthology.orchestra.run.smithi098.stdout:Installed: 2024-09-22T03:46:31.257 INFO:teuthology.orchestra.run.smithi098.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-22T03:46:31.258 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-base-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-22T03:46:31.258 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-common-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-22T03:46:31.258 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-radosgw-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-22T03:46:31.258 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-selinux-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-22T03:46:31.258 INFO:teuthology.orchestra.run.smithi098.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-22T03:46:31.258 INFO:teuthology.orchestra.run.smithi098.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-22T03:46:31.258 INFO:teuthology.orchestra.run.smithi098.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-22T03:46:31.258 INFO:teuthology.orchestra.run.smithi098.stdout: libcephfs2-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-22T03:46:31.258 INFO:teuthology.orchestra.run.smithi098.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-22T03:46:31.258 INFO:teuthology.orchestra.run.smithi098.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-22T03:46:31.258 INFO:teuthology.orchestra.run.smithi098.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-22T03:46:31.258 INFO:teuthology.orchestra.run.smithi098.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-22T03:46:31.258 INFO:teuthology.orchestra.run.smithi098.stdout: libradosstriper1-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-22T03:46:31.258 INFO:teuthology.orchestra.run.smithi098.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-22T03:46:31.259 INFO:teuthology.orchestra.run.smithi098.stdout: librgw2-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-22T03:46:31.259 INFO:teuthology.orchestra.run.smithi098.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-22T03:46:31.259 INFO:teuthology.orchestra.run.smithi098.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-22T03:46:31.259 INFO:teuthology.orchestra.run.smithi098.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-22T03:46:31.259 INFO:teuthology.orchestra.run.smithi098.stdout: python3-ceph-argparse-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-22T03:46:31.259 INFO:teuthology.orchestra.run.smithi098.stdout: python3-ceph-common-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-22T03:46:31.259 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cephfs-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-22T03:46:31.259 INFO:teuthology.orchestra.run.smithi098.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-22T03:46:31.259 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rados-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-22T03:46:31.259 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rbd-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-22T03:46:31.259 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rgw-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-22T03:46:31.259 INFO:teuthology.orchestra.run.smithi098.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-22T03:46:31.259 INFO:teuthology.orchestra.run.smithi098.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-22T03:46:31.259 INFO:teuthology.orchestra.run.smithi098.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-22T03:46:31.259 INFO:teuthology.orchestra.run.smithi098.stdout: re2-1:20211101-20.el9.x86_64 2024-09-22T03:46:31.260 INFO:teuthology.orchestra.run.smithi098.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-22T03:46:31.260 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-22T03:46:31.260 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-22T03:46:31.285 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-22T03:46:31.285 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-base-2:19.3.0-5092.g62da54b4.el9.x86_64 1/35 2024-09-22T03:46:31.285 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-common-2:19.3.0-5092.g62da54b4.el9.x86_64 2/35 2024-09-22T03:46:31.285 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-radosgw-2:19.3.0-5092.g62da54b4.el9.x86_64 3/35 2024-09-22T03:46:31.285 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-selinux-2:19.3.0-5092.g62da54b4.el9.x86_64 4/35 2024-09-22T03:46:31.285 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libcephfs2-2:19.3.0-5092.g62da54b4.el9.x86_64 5/35 2024-09-22T03:46:31.285 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libradosstriper1-2:19.3.0-5092.g62da54b4.el9.x86_6 6/35 2024-09-22T03:46:31.285 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librgw2-2:19.3.0-5092.g62da54b4.el9.x86_64 7/35 2024-09-22T03:46:31.285 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-ceph-argparse-2:19.3.0-5092.g62da54b4.el9. 8/35 2024-09-22T03:46:31.285 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-ceph-common-2:19.3.0-5092.g62da54b4.el9.x8 9/35 2024-09-22T03:46:31.285 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cephfs-2:19.3.0-5092.g62da54b4.el9.x86_64 10/35 2024-09-22T03:46:31.285 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-rados-2:19.3.0-5092.g62da54b4.el9.x86_64 11/35 2024-09-22T03:46:31.286 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-rbd-2:19.3.0-5092.g62da54b4.el9.x86_64 12/35 2024-09-22T03:46:31.286 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-rgw-2:19.3.0-5092.g62da54b4.el9.x86_64 13/35 2024-09-22T03:46:31.286 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/35 2024-09-22T03:46:31.286 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 15/35 2024-09-22T03:46:31.286 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 16/35 2024-09-22T03:46:31.286 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 17/35 2024-09-22T03:46:31.286 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 18/35 2024-09-22T03:46:31.286 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 19/35 2024-09-22T03:46:31.286 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 20/35 2024-09-22T03:46:31.286 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 21/35 2024-09-22T03:46:31.286 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 22/35 2024-09-22T03:46:31.286 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 23/35 2024-09-22T03:46:31.286 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 24/35 2024-09-22T03:46:31.286 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 25/35 2024-09-22T03:46:31.287 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 26/35 2024-09-22T03:46:31.287 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 27/35 2024-09-22T03:46:31.287 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 28/35 2024-09-22T03:46:31.287 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 29/35 2024-09-22T03:46:31.287 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : re2-1:20211101-20.el9.x86_64 30/35 2024-09-22T03:46:31.287 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 31/35 2024-09-22T03:46:31.287 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librados2-2:19.3.0-5092.g62da54b4.el9.x86_64 32/35 2024-09-22T03:46:31.287 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 33/35 2024-09-22T03:46:31.287 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librbd1-2:19.3.0-5092.g62da54b4.el9.x86_64 34/35 2024-09-22T03:46:31.612 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install ceph-test 2024-09-22T03:46:32.121 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 35/35 2024-09-22T03:46:32.122 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:46:32.122 INFO:teuthology.orchestra.run.smithi037.stdout:Upgraded: 2024-09-22T03:46:32.122 INFO:teuthology.orchestra.run.smithi037.stdout: librados2-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-22T03:46:32.122 INFO:teuthology.orchestra.run.smithi037.stdout: librbd1-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-22T03:46:32.122 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2024-09-22T03:46:32.122 INFO:teuthology.orchestra.run.smithi037.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-22T03:46:32.122 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-base-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-22T03:46:32.122 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-common-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-22T03:46:32.122 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-radosgw-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-22T03:46:32.122 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-selinux-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-22T03:46:32.122 INFO:teuthology.orchestra.run.smithi037.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-22T03:46:32.122 INFO:teuthology.orchestra.run.smithi037.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-22T03:46:32.122 INFO:teuthology.orchestra.run.smithi037.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-22T03:46:32.123 INFO:teuthology.orchestra.run.smithi037.stdout: libcephfs2-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-22T03:46:32.123 INFO:teuthology.orchestra.run.smithi037.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-22T03:46:32.123 INFO:teuthology.orchestra.run.smithi037.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-22T03:46:32.123 INFO:teuthology.orchestra.run.smithi037.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-22T03:46:32.123 INFO:teuthology.orchestra.run.smithi037.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-22T03:46:32.123 INFO:teuthology.orchestra.run.smithi037.stdout: libradosstriper1-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-22T03:46:32.123 INFO:teuthology.orchestra.run.smithi037.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-22T03:46:32.123 INFO:teuthology.orchestra.run.smithi037.stdout: librgw2-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-22T03:46:32.123 INFO:teuthology.orchestra.run.smithi037.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-22T03:46:32.123 INFO:teuthology.orchestra.run.smithi037.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-22T03:46:32.123 INFO:teuthology.orchestra.run.smithi037.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-22T03:46:32.123 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ceph-argparse-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-22T03:46:32.123 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ceph-common-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-22T03:46:32.123 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cephfs-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-22T03:46:32.123 INFO:teuthology.orchestra.run.smithi037.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-22T03:46:32.124 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rados-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-22T03:46:32.124 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rbd-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-22T03:46:32.124 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rgw-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-22T03:46:32.124 INFO:teuthology.orchestra.run.smithi037.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-22T03:46:32.124 INFO:teuthology.orchestra.run.smithi037.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-22T03:46:32.124 INFO:teuthology.orchestra.run.smithi037.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-22T03:46:32.124 INFO:teuthology.orchestra.run.smithi037.stdout: re2-1:20211101-20.el9.x86_64 2024-09-22T03:46:32.124 INFO:teuthology.orchestra.run.smithi037.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-22T03:46:32.124 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:46:32.124 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-09-22T03:46:32.193 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:00:30 ago on Sun 22 Sep 2024 03:46:02 AM UTC. 2024-09-22T03:46:32.326 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-22T03:46:32.327 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-22T03:46:32.327 INFO:teuthology.orchestra.run.smithi098.stdout: Package Arch Version Repository Size 2024-09-22T03:46:32.327 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-22T03:46:32.327 INFO:teuthology.orchestra.run.smithi098.stdout:Installing: 2024-09-22T03:46:32.327 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-test x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 81 M 2024-09-22T03:46:32.327 INFO:teuthology.orchestra.run.smithi098.stdout:Installing dependencies: 2024-09-22T03:46:32.327 INFO:teuthology.orchestra.run.smithi098.stdout: libasan8 x86_64 14.2.1-1.2.el9 appstream 513 k 2024-09-22T03:46:32.328 INFO:teuthology.orchestra.run.smithi098.stdout: libcephsqlite x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 175 k 2024-09-22T03:46:32.328 INFO:teuthology.orchestra.run.smithi098.stdout: libubsan x86_64 11.5.0-2.el9 appstream 183 k 2024-09-22T03:46:32.328 INFO:teuthology.orchestra.run.smithi098.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2024-09-22T03:46:32.328 INFO:teuthology.orchestra.run.smithi098.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-22T03:46:32.328 INFO:teuthology.orchestra.run.smithi098.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-22T03:46:32.328 INFO:teuthology.orchestra.run.smithi098.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-22T03:46:32.328 INFO:teuthology.orchestra.run.smithi098.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2024-09-22T03:46:32.328 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-22T03:46:32.328 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction Summary 2024-09-22T03:46:32.328 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-22T03:46:32.328 INFO:teuthology.orchestra.run.smithi098.stdout:Install 9 Packages 2024-09-22T03:46:32.328 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-22T03:46:32.329 INFO:teuthology.orchestra.run.smithi098.stdout:Total download size: 83 M 2024-09-22T03:46:32.329 INFO:teuthology.orchestra.run.smithi098.stdout:Installed size: 775 M 2024-09-22T03:46:32.329 INFO:teuthology.orchestra.run.smithi098.stdout:Downloading Packages: 2024-09-22T03:46:32.510 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install ceph-test 2024-09-22T03:46:32.872 INFO:teuthology.orchestra.run.smithi098.stdout:(1/9): lksctp-tools-1.0.19-2.el9.x86_64.rpm 721 kB/s | 94 kB 00:00 2024-09-22T03:46:33.014 INFO:teuthology.orchestra.run.smithi098.stdout:(2/9): libcephsqlite-19.3.0-5092.g62da54b4.el9. 642 kB/s | 175 kB 00:00 2024-09-22T03:46:33.097 INFO:teuthology.orchestra.run.smithi098.stdout:(3/9): libasan8-14.2.1-1.2.el9.x86_64.rpm 2.2 MB/s | 513 kB 00:00 2024-09-22T03:46:33.107 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:00:31 ago on Sun 22 Sep 2024 03:46:02 AM UTC. 2024-09-22T03:46:33.181 INFO:teuthology.orchestra.run.smithi098.stdout:(4/9): libubsan-11.5.0-2.el9.x86_64.rpm 1.1 MB/s | 183 kB 00:00 2024-09-22T03:46:33.249 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-09-22T03:46:33.250 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-09-22T03:46:33.250 INFO:teuthology.orchestra.run.smithi037.stdout: Package Arch Version Repository Size 2024-09-22T03:46:33.250 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-09-22T03:46:33.251 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2024-09-22T03:46:33.251 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-test x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 81 M 2024-09-22T03:46:33.251 INFO:teuthology.orchestra.run.smithi037.stdout:Installing dependencies: 2024-09-22T03:46:33.251 INFO:teuthology.orchestra.run.smithi037.stdout: libasan8 x86_64 14.2.1-1.2.el9 appstream 513 k 2024-09-22T03:46:33.251 INFO:teuthology.orchestra.run.smithi037.stdout: libcephsqlite x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 175 k 2024-09-22T03:46:33.251 INFO:teuthology.orchestra.run.smithi037.stdout: libubsan x86_64 11.5.0-2.el9 appstream 183 k 2024-09-22T03:46:33.251 INFO:teuthology.orchestra.run.smithi037.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2024-09-22T03:46:33.251 INFO:teuthology.orchestra.run.smithi037.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-22T03:46:33.251 INFO:teuthology.orchestra.run.smithi037.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-22T03:46:33.251 INFO:teuthology.orchestra.run.smithi037.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-22T03:46:33.251 INFO:teuthology.orchestra.run.smithi037.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2024-09-22T03:46:33.251 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:46:33.251 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2024-09-22T03:46:33.252 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-09-22T03:46:33.252 INFO:teuthology.orchestra.run.smithi037.stdout:Install 9 Packages 2024-09-22T03:46:33.252 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:46:33.252 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 83 M 2024-09-22T03:46:33.252 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 775 M 2024-09-22T03:46:33.252 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2024-09-22T03:46:33.289 INFO:teuthology.orchestra.run.smithi098.stdout:(5/9): socat-1.7.4.1-6.el9.x86_64.rpm 2.7 MB/s | 304 kB 00:00 2024-09-22T03:46:33.331 INFO:teuthology.orchestra.run.smithi098.stdout:(6/9): protobuf-3.14.0-13.el9.x86_64.rpm 4.3 MB/s | 1.0 MB 00:00 2024-09-22T03:46:33.365 INFO:teuthology.orchestra.run.smithi098.stdout:(7/9): xmlstarlet-1.6.1-20.el9.x86_64.rpm 845 kB/s | 64 kB 00:00 2024-09-22T03:46:33.423 INFO:teuthology.orchestra.run.smithi098.stdout:(8/9): yaml-cpp-0.6.3-5.el9.x86_64.rpm 1.3 MB/s | 122 kB 00:00 2024-09-22T03:46:33.738 INFO:teuthology.orchestra.run.smithi037.stdout:(1/9): lksctp-tools-1.0.19-2.el9.x86_64.rpm 612 kB/s | 94 kB 00:00 2024-09-22T03:46:33.880 INFO:teuthology.orchestra.run.smithi037.stdout:(2/9): libasan8-14.2.1-1.2.el9.x86_64.rpm 3.5 MB/s | 513 kB 00:00 2024-09-22T03:46:33.921 INFO:teuthology.orchestra.run.smithi037.stdout:(3/9): libubsan-11.5.0-2.el9.x86_64.rpm 4.3 MB/s | 183 kB 00:00 2024-09-22T03:46:33.988 INFO:teuthology.orchestra.run.smithi037.stdout:(4/9): protobuf-3.14.0-13.el9.x86_64.rpm 15 MB/s | 1.0 MB 00:00 2024-09-22T03:46:34.030 INFO:teuthology.orchestra.run.smithi037.stdout:(5/9): socat-1.7.4.1-6.el9.x86_64.rpm 7.2 MB/s | 304 kB 00:00 2024-09-22T03:46:34.072 INFO:teuthology.orchestra.run.smithi037.stdout:(6/9): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 64 kB 00:00 2024-09-22T03:46:34.131 INFO:teuthology.orchestra.run.smithi037.stdout:(7/9): yaml-cpp-0.6.3-5.el9.x86_64.rpm 2.0 MB/s | 122 kB 00:00 2024-09-22T03:46:36.106 INFO:teuthology.orchestra.run.smithi037.stdout:(8/9): libcephsqlite-19.3.0-5092.g62da54b4.el9. 69 kB/s | 175 kB 00:02 2024-09-22T03:46:36.232 INFO:teuthology.orchestra.run.smithi098.stdout:(9/9): ceph-test-19.3.0-5092.g62da54b4.el9.x86_ 23 MB/s | 81 MB 00:03 2024-09-22T03:46:36.235 INFO:teuthology.orchestra.run.smithi098.stdout:-------------------------------------------------------------------------------- 2024-09-22T03:46:36.235 INFO:teuthology.orchestra.run.smithi098.stdout:Total 21 MB/s | 83 MB 00:03 2024-09-22T03:46:36.320 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction check 2024-09-22T03:46:36.342 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction check succeeded. 2024-09-22T03:46:36.342 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction test 2024-09-22T03:46:36.929 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction test succeeded. 2024-09-22T03:46:36.929 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction 2024-09-22T03:46:37.073 INFO:teuthology.orchestra.run.smithi037.stdout:(9/9): ceph-test-19.3.0-5092.g62da54b4.el9.x86_ 23 MB/s | 81 MB 00:03 2024-09-22T03:46:37.076 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2024-09-22T03:46:37.077 INFO:teuthology.orchestra.run.smithi037.stdout:Total 22 MB/s | 83 MB 00:03 2024-09-22T03:46:37.163 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2024-09-22T03:46:37.188 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2024-09-22T03:46:37.188 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2024-09-22T03:46:37.792 INFO:teuthology.orchestra.run.smithi098.stdout: Preparing : 1/1 2024-09-22T03:46:37.804 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2024-09-22T03:46:37.804 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2024-09-22T03:46:37.853 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 1/9 2024-09-22T03:46:37.902 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 2/9 2024-09-22T03:46:37.945 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 3/9 2024-09-22T03:46:37.974 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 4/9 2024-09-22T03:46:38.011 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libubsan-11.5.0-2.el9.x86_64 5/9 2024-09-22T03:46:38.035 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libasan8-14.2.1-1.2.el9.x86_64 6/9 2024-09-22T03:46:38.106 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: libasan8-14.2.1-1.2.el9.x86_64 6/9 2024-09-22T03:46:38.153 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 7/9 2024-09-22T03:46:38.179 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libcephsqlite-2:19.3.0-5092.g62da54b4.el9.x86_64 8/9 2024-09-22T03:46:38.709 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2024-09-22T03:46:38.798 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 1/9 2024-09-22T03:46:38.856 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 2/9 2024-09-22T03:46:38.912 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 3/9 2024-09-22T03:46:38.956 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 4/9 2024-09-22T03:46:38.994 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libubsan-11.5.0-2.el9.x86_64 5/9 2024-09-22T03:46:39.018 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libasan8-14.2.1-1.2.el9.x86_64 6/9 2024-09-22T03:46:39.079 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libasan8-14.2.1-1.2.el9.x86_64 6/9 2024-09-22T03:46:39.119 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 7/9 2024-09-22T03:46:39.161 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libcephsqlite-2:19.3.0-5092.g62da54b4.el9.x86_64 8/9 2024-09-22T03:46:48.979 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: libcephsqlite-2:19.3.0-5092.g62da54b4.el9.x86_64 8/9 2024-09-22T03:46:49.053 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-test-2:19.3.0-5092.g62da54b4.el9.x86_64 9/9 2024-09-22T03:46:50.623 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libcephsqlite-2:19.3.0-5092.g62da54b4.el9.x86_64 8/9 2024-09-22T03:46:50.704 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-test-2:19.3.0-5092.g62da54b4.el9.x86_64 9/9 2024-09-22T03:46:55.116 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-test-2:19.3.0-5092.g62da54b4.el9.x86_64 9/9 2024-09-22T03:46:55.116 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-test-2:19.3.0-5092.g62da54b4.el9.x86_64 1/9 2024-09-22T03:46:55.116 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libcephsqlite-2:19.3.0-5092.g62da54b4.el9.x86_64 2/9 2024-09-22T03:46:55.116 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 3/9 2024-09-22T03:46:55.116 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libasan8-14.2.1-1.2.el9.x86_64 4/9 2024-09-22T03:46:55.116 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libubsan-11.5.0-2.el9.x86_64 5/9 2024-09-22T03:46:55.116 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 6/9 2024-09-22T03:46:55.117 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 7/9 2024-09-22T03:46:55.117 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 8/9 2024-09-22T03:46:55.531 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 9/9 2024-09-22T03:46:55.532 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-22T03:46:55.532 INFO:teuthology.orchestra.run.smithi098.stdout:Installed: 2024-09-22T03:46:55.532 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-test-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-22T03:46:55.532 INFO:teuthology.orchestra.run.smithi098.stdout: libasan8-14.2.1-1.2.el9.x86_64 2024-09-22T03:46:55.532 INFO:teuthology.orchestra.run.smithi098.stdout: libcephsqlite-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-22T03:46:55.532 INFO:teuthology.orchestra.run.smithi098.stdout: libubsan-11.5.0-2.el9.x86_64 2024-09-22T03:46:55.532 INFO:teuthology.orchestra.run.smithi098.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2024-09-22T03:46:55.532 INFO:teuthology.orchestra.run.smithi098.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-22T03:46:55.532 INFO:teuthology.orchestra.run.smithi098.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-22T03:46:55.532 INFO:teuthology.orchestra.run.smithi098.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-22T03:46:55.532 INFO:teuthology.orchestra.run.smithi098.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2024-09-22T03:46:55.532 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-22T03:46:55.533 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-22T03:46:55.841 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install ceph 2024-09-22T03:46:56.422 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:00:54 ago on Sun 22 Sep 2024 03:46:02 AM UTC. 2024-09-22T03:46:56.559 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-22T03:46:56.562 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-22T03:46:56.562 INFO:teuthology.orchestra.run.smithi098.stdout: Package Arch Version Repository Size 2024-09-22T03:46:56.562 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-22T03:46:56.562 INFO:teuthology.orchestra.run.smithi098.stdout:Installing: 2024-09-22T03:46:56.562 INFO:teuthology.orchestra.run.smithi098.stdout: ceph x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 6.5 k 2024-09-22T03:46:56.562 INFO:teuthology.orchestra.run.smithi098.stdout:Installing dependencies: 2024-09-22T03:46:56.562 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mds x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 2.2 M 2024-09-22T03:46:56.562 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 1.6 M 2024-09-22T03:46:56.562 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-modules-core noarch 2:19.3.0-5092.g62da54b4.el9 ceph-noarch 292 k 2024-09-22T03:46:56.562 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mon x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 5.1 M 2024-09-22T03:46:56.562 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-osd x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 70 M 2024-09-22T03:46:56.562 INFO:teuthology.orchestra.run.smithi098.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-22T03:46:56.563 INFO:teuthology.orchestra.run.smithi098.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-22T03:46:56.563 INFO:teuthology.orchestra.run.smithi098.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-22T03:46:56.563 INFO:teuthology.orchestra.run.smithi098.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-22T03:46:56.563 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-22T03:46:56.563 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-22T03:46:56.563 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-22T03:46:56.563 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-22T03:46:56.563 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-22T03:46:56.563 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-22T03:46:56.563 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-collections 2024-09-22T03:46:56.563 INFO:teuthology.orchestra.run.smithi098.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-09-22T03:46:56.563 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-22T03:46:56.563 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-22T03:46:56.564 INFO:teuthology.orchestra.run.smithi098.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-22T03:46:56.564 INFO:teuthology.orchestra.run.smithi098.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-22T03:46:56.564 INFO:teuthology.orchestra.run.smithi098.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-22T03:46:56.564 INFO:teuthology.orchestra.run.smithi098.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-22T03:46:56.564 INFO:teuthology.orchestra.run.smithi098.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-22T03:46:56.564 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-22T03:46:56.564 INFO:teuthology.orchestra.run.smithi098.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-22T03:46:56.564 INFO:teuthology.orchestra.run.smithi098.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-22T03:46:56.564 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-22T03:46:56.564 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-22T03:46:56.564 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-22T03:46:56.564 INFO:teuthology.orchestra.run.smithi098.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-22T03:46:56.564 INFO:teuthology.orchestra.run.smithi098.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-22T03:46:56.564 INFO:teuthology.orchestra.run.smithi098.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-22T03:46:56.564 INFO:teuthology.orchestra.run.smithi098.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-22T03:46:56.565 INFO:teuthology.orchestra.run.smithi098.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-22T03:46:56.565 INFO:teuthology.orchestra.run.smithi098.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-22T03:46:56.565 INFO:teuthology.orchestra.run.smithi098.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-22T03:46:56.565 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-22T03:46:56.565 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction Summary 2024-09-22T03:46:56.565 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-22T03:46:56.565 INFO:teuthology.orchestra.run.smithi098.stdout:Install 37 Packages 2024-09-22T03:46:56.565 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-22T03:46:56.566 INFO:teuthology.orchestra.run.smithi098.stdout:Total download size: 84 M 2024-09-22T03:46:56.566 INFO:teuthology.orchestra.run.smithi098.stdout:Installed size: 896 M 2024-09-22T03:46:56.566 INFO:teuthology.orchestra.run.smithi098.stdout:Downloading Packages: 2024-09-22T03:46:56.771 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-test-2:19.3.0-5092.g62da54b4.el9.x86_64 9/9 2024-09-22T03:46:56.771 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-test-2:19.3.0-5092.g62da54b4.el9.x86_64 1/9 2024-09-22T03:46:56.771 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libcephsqlite-2:19.3.0-5092.g62da54b4.el9.x86_64 2/9 2024-09-22T03:46:56.771 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 3/9 2024-09-22T03:46:56.771 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libasan8-14.2.1-1.2.el9.x86_64 4/9 2024-09-22T03:46:56.771 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libubsan-11.5.0-2.el9.x86_64 5/9 2024-09-22T03:46:56.771 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 6/9 2024-09-22T03:46:56.771 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 7/9 2024-09-22T03:46:56.771 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 8/9 2024-09-22T03:46:56.959 INFO:teuthology.orchestra.run.smithi098.stdout:(1/37): ceph-19.3.0-5092.g62da54b4.el9.x86_64.r 51 kB/s | 6.5 kB 00:00 2024-09-22T03:46:57.161 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 9/9 2024-09-22T03:46:57.161 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:46:57.161 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2024-09-22T03:46:57.161 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-test-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-22T03:46:57.161 INFO:teuthology.orchestra.run.smithi037.stdout: libasan8-14.2.1-1.2.el9.x86_64 2024-09-22T03:46:57.161 INFO:teuthology.orchestra.run.smithi037.stdout: libcephsqlite-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-22T03:46:57.162 INFO:teuthology.orchestra.run.smithi037.stdout: libubsan-11.5.0-2.el9.x86_64 2024-09-22T03:46:57.162 INFO:teuthology.orchestra.run.smithi037.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2024-09-22T03:46:57.162 INFO:teuthology.orchestra.run.smithi037.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-22T03:46:57.162 INFO:teuthology.orchestra.run.smithi037.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-22T03:46:57.162 INFO:teuthology.orchestra.run.smithi037.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-22T03:46:57.162 INFO:teuthology.orchestra.run.smithi037.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2024-09-22T03:46:57.162 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:46:57.162 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-09-22T03:46:57.168 INFO:teuthology.orchestra.run.smithi098.stdout:(2/37): ceph-mds-19.3.0-5092.g62da54b4.el9.x86_ 6.5 MB/s | 2.2 MB 00:00 2024-09-22T03:46:57.210 INFO:teuthology.orchestra.run.smithi098.stdout:(3/37): ceph-mgr-19.3.0-5092.g62da54b4.el9.x86_ 4.2 MB/s | 1.6 MB 00:00 2024-09-22T03:46:57.318 INFO:teuthology.orchestra.run.smithi098.stdout:(4/37): ceph-mgr-modules-core-19.3.0-5092.g62da 2.6 MB/s | 292 kB 00:00 2024-09-22T03:46:57.494 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install ceph 2024-09-22T03:46:57.552 INFO:teuthology.orchestra.run.smithi098.stdout:(5/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.1 MB/s | 253 kB 00:00 2024-09-22T03:46:57.627 INFO:teuthology.orchestra.run.smithi098.stdout:(6/37): ceph-mon-19.3.0-5092.g62da54b4.el9.x86_ 7.7 MB/s | 5.1 MB 00:00 2024-09-22T03:46:57.786 INFO:teuthology.orchestra.run.smithi098.stdout:(7/37): python3-cryptography-36.0.1-4.el9.x86_6 5.2 MB/s | 1.2 MB 00:00 2024-09-22T03:46:57.811 INFO:teuthology.orchestra.run.smithi098.stdout:(8/37): python3-ply-3.11-14.el9.noarch.rpm 580 kB/s | 106 kB 00:00 2024-09-22T03:46:57.837 INFO:teuthology.orchestra.run.smithi098.stdout:(9/37): python3-pycparser-2.20-6.el9.noarch.rpm 2.6 MB/s | 135 kB 00:00 2024-09-22T03:46:57.895 INFO:teuthology.orchestra.run.smithi098.stdout:(10/37): python3-urllib3-1.26.5-6.el9.noarch.rp 3.6 MB/s | 215 kB 00:00 2024-09-22T03:46:57.920 INFO:teuthology.orchestra.run.smithi098.stdout:(11/37): python3-requests-2.25.1-8.el9.noarch.r 1.1 MB/s | 125 kB 00:00 2024-09-22T03:46:58.045 INFO:teuthology.orchestra.run.smithi098.stdout:(12/37): lua-5.4.4-4.el9.x86_64.rpm 1.2 MB/s | 188 kB 00:00 2024-09-22T03:46:58.071 INFO:teuthology.orchestra.run.smithi098.stdout:(13/37): python3-mako-1.1.4-6.el9.noarch.rpm 1.1 MB/s | 172 kB 00:00 2024-09-22T03:46:58.096 INFO:teuthology.orchestra.run.smithi098.stdout:(14/37): python3-markupsafe-1.1.1-12.el9.x86_64 690 kB/s | 35 kB 00:00 2024-09-22T03:46:58.101 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:00:56 ago on Sun 22 Sep 2024 03:46:02 AM UTC. 2024-09-22T03:46:58.122 INFO:teuthology.orchestra.run.smithi098.stdout:(15/37): python3-packaging-20.9-5.el9.noarch.rp 1.5 MB/s | 77 kB 00:00 2024-09-22T03:46:58.147 INFO:teuthology.orchestra.run.smithi098.stdout:(16/37): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-22T03:46:58.172 INFO:teuthology.orchestra.run.smithi098.stdout:(17/37): python3-toml-0.10.2-6.el9.noarch.rpm 826 kB/s | 42 kB 00:00 2024-09-22T03:46:58.215 INFO:teuthology.orchestra.run.smithi098.stdout:(18/37): luarocks-3.9.2-5.el9.noarch.rpm 3.5 MB/s | 151 kB 00:00 2024-09-22T03:46:58.239 INFO:teuthology.orchestra.run.smithi098.stdout:(19/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 1.7 MB/s | 43 kB 00:00 2024-09-22T03:46:58.251 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-09-22T03:46:58.253 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-09-22T03:46:58.253 INFO:teuthology.orchestra.run.smithi037.stdout: Package Arch Version Repository Size 2024-09-22T03:46:58.253 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-09-22T03:46:58.253 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2024-09-22T03:46:58.253 INFO:teuthology.orchestra.run.smithi037.stdout: ceph x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 6.5 k 2024-09-22T03:46:58.254 INFO:teuthology.orchestra.run.smithi037.stdout:Installing dependencies: 2024-09-22T03:46:58.254 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mds x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 2.2 M 2024-09-22T03:46:58.254 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 1.6 M 2024-09-22T03:46:58.254 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-modules-core noarch 2:19.3.0-5092.g62da54b4.el9 ceph-noarch 292 k 2024-09-22T03:46:58.254 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mon x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 5.1 M 2024-09-22T03:46:58.254 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-osd x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 70 M 2024-09-22T03:46:58.254 INFO:teuthology.orchestra.run.smithi037.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-22T03:46:58.254 INFO:teuthology.orchestra.run.smithi037.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-22T03:46:58.254 INFO:teuthology.orchestra.run.smithi037.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-22T03:46:58.254 INFO:teuthology.orchestra.run.smithi037.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-22T03:46:58.254 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-22T03:46:58.254 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-22T03:46:58.254 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-22T03:46:58.255 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-22T03:46:58.255 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-22T03:46:58.255 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-22T03:46:58.255 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-collections 2024-09-22T03:46:58.255 INFO:teuthology.orchestra.run.smithi037.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-09-22T03:46:58.255 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-22T03:46:58.255 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-22T03:46:58.255 INFO:teuthology.orchestra.run.smithi037.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-22T03:46:58.255 INFO:teuthology.orchestra.run.smithi037.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-22T03:46:58.255 INFO:teuthology.orchestra.run.smithi037.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-22T03:46:58.255 INFO:teuthology.orchestra.run.smithi037.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-22T03:46:58.255 INFO:teuthology.orchestra.run.smithi037.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-22T03:46:58.255 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-22T03:46:58.256 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-22T03:46:58.256 INFO:teuthology.orchestra.run.smithi037.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-22T03:46:58.256 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-22T03:46:58.256 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-22T03:46:58.256 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-22T03:46:58.256 INFO:teuthology.orchestra.run.smithi037.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-22T03:46:58.256 INFO:teuthology.orchestra.run.smithi037.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-22T03:46:58.256 INFO:teuthology.orchestra.run.smithi037.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-22T03:46:58.256 INFO:teuthology.orchestra.run.smithi037.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-22T03:46:58.256 INFO:teuthology.orchestra.run.smithi037.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-22T03:46:58.256 INFO:teuthology.orchestra.run.smithi037.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-22T03:46:58.256 INFO:teuthology.orchestra.run.smithi037.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-22T03:46:58.256 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:46:58.256 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2024-09-22T03:46:58.256 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-09-22T03:46:58.256 INFO:teuthology.orchestra.run.smithi037.stdout:Install 37 Packages 2024-09-22T03:46:58.257 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:46:58.257 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 84 M 2024-09-22T03:46:58.257 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 896 M 2024-09-22T03:46:58.257 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2024-09-22T03:46:58.265 INFO:teuthology.orchestra.run.smithi098.stdout:(20/37): lua-devel-5.4.4-4.el9.x86_64.rpm 189 kB/s | 22 kB 00:00 2024-09-22T03:46:58.299 INFO:teuthology.orchestra.run.smithi098.stdout:(21/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-09-22T03:46:58.324 INFO:teuthology.orchestra.run.smithi098.stdout:(22/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 462 kB/s | 11 kB 00:00 2024-09-22T03:46:58.349 INFO:teuthology.orchestra.run.smithi098.stdout:(23/37): python3-jaraco-classes-3.2.1-5.el9.noa 710 kB/s | 18 kB 00:00 2024-09-22T03:46:58.374 INFO:teuthology.orchestra.run.smithi098.stdout:(24/37): python3-jaraco-collections-3.0.0-8.el9 930 kB/s | 23 kB 00:00 2024-09-22T03:46:58.400 INFO:teuthology.orchestra.run.smithi098.stdout:(25/37): python3-cherrypy-18.6.1-2.el9.noarch.r 2.6 MB/s | 358 kB 00:00 2024-09-22T03:46:58.425 INFO:teuthology.orchestra.run.smithi098.stdout:(26/37): python3-jaraco-functools-3.5.0-2.el9.n 385 kB/s | 19 kB 00:00 2024-09-22T03:46:58.450 INFO:teuthology.orchestra.run.smithi098.stdout:(27/37): python3-jaraco-text-3.2.0-6.el9.noarch 391 kB/s | 20 kB 00:00 2024-09-22T03:46:58.476 INFO:teuthology.orchestra.run.smithi098.stdout:(28/37): python3-logutils-0.3.5-21.el9.noarch.r 925 kB/s | 46 kB 00:00 2024-09-22T03:46:58.501 INFO:teuthology.orchestra.run.smithi098.stdout:(29/37): python3-more-itertools-8.12.0-2.el9.no 1.5 MB/s | 79 kB 00:00 2024-09-22T03:46:58.526 INFO:teuthology.orchestra.run.smithi098.stdout:(30/37): python3-portend-3.1.0-2.el9.noarch.rpm 657 kB/s | 16 kB 00:00 2024-09-22T03:46:58.551 INFO:teuthology.orchestra.run.smithi098.stdout:(31/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 3.5 MB/s | 90 kB 00:00 2024-09-22T03:46:58.577 INFO:teuthology.orchestra.run.smithi098.stdout:(32/37): python3-pecan-1.4.2-3.el9.noarch.rpm 2.6 MB/s | 272 kB 00:00 2024-09-22T03:46:58.602 INFO:teuthology.orchestra.run.smithi098.stdout:(33/37): python3-tempora-5.0.0-2.el9.noarch.rpm 709 kB/s | 36 kB 00:00 2024-09-22T03:46:58.627 INFO:teuthology.orchestra.run.smithi098.stdout:(34/37): python3-webob-1.8.8-2.el9.noarch.rpm 4.5 MB/s | 230 kB 00:00 2024-09-22T03:46:58.653 INFO:teuthology.orchestra.run.smithi098.stdout:(35/37): python3-zc-lockfile-2.0-10.el9.noarch. 795 kB/s | 20 kB 00:00 2024-09-22T03:46:58.678 INFO:teuthology.orchestra.run.smithi098.stdout:(36/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 5.5 MB/s | 427 kB 00:00 2024-09-22T03:46:59.123 INFO:teuthology.orchestra.run.smithi037.stdout:(1/37): ceph-19.3.0-5092.g62da54b4.el9.x86_64.r 50 kB/s | 6.5 kB 00:00 2024-09-22T03:46:59.315 INFO:teuthology.orchestra.run.smithi037.stdout:(2/37): ceph-mds-19.3.0-5092.g62da54b4.el9.x86_ 6.8 MB/s | 2.2 MB 00:00 2024-09-22T03:46:59.357 INFO:teuthology.orchestra.run.smithi037.stdout:(3/37): ceph-mgr-19.3.0-5092.g62da54b4.el9.x86_ 4.4 MB/s | 1.6 MB 00:00 2024-09-22T03:46:59.441 INFO:teuthology.orchestra.run.smithi037.stdout:(4/37): ceph-mgr-modules-core-19.3.0-5092.g62da 3.4 MB/s | 292 kB 00:00 2024-09-22T03:46:59.549 INFO:teuthology.orchestra.run.smithi037.stdout:(5/37): ceph-mon-19.3.0-5092.g62da54b4.el9.x86_ 12 MB/s | 5.1 MB 00:00 2024-09-22T03:46:59.645 INFO:teuthology.orchestra.run.smithi098.stdout:(37/37): ceph-osd-19.3.0-5092.g62da54b4.el9.x86 28 MB/s | 70 MB 00:02 2024-09-22T03:46:59.649 INFO:teuthology.orchestra.run.smithi098.stdout:-------------------------------------------------------------------------------- 2024-09-22T03:46:59.649 INFO:teuthology.orchestra.run.smithi098.stdout:Total 27 MB/s | 84 MB 00:03 2024-09-22T03:46:59.802 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction check 2024-09-22T03:46:59.844 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction check succeeded. 2024-09-22T03:46:59.844 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction test 2024-09-22T03:47:00.241 INFO:teuthology.orchestra.run.smithi037.stdout:(6/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 316 kB/s | 253 kB 00:00 2024-09-22T03:47:00.483 INFO:teuthology.orchestra.run.smithi037.stdout:(7/37): python3-cryptography-36.0.1-4.el9.x86_6 1.3 MB/s | 1.2 MB 00:00 2024-09-22T03:47:00.637 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction test succeeded. 2024-09-22T03:47:00.638 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction 2024-09-22T03:47:01.250 INFO:teuthology.orchestra.run.smithi037.stdout:(8/37): ceph-osd-19.3.0-5092.g62da54b4.el9.x86_ 36 MB/s | 70 MB 00:01 2024-09-22T03:47:01.367 INFO:teuthology.orchestra.run.smithi037.stdout:(9/37): python3-ply-3.11-14.el9.noarch.rpm 95 kB/s | 106 kB 00:01 2024-09-22T03:47:01.801 INFO:teuthology.orchestra.run.smithi037.stdout:(10/37): python3-pycparser-2.20-6.el9.noarch.rp 103 kB/s | 135 kB 00:01 2024-09-22T03:47:01.951 INFO:teuthology.orchestra.run.smithi037.stdout:(11/37): python3-requests-2.25.1-8.el9.noarch.r 178 kB/s | 125 kB 00:00 2024-09-22T03:47:02.168 INFO:teuthology.orchestra.run.smithi037.stdout:(12/37): python3-urllib3-1.26.5-6.el9.noarch.rp 268 kB/s | 215 kB 00:00 2024-09-22T03:47:02.351 INFO:teuthology.orchestra.run.smithi037.stdout:(13/37): lua-5.4.4-4.el9.x86_64.rpm 342 kB/s | 188 kB 00:00 2024-09-22T03:47:02.400 INFO:teuthology.orchestra.run.smithi098.stdout: Preparing : 1/1 2024-09-22T03:47:02.460 INFO:teuthology.orchestra.run.smithi037.stdout:(14/37): python3-markupsafe-1.1.1-12.el9.x86_64 119 kB/s | 35 kB 00:00 2024-09-22T03:47:02.464 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-22T03:47:02.485 INFO:teuthology.orchestra.run.smithi037.stdout:(15/37): python3-packaging-20.9-5.el9.noarch.rp 578 kB/s | 77 kB 00:00 2024-09-22T03:47:02.497 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-22T03:47:02.525 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-22T03:47:02.605 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-22T03:47:02.627 INFO:teuthology.orchestra.run.smithi037.stdout:(16/37): python3-mako-1.1.4-6.el9.noarch.rpm 255 kB/s | 172 kB 00:00 2024-09-22T03:47:02.649 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-22T03:47:02.653 INFO:teuthology.orchestra.run.smithi037.stdout:(17/37): python3-toml-0.10.2-6.el9.noarch.rpm 249 kB/s | 42 kB 00:00 2024-09-22T03:47:02.678 INFO:teuthology.orchestra.run.smithi037.stdout:(18/37): python3-pytz-2021.1-5.el9.noarch.rpm 234 kB/s | 51 kB 00:00 2024-09-22T03:47:02.682 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-22T03:47:02.728 INFO:teuthology.orchestra.run.smithi037.stdout:(19/37): luarocks-3.9.2-5.el9.noarch.rpm 2.0 MB/s | 151 kB 00:00 2024-09-22T03:47:02.762 INFO:teuthology.orchestra.run.smithi037.stdout:(20/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 520 kB/s | 43 kB 00:00 2024-09-22T03:47:02.774 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-22T03:47:02.787 INFO:teuthology.orchestra.run.smithi037.stdout:(21/37): lua-devel-5.4.4-4.el9.x86_64.rpm 140 kB/s | 22 kB 00:00 2024-09-22T03:47:02.812 INFO:teuthology.orchestra.run.smithi037.stdout:(22/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 2.1 MB/s | 172 kB 00:00 2024-09-22T03:47:02.845 INFO:teuthology.orchestra.run.smithi037.stdout:(23/37): python3-jaraco-classes-3.2.1-5.el9.noa 705 kB/s | 18 kB 00:00 2024-09-22T03:47:02.868 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-22T03:47:02.871 INFO:teuthology.orchestra.run.smithi037.stdout:(24/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 128 kB/s | 11 kB 00:00 2024-09-22T03:47:02.896 INFO:teuthology.orchestra.run.smithi037.stdout:(25/37): python3-jaraco-collections-3.0.0-8.el9 480 kB/s | 23 kB 00:00 2024-09-22T03:47:02.909 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-22T03:47:02.921 INFO:teuthology.orchestra.run.smithi037.stdout:(26/37): python3-jaraco-functools-3.5.0-2.el9.n 389 kB/s | 19 kB 00:00 2024-09-22T03:47:02.945 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-22T03:47:02.947 INFO:teuthology.orchestra.run.smithi037.stdout:(27/37): python3-cherrypy-18.6.1-2.el9.noarch.r 1.9 MB/s | 358 kB 00:00 2024-09-22T03:47:02.980 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-22T03:47:02.997 INFO:teuthology.orchestra.run.smithi037.stdout:(28/37): python3-jaraco-text-3.2.0-6.el9.noarch 196 kB/s | 20 kB 00:00 2024-09-22T03:47:03.014 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-22T03:47:03.022 INFO:teuthology.orchestra.run.smithi037.stdout:(29/37): python3-logutils-0.3.5-21.el9.noarch.r 461 kB/s | 46 kB 00:00 2024-09-22T03:47:03.048 INFO:teuthology.orchestra.run.smithi037.stdout:(30/37): python3-more-itertools-8.12.0-2.el9.no 785 kB/s | 79 kB 00:00 2024-09-22T03:47:03.048 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-22T03:47:03.073 INFO:teuthology.orchestra.run.smithi037.stdout:(31/37): python3-portend-3.1.0-2.el9.noarch.rpm 326 kB/s | 16 kB 00:00 2024-09-22T03:47:03.088 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-22T03:47:03.098 INFO:teuthology.orchestra.run.smithi037.stdout:(32/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.7 MB/s | 90 kB 00:00 2024-09-22T03:47:03.123 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-22T03:47:03.132 INFO:teuthology.orchestra.run.smithi037.stdout:(33/37): python3-pecan-1.4.2-3.el9.noarch.rpm 2.0 MB/s | 272 kB 00:00 2024-09-22T03:47:03.158 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-22T03:47:03.165 INFO:teuthology.orchestra.run.smithi037.stdout:(34/37): python3-webob-1.8.8-2.el9.noarch.rpm 3.4 MB/s | 230 kB 00:00 2024-09-22T03:47:03.191 INFO:teuthology.orchestra.run.smithi037.stdout:(35/37): python3-zc-lockfile-2.0-10.el9.noarch. 800 kB/s | 20 kB 00:00 2024-09-22T03:47:03.198 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-22T03:47:03.216 INFO:teuthology.orchestra.run.smithi037.stdout:(36/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 5.0 MB/s | 427 kB 00:00 2024-09-22T03:47:03.238 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-22T03:47:03.311 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-22T03:47:03.316 INFO:teuthology.orchestra.run.smithi037.stdout:(37/37): python3-tempora-5.0.0-2.el9.noarch.rpm 147 kB/s | 36 kB 00:00 2024-09-22T03:47:03.320 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2024-09-22T03:47:03.320 INFO:teuthology.orchestra.run.smithi037.stdout:Total 17 MB/s | 84 MB 00:05 2024-09-22T03:47:03.451 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-22T03:47:03.475 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2024-09-22T03:47:03.522 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2024-09-22T03:47:03.523 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2024-09-22T03:47:03.529 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-22T03:47:03.583 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-22T03:47:03.622 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-22T03:47:03.679 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-22T03:47:03.742 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-22T03:47:03.928 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-22T03:47:03.976 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-22T03:47:04.054 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-22T03:47:04.142 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-22T03:47:04.192 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-22T03:47:04.321 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-22T03:47:04.371 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2024-09-22T03:47:04.372 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2024-09-22T03:47:04.515 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-5092.g62da54b4.el9. 32/37 2024-09-22T03:47:04.544 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mgr-2:19.3.0-5092.g62da54b4.el9.x86_64 33/37 2024-09-22T03:47:04.570 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mgr-2:19.3.0-5092.g62da54b4.el9.x86_64 33/37 2024-09-22T03:47:04.571 INFO:teuthology.orchestra.run.smithi098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T03:47:04.571 INFO:teuthology.orchestra.run.smithi098.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-22T03:47:04.571 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-22T03:47:04.571 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-22T03:47:04.571 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-22T03:47:06.066 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2024-09-22T03:47:06.151 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-22T03:47:06.193 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-22T03:47:06.220 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-22T03:47:06.296 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-22T03:47:06.345 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-22T03:47:06.377 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-22T03:47:06.474 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-22T03:47:06.560 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-22T03:47:06.606 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-22T03:47:06.640 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-22T03:47:06.670 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-22T03:47:06.704 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-22T03:47:06.738 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-22T03:47:06.778 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-22T03:47:06.822 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-22T03:47:06.856 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-22T03:47:06.913 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-22T03:47:06.961 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-22T03:47:07.038 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-22T03:47:07.191 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-22T03:47:07.273 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-22T03:47:07.332 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-22T03:47:07.369 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-22T03:47:07.437 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-22T03:47:07.500 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-22T03:47:07.697 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-22T03:47:07.748 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-22T03:47:07.838 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-22T03:47:07.937 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-22T03:47:07.987 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-22T03:47:08.127 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-22T03:47:08.366 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-5092.g62da54b4.el9. 32/37 2024-09-22T03:47:08.392 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-2:19.3.0-5092.g62da54b4.el9.x86_64 33/37 2024-09-22T03:47:08.419 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-2:19.3.0-5092.g62da54b4.el9.x86_64 33/37 2024-09-22T03:47:08.419 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T03:47:08.419 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-22T03:47:08.419 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-22T03:47:08.419 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-22T03:47:08.419 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:47:15.111 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-osd-2:19.3.0-5092.g62da54b4.el9.x86_64 34/37 2024-09-22T03:47:15.139 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-osd-2:19.3.0-5092.g62da54b4.el9.x86_64 34/37 2024-09-22T03:47:15.140 INFO:teuthology.orchestra.run.smithi098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T03:47:15.140 INFO:teuthology.orchestra.run.smithi098.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-22T03:47:15.140 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-22T03:47:15.140 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-22T03:47:15.140 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-22T03:47:15.696 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mon-2:19.3.0-5092.g62da54b4.el9.x86_64 35/37 2024-09-22T03:47:15.720 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mon-2:19.3.0-5092.g62da54b4.el9.x86_64 35/37 2024-09-22T03:47:15.720 INFO:teuthology.orchestra.run.smithi098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T03:47:15.720 INFO:teuthology.orchestra.run.smithi098.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-22T03:47:15.720 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-22T03:47:15.720 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-22T03:47:15.720 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-22T03:47:15.954 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mds-2:19.3.0-5092.g62da54b4.el9.x86_64 36/37 2024-09-22T03:47:15.978 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mds-2:19.3.0-5092.g62da54b4.el9.x86_64 36/37 2024-09-22T03:47:15.979 INFO:teuthology.orchestra.run.smithi098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T03:47:15.979 INFO:teuthology.orchestra.run.smithi098.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-22T03:47:15.979 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-22T03:47:15.979 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-22T03:47:15.979 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-22T03:47:16.043 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-2:19.3.0-5092.g62da54b4.el9.x86_64 37/37 2024-09-22T03:47:19.634 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-osd-2:19.3.0-5092.g62da54b4.el9.x86_64 34/37 2024-09-22T03:47:19.663 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-osd-2:19.3.0-5092.g62da54b4.el9.x86_64 34/37 2024-09-22T03:47:19.663 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T03:47:19.663 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-22T03:47:19.663 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-22T03:47:19.663 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-22T03:47:19.663 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:47:20.243 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mon-2:19.3.0-5092.g62da54b4.el9.x86_64 35/37 2024-09-22T03:47:20.268 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mon-2:19.3.0-5092.g62da54b4.el9.x86_64 35/37 2024-09-22T03:47:20.268 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T03:47:20.268 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-22T03:47:20.268 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-22T03:47:20.268 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-22T03:47:20.268 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:47:20.527 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mds-2:19.3.0-5092.g62da54b4.el9.x86_64 36/37 2024-09-22T03:47:20.552 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mds-2:19.3.0-5092.g62da54b4.el9.x86_64 36/37 2024-09-22T03:47:20.552 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T03:47:20.552 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-22T03:47:20.552 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-22T03:47:20.552 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-22T03:47:20.552 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:47:20.636 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-2:19.3.0-5092.g62da54b4.el9.x86_64 37/37 2024-09-22T03:47:22.890 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-2:19.3.0-5092.g62da54b4.el9.x86_64 37/37 2024-09-22T03:47:22.890 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-2:19.3.0-5092.g62da54b4.el9.x86_64 1/37 2024-09-22T03:47:22.890 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mds-2:19.3.0-5092.g62da54b4.el9.x86_64 2/37 2024-09-22T03:47:22.890 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mgr-2:19.3.0-5092.g62da54b4.el9.x86_64 3/37 2024-09-22T03:47:22.890 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mon-2:19.3.0-5092.g62da54b4.el9.x86_64 4/37 2024-09-22T03:47:22.890 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-osd-2:19.3.0-5092.g62da54b4.el9.x86_64 5/37 2024-09-22T03:47:22.890 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-5092.g62da54b4.el9. 6/37 2024-09-22T03:47:22.891 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-22T03:47:22.891 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-22T03:47:22.891 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-22T03:47:22.891 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-22T03:47:22.891 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-22T03:47:22.891 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-22T03:47:22.891 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-22T03:47:22.891 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-22T03:47:22.891 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-22T03:47:22.891 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-22T03:47:22.891 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-22T03:47:22.891 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-22T03:47:22.891 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-22T03:47:22.891 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-22T03:47:22.892 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-22T03:47:22.892 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-22T03:47:22.892 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-22T03:47:22.892 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-22T03:47:22.892 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-22T03:47:22.892 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-22T03:47:22.892 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-22T03:47:22.892 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-22T03:47:22.893 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-22T03:47:22.893 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-22T03:47:22.893 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-22T03:47:22.893 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-22T03:47:22.893 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-22T03:47:22.893 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-22T03:47:22.893 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-22T03:47:22.893 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-22T03:47:23.900 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-22T03:47:23.900 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-22T03:47:23.900 INFO:teuthology.orchestra.run.smithi098.stdout:Installed: 2024-09-22T03:47:23.901 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-22T03:47:23.901 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mds-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-22T03:47:23.901 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-22T03:47:23.901 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-modules-core-2:19.3.0-5092.g62da54b4.el9.noarch 2024-09-22T03:47:23.901 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mon-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-22T03:47:23.901 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-osd-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-22T03:47:23.901 INFO:teuthology.orchestra.run.smithi098.stdout: lua-5.4.4-4.el9.x86_64 2024-09-22T03:47:23.901 INFO:teuthology.orchestra.run.smithi098.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-22T03:47:23.901 INFO:teuthology.orchestra.run.smithi098.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-22T03:47:23.901 INFO:teuthology.orchestra.run.smithi098.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-22T03:47:23.901 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-22T03:47:23.901 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-22T03:47:23.901 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-22T03:47:23.901 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-22T03:47:23.901 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-22T03:47:23.902 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-22T03:47:23.902 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-22T03:47:23.902 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-22T03:47:23.902 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-22T03:47:23.902 INFO:teuthology.orchestra.run.smithi098.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-22T03:47:23.902 INFO:teuthology.orchestra.run.smithi098.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-22T03:47:23.902 INFO:teuthology.orchestra.run.smithi098.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-22T03:47:23.902 INFO:teuthology.orchestra.run.smithi098.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-22T03:47:23.902 INFO:teuthology.orchestra.run.smithi098.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-22T03:47:23.902 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-22T03:47:23.902 INFO:teuthology.orchestra.run.smithi098.stdout: python3-ply-3.11-14.el9.noarch 2024-09-22T03:47:23.902 INFO:teuthology.orchestra.run.smithi098.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-22T03:47:23.902 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-22T03:47:23.903 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-22T03:47:23.903 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-22T03:47:23.903 INFO:teuthology.orchestra.run.smithi098.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-22T03:47:23.903 INFO:teuthology.orchestra.run.smithi098.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-22T03:47:23.903 INFO:teuthology.orchestra.run.smithi098.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-22T03:47:23.903 INFO:teuthology.orchestra.run.smithi098.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-22T03:47:23.903 INFO:teuthology.orchestra.run.smithi098.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-22T03:47:23.903 INFO:teuthology.orchestra.run.smithi098.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-22T03:47:23.903 INFO:teuthology.orchestra.run.smithi098.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-22T03:47:23.903 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-22T03:47:23.903 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-22T03:47:24.175 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install ceph-base 2024-09-22T03:47:24.778 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:01:22 ago on Sun 22 Sep 2024 03:46:02 AM UTC. 2024-09-22T03:47:24.870 INFO:teuthology.orchestra.run.smithi098.stdout:Package ceph-base-2:19.3.0-5092.g62da54b4.el9.x86_64 is already installed. 2024-09-22T03:47:24.915 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-22T03:47:24.916 INFO:teuthology.orchestra.run.smithi098.stdout:Nothing to do. 2024-09-22T03:47:24.916 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-22T03:47:24.983 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install cephadm 2024-09-22T03:47:25.580 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:01:23 ago on Sun 22 Sep 2024 03:46:02 AM UTC. 2024-09-22T03:47:25.710 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-22T03:47:25.711 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-22T03:47:25.711 INFO:teuthology.orchestra.run.smithi098.stdout: Package Arch Version Repository Size 2024-09-22T03:47:25.711 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-22T03:47:25.711 INFO:teuthology.orchestra.run.smithi098.stdout:Installing: 2024-09-22T03:47:25.711 INFO:teuthology.orchestra.run.smithi098.stdout: cephadm noarch 2:19.3.0-5092.g62da54b4.el9 ceph-noarch 784 k 2024-09-22T03:47:25.711 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-22T03:47:25.711 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction Summary 2024-09-22T03:47:25.711 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-22T03:47:25.711 INFO:teuthology.orchestra.run.smithi098.stdout:Install 1 Package 2024-09-22T03:47:25.711 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-22T03:47:25.711 INFO:teuthology.orchestra.run.smithi098.stdout:Total download size: 784 k 2024-09-22T03:47:25.711 INFO:teuthology.orchestra.run.smithi098.stdout:Installed size: 791 k 2024-09-22T03:47:25.711 INFO:teuthology.orchestra.run.smithi098.stdout:Downloading Packages: 2024-09-22T03:47:25.963 INFO:teuthology.orchestra.run.smithi098.stdout:cephadm-19.3.0-5092.g62da54b4.el9.noarch.rpm 3.0 MB/s | 784 kB 00:00 2024-09-22T03:47:25.964 INFO:teuthology.orchestra.run.smithi098.stdout:-------------------------------------------------------------------------------- 2024-09-22T03:47:25.964 INFO:teuthology.orchestra.run.smithi098.stdout:Total 3.0 MB/s | 784 kB 00:00 2024-09-22T03:47:25.964 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction check 2024-09-22T03:47:25.969 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction check succeeded. 2024-09-22T03:47:25.969 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction test 2024-09-22T03:47:25.975 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction test succeeded. 2024-09-22T03:47:25.976 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction 2024-09-22T03:47:26.046 INFO:teuthology.orchestra.run.smithi098.stdout: Preparing : 1/1 2024-09-22T03:47:26.475 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: cephadm-2:19.3.0-5092.g62da54b4.el9.noarch 1/1 2024-09-22T03:47:26.567 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : cephadm-2:19.3.0-5092.g62da54b4.el9.noarch 1/1 2024-09-22T03:47:26.935 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: cephadm-2:19.3.0-5092.g62da54b4.el9.noarch 1/1 2024-09-22T03:47:27.110 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-2:19.3.0-5092.g62da54b4.el9.x86_64 37/37 2024-09-22T03:47:27.110 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-2:19.3.0-5092.g62da54b4.el9.x86_64 1/37 2024-09-22T03:47:27.110 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mds-2:19.3.0-5092.g62da54b4.el9.x86_64 2/37 2024-09-22T03:47:27.110 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-2:19.3.0-5092.g62da54b4.el9.x86_64 3/37 2024-09-22T03:47:27.110 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mon-2:19.3.0-5092.g62da54b4.el9.x86_64 4/37 2024-09-22T03:47:27.110 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-osd-2:19.3.0-5092.g62da54b4.el9.x86_64 5/37 2024-09-22T03:47:27.110 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-5092.g62da54b4.el9. 6/37 2024-09-22T03:47:27.111 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-22T03:47:27.111 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-22T03:47:27.111 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-22T03:47:27.111 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-22T03:47:27.111 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-22T03:47:27.111 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-22T03:47:27.111 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-22T03:47:27.111 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-22T03:47:27.111 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-22T03:47:27.111 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-22T03:47:27.111 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-22T03:47:27.112 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-22T03:47:27.112 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-22T03:47:27.112 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-22T03:47:27.112 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-22T03:47:27.112 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-22T03:47:27.112 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-22T03:47:27.112 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-22T03:47:27.112 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-22T03:47:27.114 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-22T03:47:27.114 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-22T03:47:27.114 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-22T03:47:27.114 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-22T03:47:27.114 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-22T03:47:27.114 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-22T03:47:27.115 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-22T03:47:27.115 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-22T03:47:27.115 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-22T03:47:27.115 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-22T03:47:27.115 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-22T03:47:27.191 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : cephadm-2:19.3.0-5092.g62da54b4.el9.noarch 1/1 2024-09-22T03:47:27.191 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-22T03:47:27.191 INFO:teuthology.orchestra.run.smithi098.stdout:Installed: 2024-09-22T03:47:27.192 INFO:teuthology.orchestra.run.smithi098.stdout: cephadm-2:19.3.0-5092.g62da54b4.el9.noarch 2024-09-22T03:47:27.192 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-22T03:47:27.192 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-22T03:47:27.401 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install ceph-immutable-object-cache 2024-09-22T03:47:27.985 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:01:25 ago on Sun 22 Sep 2024 03:46:02 AM UTC. 2024-09-22T03:47:28.100 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-22T03:47:28.100 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:47:28.100 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2024-09-22T03:47:28.100 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-22T03:47:28.100 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mds-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-22T03:47:28.100 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-22T03:47:28.100 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-modules-core-2:19.3.0-5092.g62da54b4.el9.noarch 2024-09-22T03:47:28.100 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mon-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-22T03:47:28.100 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-osd-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-22T03:47:28.101 INFO:teuthology.orchestra.run.smithi037.stdout: lua-5.4.4-4.el9.x86_64 2024-09-22T03:47:28.101 INFO:teuthology.orchestra.run.smithi037.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-22T03:47:28.101 INFO:teuthology.orchestra.run.smithi037.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-22T03:47:28.101 INFO:teuthology.orchestra.run.smithi037.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-22T03:47:28.101 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-22T03:47:28.101 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-22T03:47:28.101 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-22T03:47:28.101 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-22T03:47:28.101 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-22T03:47:28.101 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-22T03:47:28.101 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-22T03:47:28.101 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-22T03:47:28.101 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-22T03:47:28.101 INFO:teuthology.orchestra.run.smithi037.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-22T03:47:28.101 INFO:teuthology.orchestra.run.smithi037.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-22T03:47:28.102 INFO:teuthology.orchestra.run.smithi037.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-22T03:47:28.102 INFO:teuthology.orchestra.run.smithi037.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-22T03:47:28.102 INFO:teuthology.orchestra.run.smithi037.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-22T03:47:28.102 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-22T03:47:28.102 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ply-3.11-14.el9.noarch 2024-09-22T03:47:28.102 INFO:teuthology.orchestra.run.smithi037.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-22T03:47:28.102 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-22T03:47:28.102 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-22T03:47:28.102 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-22T03:47:28.102 INFO:teuthology.orchestra.run.smithi037.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-22T03:47:28.102 INFO:teuthology.orchestra.run.smithi037.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-22T03:47:28.102 INFO:teuthology.orchestra.run.smithi037.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-22T03:47:28.102 INFO:teuthology.orchestra.run.smithi037.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-22T03:47:28.102 INFO:teuthology.orchestra.run.smithi037.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-22T03:47:28.102 INFO:teuthology.orchestra.run.smithi037.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-22T03:47:28.103 INFO:teuthology.orchestra.run.smithi037.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-22T03:47:28.103 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:47:28.103 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-09-22T03:47:28.115 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-22T03:47:28.115 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-22T03:47:28.115 INFO:teuthology.orchestra.run.smithi098.stdout: Package Arch Version Repo Size 2024-09-22T03:47:28.116 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-22T03:47:28.116 INFO:teuthology.orchestra.run.smithi098.stdout:Installing: 2024-09-22T03:47:28.116 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 158 k 2024-09-22T03:47:28.116 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-22T03:47:28.116 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction Summary 2024-09-22T03:47:28.116 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-22T03:47:28.116 INFO:teuthology.orchestra.run.smithi098.stdout:Install 1 Package 2024-09-22T03:47:28.116 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-22T03:47:28.117 INFO:teuthology.orchestra.run.smithi098.stdout:Total download size: 158 k 2024-09-22T03:47:28.117 INFO:teuthology.orchestra.run.smithi098.stdout:Installed size: 644 k 2024-09-22T03:47:28.117 INFO:teuthology.orchestra.run.smithi098.stdout:Downloading Packages: 2024-09-22T03:47:28.320 INFO:teuthology.orchestra.run.smithi098.stdout:ceph-immutable-object-cache-19.3.0-5092.g62da54 777 kB/s | 158 kB 00:00 2024-09-22T03:47:28.321 INFO:teuthology.orchestra.run.smithi098.stdout:-------------------------------------------------------------------------------- 2024-09-22T03:47:28.321 INFO:teuthology.orchestra.run.smithi098.stdout:Total 770 kB/s | 158 kB 00:00 2024-09-22T03:47:28.321 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction check 2024-09-22T03:47:28.331 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction check succeeded. 2024-09-22T03:47:28.331 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction test 2024-09-22T03:47:28.390 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction test succeeded. 2024-09-22T03:47:28.390 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction 2024-09-22T03:47:28.439 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install ceph-base 2024-09-22T03:47:28.549 INFO:teuthology.orchestra.run.smithi098.stdout: Preparing : 1/1 2024-09-22T03:47:28.622 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-5092.g62da54b4. 1/1 2024-09-22T03:47:28.646 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-5092.g62da54b4. 1/1 2024-09-22T03:47:28.646 INFO:teuthology.orchestra.run.smithi098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T03:47:28.646 INFO:teuthology.orchestra.run.smithi098.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-22T03:47:28.647 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-22T03:47:29.045 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:01:27 ago on Sun 22 Sep 2024 03:46:02 AM UTC. 2024-09-22T03:47:29.135 INFO:teuthology.orchestra.run.smithi037.stdout:Package ceph-base-2:19.3.0-5092.g62da54b4.el9.x86_64 is already installed. 2024-09-22T03:47:29.181 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-09-22T03:47:29.182 INFO:teuthology.orchestra.run.smithi037.stdout:Nothing to do. 2024-09-22T03:47:29.182 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-09-22T03:47:29.252 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install cephadm 2024-09-22T03:47:29.575 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-5092.g62da54b4. 1/1 2024-09-22T03:47:29.575 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-22T03:47:29.575 INFO:teuthology.orchestra.run.smithi098.stdout:Installed: 2024-09-22T03:47:29.575 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-immutable-object-cache-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-22T03:47:29.575 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-22T03:47:29.575 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-22T03:47:29.797 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install ceph-mgr 2024-09-22T03:47:29.846 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:01:27 ago on Sun 22 Sep 2024 03:46:02 AM UTC. 2024-09-22T03:47:29.981 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-09-22T03:47:29.982 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-09-22T03:47:29.982 INFO:teuthology.orchestra.run.smithi037.stdout: Package Arch Version Repository Size 2024-09-22T03:47:29.982 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-09-22T03:47:29.982 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2024-09-22T03:47:29.982 INFO:teuthology.orchestra.run.smithi037.stdout: cephadm noarch 2:19.3.0-5092.g62da54b4.el9 ceph-noarch 784 k 2024-09-22T03:47:29.982 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:47:29.982 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2024-09-22T03:47:29.982 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-09-22T03:47:29.982 INFO:teuthology.orchestra.run.smithi037.stdout:Install 1 Package 2024-09-22T03:47:29.983 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:47:29.983 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 784 k 2024-09-22T03:47:29.983 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 791 k 2024-09-22T03:47:29.983 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2024-09-22T03:47:30.309 INFO:teuthology.orchestra.run.smithi037.stdout:cephadm-19.3.0-5092.g62da54b4.el9.noarch.rpm 2.3 MB/s | 784 kB 00:00 2024-09-22T03:47:30.310 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2024-09-22T03:47:30.310 INFO:teuthology.orchestra.run.smithi037.stdout:Total 2.3 MB/s | 784 kB 00:00 2024-09-22T03:47:30.310 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2024-09-22T03:47:30.317 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2024-09-22T03:47:30.317 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2024-09-22T03:47:30.323 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2024-09-22T03:47:30.323 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2024-09-22T03:47:30.380 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:01:28 ago on Sun 22 Sep 2024 03:46:02 AM UTC. 2024-09-22T03:47:30.397 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2024-09-22T03:47:30.470 INFO:teuthology.orchestra.run.smithi098.stdout:Package ceph-mgr-2:19.3.0-5092.g62da54b4.el9.x86_64 is already installed. 2024-09-22T03:47:30.512 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-22T03:47:30.513 INFO:teuthology.orchestra.run.smithi098.stdout:Nothing to do. 2024-09-22T03:47:30.513 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-22T03:47:30.579 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install ceph-mgr-dashboard 2024-09-22T03:47:30.882 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: cephadm-2:19.3.0-5092.g62da54b4.el9.noarch 1/1 2024-09-22T03:47:30.984 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : cephadm-2:19.3.0-5092.g62da54b4.el9.noarch 1/1 2024-09-22T03:47:31.152 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:01:29 ago on Sun 22 Sep 2024 03:46:02 AM UTC. 2024-09-22T03:47:31.284 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-22T03:47:31.285 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-22T03:47:31.285 INFO:teuthology.orchestra.run.smithi098.stdout: Package Arch Version Repository Size 2024-09-22T03:47:31.285 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-22T03:47:31.285 INFO:teuthology.orchestra.run.smithi098.stdout:Installing: 2024-09-22T03:47:31.285 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-dashboard noarch 2:19.3.0-5092.g62da54b4.el9 ceph-noarch 14 M 2024-09-22T03:47:31.285 INFO:teuthology.orchestra.run.smithi098.stdout:Installing dependencies: 2024-09-22T03:47:31.285 INFO:teuthology.orchestra.run.smithi098.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-22T03:47:31.286 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-grafana-dashboards noarch 2:19.3.0-5092.g62da54b4.el9 ceph-noarch 34 k 2024-09-22T03:47:31.286 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-prometheus-alerts noarch 2:19.3.0-5092.g62da54b4.el9 ceph-noarch 16 k 2024-09-22T03:47:31.286 INFO:teuthology.orchestra.run.smithi098.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-22T03:47:31.286 INFO:teuthology.orchestra.run.smithi098.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-22T03:47:31.286 INFO:teuthology.orchestra.run.smithi098.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-22T03:47:31.286 INFO:teuthology.orchestra.run.smithi098.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-22T03:47:31.286 INFO:teuthology.orchestra.run.smithi098.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-22T03:47:31.286 INFO:teuthology.orchestra.run.smithi098.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-22T03:47:31.286 INFO:teuthology.orchestra.run.smithi098.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-22T03:47:31.286 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-22T03:47:31.286 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction Summary 2024-09-22T03:47:31.286 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-22T03:47:31.286 INFO:teuthology.orchestra.run.smithi098.stdout:Install 11 Packages 2024-09-22T03:47:31.286 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-22T03:47:31.287 INFO:teuthology.orchestra.run.smithi098.stdout:Total download size: 18 M 2024-09-22T03:47:31.287 INFO:teuthology.orchestra.run.smithi098.stdout:Installed size: 156 M 2024-09-22T03:47:31.287 INFO:teuthology.orchestra.run.smithi098.stdout:Downloading Packages: 2024-09-22T03:47:31.348 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: cephadm-2:19.3.0-5092.g62da54b4.el9.noarch 1/1 2024-09-22T03:47:31.607 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : cephadm-2:19.3.0-5092.g62da54b4.el9.noarch 1/1 2024-09-22T03:47:31.607 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:47:31.607 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2024-09-22T03:47:31.607 INFO:teuthology.orchestra.run.smithi037.stdout: cephadm-2:19.3.0-5092.g62da54b4.el9.noarch 2024-09-22T03:47:31.607 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:47:31.607 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-09-22T03:47:31.840 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install ceph-immutable-object-cache 2024-09-22T03:47:31.900 INFO:teuthology.orchestra.run.smithi098.stdout:(1/11): ceph-prometheus-alerts-19.3.0-5092.g62d 63 kB/s | 16 kB 00:00 2024-09-22T03:47:31.917 INFO:teuthology.orchestra.run.smithi098.stdout:(2/11): ceph-grafana-dashboards-19.3.0-5092.g62 123 kB/s | 34 kB 00:00 2024-09-22T03:47:32.075 INFO:teuthology.orchestra.run.smithi098.stdout:(3/11): protobuf-compiler-3.14.0-13.el9.x86_64. 5.3 MB/s | 863 kB 00:00 2024-09-22T03:47:32.142 INFO:teuthology.orchestra.run.smithi098.stdout:(4/11): abseil-cpp-20211102.0-3.el9.x86_64.rpm 8.0 MB/s | 548 kB 00:00 2024-09-22T03:47:32.159 INFO:teuthology.orchestra.run.smithi098.stdout:(5/11): grpc-data-1.46.7-10.el9.noarch.rpm 1.1 MB/s | 19 kB 00:00 2024-09-22T03:47:32.301 INFO:teuthology.orchestra.run.smithi098.stdout:(6/11): python3-grpcio-1.46.7-10.el9.x86_64.rpm 15 MB/s | 2.0 MB 00:00 2024-09-22T03:47:32.326 INFO:teuthology.orchestra.run.smithi098.stdout:(7/11): python3-grpcio-tools-1.46.7-10.el9.x86_ 5.7 MB/s | 144 kB 00:00 2024-09-22T03:47:32.343 INFO:teuthology.orchestra.run.smithi098.stdout:(8/11): python3-repoze-lru-0.7-16.el9.noarch.rp 1.8 MB/s | 31 kB 00:00 2024-09-22T03:47:32.368 INFO:teuthology.orchestra.run.smithi098.stdout:(9/11): python3-routes-2.5.1-5.el9.noarch.rpm 7.4 MB/s | 188 kB 00:00 2024-09-22T03:47:32.445 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:01:30 ago on Sun 22 Sep 2024 03:46:02 AM UTC. 2024-09-22T03:47:32.584 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-09-22T03:47:32.584 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-09-22T03:47:32.584 INFO:teuthology.orchestra.run.smithi037.stdout: Package Arch Version Repo Size 2024-09-22T03:47:32.584 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-09-22T03:47:32.584 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2024-09-22T03:47:32.584 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 158 k 2024-09-22T03:47:32.585 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:47:32.585 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2024-09-22T03:47:32.585 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-09-22T03:47:32.585 INFO:teuthology.orchestra.run.smithi037.stdout:Install 1 Package 2024-09-22T03:47:32.585 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:47:32.585 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 158 k 2024-09-22T03:47:32.585 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 644 k 2024-09-22T03:47:32.585 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2024-09-22T03:47:32.794 INFO:teuthology.orchestra.run.smithi098.stdout:(10/11): python3-protobuf-3.14.0-13.el9.noarch. 301 kB/s | 269 kB 00:00 2024-09-22T03:47:32.807 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-immutable-object-cache-19.3.0-5092.g62da54 714 kB/s | 158 kB 00:00 2024-09-22T03:47:32.807 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2024-09-22T03:47:32.808 INFO:teuthology.orchestra.run.smithi037.stdout:Total 709 kB/s | 158 kB 00:00 2024-09-22T03:47:32.808 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2024-09-22T03:47:32.818 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2024-09-22T03:47:32.818 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2024-09-22T03:47:32.880 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2024-09-22T03:47:32.880 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2024-09-22T03:47:32.994 INFO:teuthology.orchestra.run.smithi098.stdout:(11/11): ceph-mgr-dashboard-19.3.0-5092.g62da54 10 MB/s | 14 MB 00:01 2024-09-22T03:47:32.997 INFO:teuthology.orchestra.run.smithi098.stdout:-------------------------------------------------------------------------------- 2024-09-22T03:47:32.998 INFO:teuthology.orchestra.run.smithi098.stdout:Total 11 MB/s | 18 MB 00:01 2024-09-22T03:47:33.028 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction check 2024-09-22T03:47:33.030 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2024-09-22T03:47:33.047 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction check succeeded. 2024-09-22T03:47:33.047 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction test 2024-09-22T03:47:33.100 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-5092.g62da54b4. 1/1 2024-09-22T03:47:33.125 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-5092.g62da54b4. 1/1 2024-09-22T03:47:33.125 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T03:47:33.126 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-22T03:47:33.126 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:47:33.307 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction test succeeded. 2024-09-22T03:47:33.307 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction 2024-09-22T03:47:33.859 INFO:teuthology.orchestra.run.smithi098.stdout: Preparing : 1/1 2024-09-22T03:47:33.933 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 1/11 2024-09-22T03:47:33.964 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 2/11 2024-09-22T03:47:34.057 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-5092.g62da54b4. 1/1 2024-09-22T03:47:34.057 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:47:34.057 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2024-09-22T03:47:34.057 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-immutable-object-cache-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-22T03:47:34.057 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:47:34.057 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-09-22T03:47:34.072 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 3/11 2024-09-22T03:47:34.199 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 4/11 2024-09-22T03:47:34.259 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 5/11 2024-09-22T03:47:34.291 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install ceph-mgr 2024-09-22T03:47:34.344 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 6/11 2024-09-22T03:47:34.386 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 7/11 2024-09-22T03:47:34.423 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 8/11 2024-09-22T03:47:34.456 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-5092.g62da54b4.el9 9/11 2024-09-22T03:47:34.898 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:01:32 ago on Sun 22 Sep 2024 03:46:02 AM UTC. 2024-09-22T03:47:34.991 INFO:teuthology.orchestra.run.smithi037.stdout:Package ceph-mgr-2:19.3.0-5092.g62da54b4.el9.x86_64 is already installed. 2024-09-22T03:47:35.037 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-09-22T03:47:35.038 INFO:teuthology.orchestra.run.smithi037.stdout:Nothing to do. 2024-09-22T03:47:35.038 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-09-22T03:47:35.111 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install ceph-mgr-dashboard 2024-09-22T03:47:35.715 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:01:33 ago on Sun 22 Sep 2024 03:46:02 AM UTC. 2024-09-22T03:47:35.852 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-09-22T03:47:35.853 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-09-22T03:47:35.854 INFO:teuthology.orchestra.run.smithi037.stdout: Package Arch Version Repository Size 2024-09-22T03:47:35.854 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-09-22T03:47:35.854 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2024-09-22T03:47:35.854 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-dashboard noarch 2:19.3.0-5092.g62da54b4.el9 ceph-noarch 14 M 2024-09-22T03:47:35.854 INFO:teuthology.orchestra.run.smithi037.stdout:Installing dependencies: 2024-09-22T03:47:35.854 INFO:teuthology.orchestra.run.smithi037.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-22T03:47:35.854 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-grafana-dashboards noarch 2:19.3.0-5092.g62da54b4.el9 ceph-noarch 34 k 2024-09-22T03:47:35.854 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-prometheus-alerts noarch 2:19.3.0-5092.g62da54b4.el9 ceph-noarch 16 k 2024-09-22T03:47:35.854 INFO:teuthology.orchestra.run.smithi037.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-22T03:47:35.854 INFO:teuthology.orchestra.run.smithi037.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-22T03:47:35.854 INFO:teuthology.orchestra.run.smithi037.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-22T03:47:35.854 INFO:teuthology.orchestra.run.smithi037.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-22T03:47:35.854 INFO:teuthology.orchestra.run.smithi037.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-22T03:47:35.854 INFO:teuthology.orchestra.run.smithi037.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-22T03:47:35.855 INFO:teuthology.orchestra.run.smithi037.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-22T03:47:35.855 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:47:35.855 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2024-09-22T03:47:35.855 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-09-22T03:47:35.855 INFO:teuthology.orchestra.run.smithi037.stdout:Install 11 Packages 2024-09-22T03:47:35.855 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:47:35.855 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 18 M 2024-09-22T03:47:35.855 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 156 M 2024-09-22T03:47:35.855 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2024-09-22T03:47:36.361 INFO:teuthology.orchestra.run.smithi037.stdout:(1/11): ceph-grafana-dashboards-19.3.0-5092.g62 233 kB/s | 34 kB 00:00 2024-09-22T03:47:36.386 INFO:teuthology.orchestra.run.smithi037.stdout:(2/11): ceph-prometheus-alerts-19.3.0-5092.g62d 96 kB/s | 16 kB 00:00 2024-09-22T03:47:36.895 INFO:teuthology.orchestra.run.smithi037.stdout:(3/11): ceph-mgr-dashboard-19.3.0-5092.g62da54b 21 MB/s | 14 MB 00:00 2024-09-22T03:47:37.012 INFO:teuthology.orchestra.run.smithi037.stdout:(4/11): abseil-cpp-20211102.0-3.el9.x86_64.rpm 4.6 MB/s | 548 kB 00:00 2024-09-22T03:47:37.037 INFO:teuthology.orchestra.run.smithi037.stdout:(5/11): python3-protobuf-3.14.0-13.el9.noarch.r 399 kB/s | 269 kB 00:00 2024-09-22T03:47:37.062 INFO:teuthology.orchestra.run.smithi037.stdout:(6/11): grpc-data-1.46.7-10.el9.noarch.rpm 387 kB/s | 19 kB 00:00 2024-09-22T03:47:37.104 INFO:teuthology.orchestra.run.smithi037.stdout:(7/11): python3-grpcio-tools-1.46.7-10.el9.x86_ 4.2 MB/s | 144 kB 00:00 2024-09-22T03:47:37.129 INFO:teuthology.orchestra.run.smithi037.stdout:(8/11): python3-repoze-lru-0.7-16.el9.noarch.rp 1.3 MB/s | 31 kB 00:00 2024-09-22T03:47:37.163 INFO:teuthology.orchestra.run.smithi037.stdout:(9/11): python3-routes-2.5.1-5.el9.noarch.rpm 5.6 MB/s | 188 kB 00:00 2024-09-22T03:47:37.263 INFO:teuthology.orchestra.run.smithi037.stdout:(10/11): python3-grpcio-1.46.7-10.el9.x86_64.rp 9.0 MB/s | 2.0 MB 00:00 2024-09-22T03:47:37.297 INFO:teuthology.orchestra.run.smithi037.stdout:(11/11): protobuf-compiler-3.14.0-13.el9.x86_64 948 kB/s | 863 kB 00:00 2024-09-22T03:47:37.301 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2024-09-22T03:47:37.301 INFO:teuthology.orchestra.run.smithi037.stdout:Total 13 MB/s | 18 MB 00:01 2024-09-22T03:47:37.334 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2024-09-22T03:47:37.356 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2024-09-22T03:47:37.356 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2024-09-22T03:47:37.622 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-5092.g62da54b4.el 10/11 2024-09-22T03:47:37.649 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2024-09-22T03:47:37.649 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2024-09-22T03:47:37.686 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-5092.g62da54b4.el9.noa 11/11 2024-09-22T03:47:38.215 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2024-09-22T03:47:38.297 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 1/11 2024-09-22T03:47:38.333 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 2/11 2024-09-22T03:47:38.434 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 3/11 2024-09-22T03:47:38.574 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 4/11 2024-09-22T03:47:38.629 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 5/11 2024-09-22T03:47:38.718 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 6/11 2024-09-22T03:47:38.773 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 7/11 2024-09-22T03:47:38.817 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 8/11 2024-09-22T03:47:38.850 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-5092.g62da54b4.el9 9/11 2024-09-22T03:47:39.369 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-5092.g62da54b4.el9.noa 11/11 2024-09-22T03:47:39.369 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-5092.g62da54b4.el 1/11 2024-09-22T03:47:39.369 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-5092.g62da54b4.el9.noa 2/11 2024-09-22T03:47:39.369 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-5092.g62da54b4.el9 3/11 2024-09-22T03:47:39.370 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 4/11 2024-09-22T03:47:39.370 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 5/11 2024-09-22T03:47:39.370 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 6/11 2024-09-22T03:47:39.370 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 7/11 2024-09-22T03:47:39.370 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 8/11 2024-09-22T03:47:39.370 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/11 2024-09-22T03:47:39.370 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 10/11 2024-09-22T03:47:39.690 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 11/11 2024-09-22T03:47:39.690 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-22T03:47:39.691 INFO:teuthology.orchestra.run.smithi098.stdout:Installed: 2024-09-22T03:47:39.691 INFO:teuthology.orchestra.run.smithi098.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-22T03:47:39.691 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-grafana-dashboards-2:19.3.0-5092.g62da54b4.el9.noarch 2024-09-22T03:47:39.691 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-dashboard-2:19.3.0-5092.g62da54b4.el9.noarch 2024-09-22T03:47:39.691 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-prometheus-alerts-2:19.3.0-5092.g62da54b4.el9.noarch 2024-09-22T03:47:39.691 INFO:teuthology.orchestra.run.smithi098.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-22T03:47:39.691 INFO:teuthology.orchestra.run.smithi098.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-22T03:47:39.691 INFO:teuthology.orchestra.run.smithi098.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-22T03:47:39.691 INFO:teuthology.orchestra.run.smithi098.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-22T03:47:39.691 INFO:teuthology.orchestra.run.smithi098.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-22T03:47:39.691 INFO:teuthology.orchestra.run.smithi098.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-22T03:47:39.692 INFO:teuthology.orchestra.run.smithi098.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-22T03:47:39.692 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-22T03:47:39.692 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-22T03:47:39.937 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-22T03:47:40.512 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:01:38 ago on Sun 22 Sep 2024 03:46:02 AM UTC. 2024-09-22T03:47:40.644 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-22T03:47:40.645 INFO:teuthology.orchestra.run.smithi098.stdout:======================================================================================= 2024-09-22T03:47:40.646 INFO:teuthology.orchestra.run.smithi098.stdout: Package Arch Version Repository Size 2024-09-22T03:47:40.646 INFO:teuthology.orchestra.run.smithi098.stdout:======================================================================================= 2024-09-22T03:47:40.646 INFO:teuthology.orchestra.run.smithi098.stdout:Installing: 2024-09-22T03:47:40.646 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-5092.g62da54b4.el9 ceph-noarch 7.4 M 2024-09-22T03:47:40.646 INFO:teuthology.orchestra.run.smithi098.stdout:Installing dependencies: 2024-09-22T03:47:40.646 INFO:teuthology.orchestra.run.smithi098.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-22T03:47:40.646 INFO:teuthology.orchestra.run.smithi098.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-22T03:47:40.646 INFO:teuthology.orchestra.run.smithi098.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-22T03:47:40.646 INFO:teuthology.orchestra.run.smithi098.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-22T03:47:40.646 INFO:teuthology.orchestra.run.smithi098.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-22T03:47:40.646 INFO:teuthology.orchestra.run.smithi098.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-22T03:47:40.647 INFO:teuthology.orchestra.run.smithi098.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-22T03:47:40.647 INFO:teuthology.orchestra.run.smithi098.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-22T03:47:40.647 INFO:teuthology.orchestra.run.smithi098.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-22T03:47:40.647 INFO:teuthology.orchestra.run.smithi098.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-22T03:47:40.647 INFO:teuthology.orchestra.run.smithi098.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-22T03:47:40.647 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-22T03:47:40.647 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction Summary 2024-09-22T03:47:40.647 INFO:teuthology.orchestra.run.smithi098.stdout:======================================================================================= 2024-09-22T03:47:40.647 INFO:teuthology.orchestra.run.smithi098.stdout:Install 12 Packages 2024-09-22T03:47:40.647 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-22T03:47:40.648 INFO:teuthology.orchestra.run.smithi098.stdout:Total download size: 38 M 2024-09-22T03:47:40.648 INFO:teuthology.orchestra.run.smithi098.stdout:Installed size: 212 M 2024-09-22T03:47:40.648 INFO:teuthology.orchestra.run.smithi098.stdout:Downloading Packages: 2024-09-22T03:47:41.027 INFO:teuthology.orchestra.run.smithi098.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 921 kB/s | 191 kB 00:00 2024-09-22T03:47:41.152 INFO:teuthology.orchestra.run.smithi098.stdout:(2/12): libgfortran-11.5.0-2.el9.x86_64.rpm 2.4 MB/s | 801 kB 00:00 2024-09-22T03:47:41.352 INFO:teuthology.orchestra.run.smithi098.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 100 kB/s | 33 kB 00:00 2024-09-22T03:47:41.469 INFO:teuthology.orchestra.run.smithi098.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 156 kB/s | 18 kB 00:00 2024-09-22T03:47:41.577 INFO:teuthology.orchestra.run.smithi098.stdout:(5/12): openblas-0.3.26-2.el9.x86_64.rpm 355 kB/s | 38 kB 00:00 2024-09-22T03:47:42.237 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-5092.g62da54b4.el 10/11 2024-09-22T03:47:42.295 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-5092.g62da54b4.el9.noa 11/11 2024-09-22T03:47:42.361 INFO:teuthology.orchestra.run.smithi098.stdout:(6/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 2.5 MB/s | 3.0 MB 00:01 2024-09-22T03:47:42.486 INFO:teuthology.orchestra.run.smithi098.stdout:(7/12): python3-devel-3.9.19-8.el9.x86_64.rpm 1.9 MB/s | 245 kB 00:00 2024-09-22T03:47:42.770 INFO:teuthology.orchestra.run.smithi098.stdout:(8/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 18 MB/s | 5.1 MB 00:00 2024-09-22T03:47:42.887 INFO:teuthology.orchestra.run.smithi098.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.1 MB/s | 250 kB 00:00 2024-09-22T03:47:43.545 INFO:teuthology.orchestra.run.smithi098.stdout:(10/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 25 MB/s | 16 MB 00:00 2024-09-22T03:47:44.180 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-5092.g62da54b4.el9.noa 11/11 2024-09-22T03:47:44.181 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-5092.g62da54b4.el 1/11 2024-09-22T03:47:44.181 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-5092.g62da54b4.el9.noa 2/11 2024-09-22T03:47:44.181 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-5092.g62da54b4.el9 3/11 2024-09-22T03:47:44.181 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 4/11 2024-09-22T03:47:44.181 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 5/11 2024-09-22T03:47:44.181 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 6/11 2024-09-22T03:47:44.181 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 7/11 2024-09-22T03:47:44.181 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 8/11 2024-09-22T03:47:44.181 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/11 2024-09-22T03:47:44.181 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 10/11 2024-09-22T03:47:44.506 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 11/11 2024-09-22T03:47:44.506 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:47:44.506 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2024-09-22T03:47:44.507 INFO:teuthology.orchestra.run.smithi037.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-22T03:47:44.507 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-grafana-dashboards-2:19.3.0-5092.g62da54b4.el9.noarch 2024-09-22T03:47:44.507 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-dashboard-2:19.3.0-5092.g62da54b4.el9.noarch 2024-09-22T03:47:44.507 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-prometheus-alerts-2:19.3.0-5092.g62da54b4.el9.noarch 2024-09-22T03:47:44.507 INFO:teuthology.orchestra.run.smithi037.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-22T03:47:44.507 INFO:teuthology.orchestra.run.smithi037.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-22T03:47:44.507 INFO:teuthology.orchestra.run.smithi037.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-22T03:47:44.507 INFO:teuthology.orchestra.run.smithi037.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-22T03:47:44.507 INFO:teuthology.orchestra.run.smithi037.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-22T03:47:44.507 INFO:teuthology.orchestra.run.smithi037.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-22T03:47:44.507 INFO:teuthology.orchestra.run.smithi037.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-22T03:47:44.507 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:47:44.507 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-09-22T03:47:44.783 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-22T03:47:44.854 INFO:teuthology.orchestra.run.smithi098.stdout:(11/12): openblas-openmp-0.3.26-2.el9.x86_64.rp 1.5 MB/s | 4.9 MB 00:03 2024-09-22T03:47:45.395 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:01:43 ago on Sun 22 Sep 2024 03:46:02 AM UTC. 2024-09-22T03:47:45.537 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-09-22T03:47:45.538 INFO:teuthology.orchestra.run.smithi037.stdout:======================================================================================= 2024-09-22T03:47:45.538 INFO:teuthology.orchestra.run.smithi037.stdout: Package Arch Version Repository Size 2024-09-22T03:47:45.538 INFO:teuthology.orchestra.run.smithi037.stdout:======================================================================================= 2024-09-22T03:47:45.538 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2024-09-22T03:47:45.538 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-5092.g62da54b4.el9 ceph-noarch 7.4 M 2024-09-22T03:47:45.538 INFO:teuthology.orchestra.run.smithi037.stdout:Installing dependencies: 2024-09-22T03:47:45.538 INFO:teuthology.orchestra.run.smithi037.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-22T03:47:45.538 INFO:teuthology.orchestra.run.smithi037.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-22T03:47:45.539 INFO:teuthology.orchestra.run.smithi037.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-22T03:47:45.539 INFO:teuthology.orchestra.run.smithi037.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-22T03:47:45.539 INFO:teuthology.orchestra.run.smithi037.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-22T03:47:45.539 INFO:teuthology.orchestra.run.smithi037.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-22T03:47:45.539 INFO:teuthology.orchestra.run.smithi037.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-22T03:47:45.539 INFO:teuthology.orchestra.run.smithi037.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-22T03:47:45.539 INFO:teuthology.orchestra.run.smithi037.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-22T03:47:45.539 INFO:teuthology.orchestra.run.smithi037.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-22T03:47:45.539 INFO:teuthology.orchestra.run.smithi037.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-22T03:47:45.539 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:47:45.539 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2024-09-22T03:47:45.539 INFO:teuthology.orchestra.run.smithi037.stdout:======================================================================================= 2024-09-22T03:47:45.539 INFO:teuthology.orchestra.run.smithi037.stdout:Install 12 Packages 2024-09-22T03:47:45.539 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:47:45.540 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 38 M 2024-09-22T03:47:45.540 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 212 M 2024-09-22T03:47:45.540 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2024-09-22T03:47:45.853 INFO:teuthology.orchestra.run.smithi037.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 1.3 MB/s | 191 kB 00:00 2024-09-22T03:47:45.903 INFO:teuthology.orchestra.run.smithi037.stdout:(2/12): libgfortran-11.5.0-2.el9.x86_64.rpm 4.1 MB/s | 801 kB 00:00 2024-09-22T03:47:45.937 INFO:teuthology.orchestra.run.smithi037.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 393 kB/s | 33 kB 00:00 2024-09-22T03:47:45.995 INFO:teuthology.orchestra.run.smithi037.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 312 kB/s | 18 kB 00:00 2024-09-22T03:47:46.062 INFO:teuthology.orchestra.run.smithi037.stdout:(5/12): openblas-0.3.26-2.el9.x86_64.rpm 577 kB/s | 38 kB 00:00 2024-09-22T03:47:46.212 INFO:teuthology.orchestra.run.smithi037.stdout:(6/12): ceph-mgr-diskprediction-local-19.3.0-50 15 MB/s | 7.4 MB 00:00 2024-09-22T03:47:46.279 INFO:teuthology.orchestra.run.smithi037.stdout:(7/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 8.0 MB/s | 3.0 MB 00:00 2024-09-22T03:47:46.380 INFO:teuthology.orchestra.run.smithi037.stdout:(8/12): python3-devel-3.9.19-8.el9.x86_64.rpm 1.4 MB/s | 245 kB 00:00 2024-09-22T03:47:46.472 INFO:teuthology.orchestra.run.smithi037.stdout:(9/12): openblas-openmp-0.3.26-2.el9.x86_64.rpm 12 MB/s | 4.9 MB 00:00 2024-09-22T03:47:46.497 INFO:teuthology.orchestra.run.smithi037.stdout:(10/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 2.1 MB/s | 250 kB 00:00 2024-09-22T03:47:46.597 INFO:teuthology.orchestra.run.smithi037.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 16 MB/s | 5.1 MB 00:00 2024-09-22T03:47:46.906 INFO:teuthology.orchestra.run.smithi037.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 37 MB/s | 16 MB 00:00 2024-09-22T03:47:46.907 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2024-09-22T03:47:46.907 INFO:teuthology.orchestra.run.smithi037.stdout:Total 28 MB/s | 38 MB 00:01 2024-09-22T03:47:47.270 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2024-09-22T03:47:47.297 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2024-09-22T03:47:47.297 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2024-09-22T03:47:47.749 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2024-09-22T03:47:47.749 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2024-09-22T03:47:47.778 INFO:teuthology.orchestra.run.smithi098.stdout:(12/12): ceph-mgr-diskprediction-local-19.3.0-5 1.1 MB/s | 7.4 MB 00:06 2024-09-22T03:47:47.780 INFO:teuthology.orchestra.run.smithi098.stdout:-------------------------------------------------------------------------------- 2024-09-22T03:47:47.780 INFO:teuthology.orchestra.run.smithi098.stdout:Total 5.4 MB/s | 38 MB 00:07 2024-09-22T03:47:48.135 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction check 2024-09-22T03:47:48.161 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction check succeeded. 2024-09-22T03:47:48.161 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction test 2024-09-22T03:47:48.542 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2024-09-22T03:47:48.597 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction test succeeded. 2024-09-22T03:47:48.597 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction 2024-09-22T03:47:48.617 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-22T03:47:48.671 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-22T03:47:48.783 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-22T03:47:48.822 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-22T03:47:49.014 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-22T03:47:49.054 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-22T03:47:49.132 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-22T03:47:49.355 INFO:teuthology.orchestra.run.smithi098.stdout: Preparing : 1/1 2024-09-22T03:47:49.413 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-22T03:47:49.451 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-22T03:47:49.552 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-22T03:47:49.595 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-22T03:47:49.778 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-22T03:47:49.810 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-22T03:47:49.831 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-22T03:47:49.887 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-22T03:47:49.955 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-22T03:47:50.545 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-22T03:47:50.675 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-22T03:47:51.287 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-22T03:47:51.939 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-22T03:47:52.365 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-22T03:47:52.386 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-5092.g62da5 12/12 2024-09-22T03:47:52.987 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-22T03:47:53.019 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-5092.g62da5 12/12 2024-09-22T03:47:54.953 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-5092.g62da5 12/12 2024-09-22T03:47:54.953 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-5092.g62da5 1/12 2024-09-22T03:47:54.954 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-22T03:47:54.954 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-22T03:47:54.954 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-22T03:47:54.954 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-22T03:47:54.954 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-22T03:47:54.954 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-22T03:47:54.954 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-22T03:47:54.954 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-22T03:47:54.954 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-22T03:47:54.954 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-22T03:47:55.323 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-22T03:47:55.324 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:47:55.324 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2024-09-22T03:47:55.324 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-diskprediction-local-2:19.3.0-5092.g62da54b4.el9.noarch 2024-09-22T03:47:55.324 INFO:teuthology.orchestra.run.smithi037.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-22T03:47:55.324 INFO:teuthology.orchestra.run.smithi037.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-22T03:47:55.324 INFO:teuthology.orchestra.run.smithi037.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-22T03:47:55.324 INFO:teuthology.orchestra.run.smithi037.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-22T03:47:55.324 INFO:teuthology.orchestra.run.smithi037.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-22T03:47:55.324 INFO:teuthology.orchestra.run.smithi037.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-22T03:47:55.324 INFO:teuthology.orchestra.run.smithi037.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-22T03:47:55.324 INFO:teuthology.orchestra.run.smithi037.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-22T03:47:55.324 INFO:teuthology.orchestra.run.smithi037.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-22T03:47:55.324 INFO:teuthology.orchestra.run.smithi037.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-22T03:47:55.324 INFO:teuthology.orchestra.run.smithi037.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-22T03:47:55.324 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:47:55.325 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-09-22T03:47:55.586 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-5092.g62da5 12/12 2024-09-22T03:47:55.586 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-5092.g62da5 1/12 2024-09-22T03:47:55.586 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-22T03:47:55.586 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-22T03:47:55.586 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-22T03:47:55.586 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-22T03:47:55.586 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-22T03:47:55.586 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-22T03:47:55.586 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-22T03:47:55.587 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-22T03:47:55.587 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-22T03:47:55.587 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-22T03:47:55.760 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install ceph-mgr-rook 2024-09-22T03:47:55.990 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-22T03:47:55.991 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-22T03:47:55.991 INFO:teuthology.orchestra.run.smithi098.stdout:Installed: 2024-09-22T03:47:55.991 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-diskprediction-local-2:19.3.0-5092.g62da54b4.el9.noarch 2024-09-22T03:47:55.991 INFO:teuthology.orchestra.run.smithi098.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-22T03:47:55.991 INFO:teuthology.orchestra.run.smithi098.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-22T03:47:55.991 INFO:teuthology.orchestra.run.smithi098.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-22T03:47:55.991 INFO:teuthology.orchestra.run.smithi098.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-22T03:47:55.991 INFO:teuthology.orchestra.run.smithi098.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-22T03:47:55.991 INFO:teuthology.orchestra.run.smithi098.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-22T03:47:55.991 INFO:teuthology.orchestra.run.smithi098.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-22T03:47:55.991 INFO:teuthology.orchestra.run.smithi098.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-22T03:47:55.991 INFO:teuthology.orchestra.run.smithi098.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-22T03:47:55.991 INFO:teuthology.orchestra.run.smithi098.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-22T03:47:55.991 INFO:teuthology.orchestra.run.smithi098.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-22T03:47:55.991 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-22T03:47:55.992 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-22T03:47:56.372 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:01:54 ago on Sun 22 Sep 2024 03:46:02 AM UTC. 2024-09-22T03:47:56.418 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install ceph-mgr-rook 2024-09-22T03:47:56.512 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-09-22T03:47:56.514 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-09-22T03:47:56.514 INFO:teuthology.orchestra.run.smithi037.stdout: Package Arch Version Repository Size 2024-09-22T03:47:56.514 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-09-22T03:47:56.514 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2024-09-22T03:47:56.514 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-rook noarch 2:19.3.0-5092.g62da54b4.el9 ceph-noarch 49 k 2024-09-22T03:47:56.514 INFO:teuthology.orchestra.run.smithi037.stdout:Installing dependencies: 2024-09-22T03:47:56.514 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-22T03:47:56.514 INFO:teuthology.orchestra.run.smithi037.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-22T03:47:56.514 INFO:teuthology.orchestra.run.smithi037.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-22T03:47:56.515 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-22T03:47:56.515 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-22T03:47:56.515 INFO:teuthology.orchestra.run.smithi037.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-22T03:47:56.515 INFO:teuthology.orchestra.run.smithi037.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-22T03:47:56.515 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-22T03:47:56.515 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-22T03:47:56.515 INFO:teuthology.orchestra.run.smithi037.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-22T03:47:56.515 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-22T03:47:56.515 INFO:teuthology.orchestra.run.smithi037.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-22T03:47:56.515 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:47:56.515 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2024-09-22T03:47:56.515 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-09-22T03:47:56.515 INFO:teuthology.orchestra.run.smithi037.stdout:Install 13 Packages 2024-09-22T03:47:56.515 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:47:56.516 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 2.2 M 2024-09-22T03:47:56.516 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 26 M 2024-09-22T03:47:56.516 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2024-09-22T03:47:56.877 INFO:teuthology.orchestra.run.smithi037.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 222 kB/s | 19 kB 00:00 2024-09-22T03:47:56.894 INFO:teuthology.orchestra.run.smithi037.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 248 kB/s | 26 kB 00:00 2024-09-22T03:47:56.953 INFO:teuthology.orchestra.run.smithi037.stdout:(3/13): ceph-mgr-rook-19.3.0-5092.g62da54b4.el9 304 kB/s | 49 kB 00:00 2024-09-22T03:47:56.978 INFO:teuthology.orchestra.run.smithi037.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.2 MB/s | 222 kB 00:00 2024-09-22T03:47:57.003 INFO:teuthology.orchestra.run.smithi037.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.4 MB/s | 159 kB 00:00 2024-09-22T03:47:57.018 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:01:55 ago on Sun 22 Sep 2024 03:46:02 AM UTC. 2024-09-22T03:47:57.029 INFO:teuthology.orchestra.run.smithi037.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 1.0 MB/s | 54 kB 00:00 2024-09-22T03:47:57.071 INFO:teuthology.orchestra.run.smithi037.stdout:(7/13): python3-cachetools-4.2.4-1.el9.noarch.r 480 kB/s | 32 kB 00:00 2024-09-22T03:47:57.096 INFO:teuthology.orchestra.run.smithi037.stdout:(8/13): python3-certifi-2023.05.07-4.el9.noarch 211 kB/s | 14 kB 00:00 2024-09-22T03:47:57.129 INFO:teuthology.orchestra.run.smithi037.stdout:(9/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.5 MB/s | 279 kB 00:00 2024-09-22T03:47:57.157 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-22T03:47:57.158 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-22T03:47:57.158 INFO:teuthology.orchestra.run.smithi098.stdout: Package Arch Version Repository Size 2024-09-22T03:47:57.158 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-22T03:47:57.158 INFO:teuthology.orchestra.run.smithi098.stdout:Installing: 2024-09-22T03:47:57.158 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-rook noarch 2:19.3.0-5092.g62da54b4.el9 ceph-noarch 49 k 2024-09-22T03:47:57.158 INFO:teuthology.orchestra.run.smithi098.stdout:Installing dependencies: 2024-09-22T03:47:57.158 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-22T03:47:57.158 INFO:teuthology.orchestra.run.smithi098.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-22T03:47:57.159 INFO:teuthology.orchestra.run.smithi098.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-22T03:47:57.159 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-22T03:47:57.159 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-22T03:47:57.159 INFO:teuthology.orchestra.run.smithi098.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-22T03:47:57.159 INFO:teuthology.orchestra.run.smithi098.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-22T03:47:57.159 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-22T03:47:57.159 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-22T03:47:57.159 INFO:teuthology.orchestra.run.smithi098.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-22T03:47:57.159 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-22T03:47:57.159 INFO:teuthology.orchestra.run.smithi098.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-22T03:47:57.159 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-22T03:47:57.159 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction Summary 2024-09-22T03:47:57.159 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-22T03:47:57.160 INFO:teuthology.orchestra.run.smithi098.stdout:Install 13 Packages 2024-09-22T03:47:57.160 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-22T03:47:57.160 INFO:teuthology.orchestra.run.smithi098.stdout:Total download size: 2.2 M 2024-09-22T03:47:57.160 INFO:teuthology.orchestra.run.smithi098.stdout:Installed size: 26 M 2024-09-22T03:47:57.160 INFO:teuthology.orchestra.run.smithi098.stdout:Downloading Packages: 2024-09-22T03:47:57.163 INFO:teuthology.orchestra.run.smithi037.stdout:(10/13): python3-google-auth-2.34.0-1.el9.noarc 2.4 MB/s | 220 kB 00:00 2024-09-22T03:47:57.196 INFO:teuthology.orchestra.run.smithi037.stdout:(11/13): python3-websocket-client-1.2.3-2.el9.n 2.8 MB/s | 90 kB 00:00 2024-09-22T03:47:57.222 INFO:teuthology.orchestra.run.smithi037.stdout:(12/13): python3-rsa-4.9-2.el9.noarch.rpm 642 kB/s | 59 kB 00:00 2024-09-22T03:47:57.255 INFO:teuthology.orchestra.run.smithi037.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 6.4 MB/s | 1.0 MB 00:00 2024-09-22T03:47:57.258 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2024-09-22T03:47:57.259 INFO:teuthology.orchestra.run.smithi037.stdout:Total 3.0 MB/s | 2.2 MB 00:00 2024-09-22T03:47:57.327 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2024-09-22T03:47:57.344 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2024-09-22T03:47:57.344 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2024-09-22T03:47:57.420 INFO:teuthology.orchestra.run.smithi098.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 287 kB/s | 26 kB 00:00 2024-09-22T03:47:57.437 INFO:teuthology.orchestra.run.smithi098.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 180 kB/s | 19 kB 00:00 2024-09-22T03:47:57.441 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2024-09-22T03:47:57.441 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2024-09-22T03:47:57.529 INFO:teuthology.orchestra.run.smithi098.stdout:(3/13): ceph-mgr-rook-19.3.0-5092.g62da54b4.el9 248 kB/s | 49 kB 00:00 2024-09-22T03:47:57.554 INFO:teuthology.orchestra.run.smithi098.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.6 MB/s | 222 kB 00:00 2024-09-22T03:47:57.580 INFO:teuthology.orchestra.run.smithi098.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.1 MB/s | 159 kB 00:00 2024-09-22T03:47:57.613 INFO:teuthology.orchestra.run.smithi098.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 916 kB/s | 54 kB 00:00 2024-09-22T03:47:57.647 INFO:teuthology.orchestra.run.smithi098.stdout:(7/13): python3-cachetools-4.2.4-1.el9.noarch.r 481 kB/s | 32 kB 00:00 2024-09-22T03:47:57.672 INFO:teuthology.orchestra.run.smithi098.stdout:(8/13): python3-certifi-2023.05.07-4.el9.noarch 254 kB/s | 14 kB 00:00 2024-09-22T03:47:57.698 INFO:teuthology.orchestra.run.smithi098.stdout:(9/13): python3-google-auth-2.34.0-1.el9.noarch 4.5 MB/s | 220 kB 00:00 2024-09-22T03:47:57.715 INFO:teuthology.orchestra.run.smithi098.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 3.5 MB/s | 59 kB 00:00 2024-09-22T03:47:57.748 INFO:teuthology.orchestra.run.smithi098.stdout:(11/13): python3-websocket-client-1.2.3-2.el9.n 2.6 MB/s | 90 kB 00:00 2024-09-22T03:47:57.774 INFO:teuthology.orchestra.run.smithi098.stdout:(12/13): python3-pyasn1-modules-0.4.8-6.el9.noa 1.1 MB/s | 279 kB 00:00 2024-09-22T03:47:57.807 INFO:teuthology.orchestra.run.smithi098.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 7.6 MB/s | 1.0 MB 00:00 2024-09-22T03:47:57.809 INFO:teuthology.orchestra.run.smithi098.stdout:-------------------------------------------------------------------------------- 2024-09-22T03:47:57.809 INFO:teuthology.orchestra.run.smithi098.stdout:Total 3.4 MB/s | 2.2 MB 00:00 2024-09-22T03:47:57.873 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction check 2024-09-22T03:47:57.888 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction check succeeded. 2024-09-22T03:47:57.888 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction test 2024-09-22T03:47:57.961 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2024-09-22T03:47:57.980 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction test succeeded. 2024-09-22T03:47:57.981 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction 2024-09-22T03:47:58.143 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-22T03:47:58.199 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-22T03:47:58.264 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-22T03:47:58.299 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-22T03:47:58.341 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-22T03:47:58.463 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-22T03:47:58.488 INFO:teuthology.orchestra.run.smithi098.stdout: Preparing : 1/1 2024-09-22T03:47:58.574 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-22T03:47:58.627 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-22T03:47:58.678 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-22T03:47:58.741 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-22T03:47:58.797 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-22T03:47:58.834 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-22T03:47:58.876 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-22T03:47:58.978 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-22T03:47:59.088 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-22T03:47:59.154 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-22T03:47:59.381 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-22T03:47:59.440 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-22T03:47:59.482 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-22T03:47:59.531 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-22T03:47:59.559 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-rook-2:19.3.0-5092.g62da54b4.el9.noarch 13/13 2024-09-22T03:47:59.868 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-22T03:47:59.917 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-22T03:47:59.950 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-22T03:47:59.999 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-22T03:48:00.020 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mgr-rook-2:19.3.0-5092.g62da54b4.el9.noarch 13/13 2024-09-22T03:48:00.344 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-5092.g62da54b4.el9.noarch 13/13 2024-09-22T03:48:00.344 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-rook-2:19.3.0-5092.g62da54b4.el9.noarch 1/13 2024-09-22T03:48:00.345 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-22T03:48:00.345 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-22T03:48:00.345 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-22T03:48:00.345 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-22T03:48:00.345 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-22T03:48:00.345 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-22T03:48:00.345 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-22T03:48:00.345 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-22T03:48:00.345 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-22T03:48:00.345 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-22T03:48:00.346 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-22T03:48:00.680 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-22T03:48:00.680 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:48:00.680 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2024-09-22T03:48:00.680 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-rook-2:19.3.0-5092.g62da54b4.el9.noarch 2024-09-22T03:48:00.680 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-22T03:48:00.681 INFO:teuthology.orchestra.run.smithi037.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-22T03:48:00.681 INFO:teuthology.orchestra.run.smithi037.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-22T03:48:00.681 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-22T03:48:00.681 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-22T03:48:00.681 INFO:teuthology.orchestra.run.smithi037.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-22T03:48:00.681 INFO:teuthology.orchestra.run.smithi037.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-22T03:48:00.681 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-22T03:48:00.681 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-22T03:48:00.681 INFO:teuthology.orchestra.run.smithi037.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-22T03:48:00.681 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-22T03:48:00.681 INFO:teuthology.orchestra.run.smithi037.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-22T03:48:00.681 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:48:00.681 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-09-22T03:48:00.762 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-5092.g62da54b4.el9.noarch 13/13 2024-09-22T03:48:00.762 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mgr-rook-2:19.3.0-5092.g62da54b4.el9.noarch 1/13 2024-09-22T03:48:00.762 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-22T03:48:00.762 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-22T03:48:00.762 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-22T03:48:00.762 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-22T03:48:00.762 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-22T03:48:00.762 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-22T03:48:00.762 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-22T03:48:00.762 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-22T03:48:00.762 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-22T03:48:00.763 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-22T03:48:00.763 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-22T03:48:00.929 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install ceph-mgr-cephadm 2024-09-22T03:48:01.106 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-22T03:48:01.106 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-22T03:48:01.106 INFO:teuthology.orchestra.run.smithi098.stdout:Installed: 2024-09-22T03:48:01.106 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-rook-2:19.3.0-5092.g62da54b4.el9.noarch 2024-09-22T03:48:01.106 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-22T03:48:01.106 INFO:teuthology.orchestra.run.smithi098.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-22T03:48:01.106 INFO:teuthology.orchestra.run.smithi098.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-22T03:48:01.106 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-22T03:48:01.106 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-22T03:48:01.106 INFO:teuthology.orchestra.run.smithi098.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-22T03:48:01.107 INFO:teuthology.orchestra.run.smithi098.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-22T03:48:01.107 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-22T03:48:01.107 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-22T03:48:01.107 INFO:teuthology.orchestra.run.smithi098.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-22T03:48:01.107 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-22T03:48:01.107 INFO:teuthology.orchestra.run.smithi098.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-22T03:48:01.107 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-22T03:48:01.107 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-22T03:48:01.375 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install ceph-mgr-cephadm 2024-09-22T03:48:01.537 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:01:59 ago on Sun 22 Sep 2024 03:46:02 AM UTC. 2024-09-22T03:48:01.675 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-09-22T03:48:01.676 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-09-22T03:48:01.676 INFO:teuthology.orchestra.run.smithi037.stdout: Package Arch Version Repository Size 2024-09-22T03:48:01.676 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-09-22T03:48:01.677 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2024-09-22T03:48:01.677 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-cephadm noarch 2:19.3.0-5092.g62da54b4.el9 ceph-noarch 154 k 2024-09-22T03:48:01.677 INFO:teuthology.orchestra.run.smithi037.stdout:Installing dependencies: 2024-09-22T03:48:01.677 INFO:teuthology.orchestra.run.smithi037.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-22T03:48:01.677 INFO:teuthology.orchestra.run.smithi037.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-22T03:48:01.677 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-22T03:48:01.677 INFO:teuthology.orchestra.run.smithi037.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-22T03:48:01.677 INFO:teuthology.orchestra.run.smithi037.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-22T03:48:01.677 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:48:01.677 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2024-09-22T03:48:01.677 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-09-22T03:48:01.677 INFO:teuthology.orchestra.run.smithi037.stdout:Install 6 Packages 2024-09-22T03:48:01.677 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:48:01.678 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 7.0 M 2024-09-22T03:48:01.678 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 33 M 2024-09-22T03:48:01.678 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2024-09-22T03:48:01.957 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:01:59 ago on Sun 22 Sep 2024 03:46:02 AM UTC. 2024-09-22T03:48:02.089 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-22T03:48:02.090 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-22T03:48:02.090 INFO:teuthology.orchestra.run.smithi098.stdout: Package Arch Version Repository Size 2024-09-22T03:48:02.090 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-22T03:48:02.090 INFO:teuthology.orchestra.run.smithi098.stdout:Installing: 2024-09-22T03:48:02.090 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-cephadm noarch 2:19.3.0-5092.g62da54b4.el9 ceph-noarch 154 k 2024-09-22T03:48:02.090 INFO:teuthology.orchestra.run.smithi098.stdout:Installing dependencies: 2024-09-22T03:48:02.091 INFO:teuthology.orchestra.run.smithi098.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-22T03:48:02.091 INFO:teuthology.orchestra.run.smithi098.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-22T03:48:02.091 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-22T03:48:02.091 INFO:teuthology.orchestra.run.smithi098.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-22T03:48:02.091 INFO:teuthology.orchestra.run.smithi098.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-22T03:48:02.091 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-22T03:48:02.091 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction Summary 2024-09-22T03:48:02.091 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-22T03:48:02.091 INFO:teuthology.orchestra.run.smithi098.stdout:Install 6 Packages 2024-09-22T03:48:02.091 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-22T03:48:02.092 INFO:teuthology.orchestra.run.smithi098.stdout:Total download size: 7.0 M 2024-09-22T03:48:02.092 INFO:teuthology.orchestra.run.smithi098.stdout:Installed size: 33 M 2024-09-22T03:48:02.092 INFO:teuthology.orchestra.run.smithi098.stdout:Downloading Packages: 2024-09-22T03:48:02.248 INFO:teuthology.orchestra.run.smithi037.stdout:(1/6): ceph-mgr-cephadm-19.3.0-5092.g62da54b4.e 735 kB/s | 154 kB 00:00 2024-09-22T03:48:02.307 INFO:teuthology.orchestra.run.smithi037.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 9.2 MB/s | 548 kB 00:00 2024-09-22T03:48:02.332 INFO:teuthology.orchestra.run.smithi037.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 2.3 MB/s | 58 kB 00:00 2024-09-22T03:48:02.357 INFO:teuthology.orchestra.run.smithi037.stdout:(4/6): python3-typing-extensions-4.12.2-2.el9.n 3.0 MB/s | 74 kB 00:00 2024-09-22T03:48:02.593 INFO:teuthology.orchestra.run.smithi098.stdout:(1/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.3 MB/s | 248 kB 00:00 2024-09-22T03:48:02.618 INFO:teuthology.orchestra.run.smithi098.stdout:(2/6): ceph-mgr-cephadm-19.3.0-5092.g62da54b4.e 721 kB/s | 154 kB 00:00 2024-09-22T03:48:02.686 INFO:teuthology.orchestra.run.smithi098.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 863 kB/s | 58 kB 00:00 2024-09-22T03:48:02.719 INFO:teuthology.orchestra.run.smithi098.stdout:(4/6): python3-typing-extensions-4.12.2-2.el9.n 2.2 MB/s | 74 kB 00:00 2024-09-22T03:48:02.744 INFO:teuthology.orchestra.run.smithi098.stdout:(5/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 3.6 MB/s | 548 kB 00:00 2024-09-22T03:48:02.819 INFO:teuthology.orchestra.run.smithi098.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 14 MB/s | 6.0 MB 00:00 2024-09-22T03:48:02.822 INFO:teuthology.orchestra.run.smithi098.stdout:-------------------------------------------------------------------------------- 2024-09-22T03:48:02.822 INFO:teuthology.orchestra.run.smithi098.stdout:Total 9.6 MB/s | 7.0 MB 00:00 2024-09-22T03:48:02.892 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction check 2024-09-22T03:48:02.899 INFO:teuthology.orchestra.run.smithi037.stdout:(5/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 288 kB/s | 248 kB 00:00 2024-09-22T03:48:02.904 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction check succeeded. 2024-09-22T03:48:02.904 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction test 2024-09-22T03:48:03.004 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction test succeeded. 2024-09-22T03:48:03.004 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction 2024-09-22T03:48:03.319 INFO:teuthology.orchestra.run.smithi098.stdout: Preparing : 1/1 2024-09-22T03:48:03.493 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-22T03:48:03.546 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-22T03:48:03.733 INFO:teuthology.orchestra.run.smithi037.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 3.5 MB/s | 6.0 MB 00:01 2024-09-22T03:48:03.735 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2024-09-22T03:48:03.736 INFO:teuthology.orchestra.run.smithi037.stdout:Total 3.4 MB/s | 7.0 MB 00:02 2024-09-22T03:48:03.813 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2024-09-22T03:48:03.826 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2024-09-22T03:48:03.826 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2024-09-22T03:48:03.935 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2024-09-22T03:48:03.935 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2024-09-22T03:48:04.063 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-22T03:48:04.150 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-22T03:48:04.217 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-22T03:48:04.242 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-5092.g62da54b4.el9.noarch 6/6 2024-09-22T03:48:04.253 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2024-09-22T03:48:04.423 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-22T03:48:04.477 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-22T03:48:05.023 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-5092.g62da54b4.el9.noarch 6/6 2024-09-22T03:48:05.023 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-5092.g62da54b4.el9.noarch 1/6 2024-09-22T03:48:05.023 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-22T03:48:05.024 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-22T03:48:05.024 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-22T03:48:05.024 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-22T03:48:05.040 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-22T03:48:05.141 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-22T03:48:05.217 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-22T03:48:05.255 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-5092.g62da54b4.el9.noarch 6/6 2024-09-22T03:48:05.295 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-22T03:48:05.296 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-22T03:48:05.296 INFO:teuthology.orchestra.run.smithi098.stdout:Installed: 2024-09-22T03:48:05.296 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-cephadm-2:19.3.0-5092.g62da54b4.el9.noarch 2024-09-22T03:48:05.296 INFO:teuthology.orchestra.run.smithi098.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-22T03:48:05.296 INFO:teuthology.orchestra.run.smithi098.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-22T03:48:05.296 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-22T03:48:05.296 INFO:teuthology.orchestra.run.smithi098.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-22T03:48:05.296 INFO:teuthology.orchestra.run.smithi098.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-22T03:48:05.296 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-22T03:48:05.296 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-22T03:48:05.570 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install ceph-fuse 2024-09-22T03:48:06.049 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-5092.g62da54b4.el9.noarch 6/6 2024-09-22T03:48:06.050 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-5092.g62da54b4.el9.noarch 1/6 2024-09-22T03:48:06.050 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-22T03:48:06.050 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-22T03:48:06.050 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-22T03:48:06.050 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-22T03:48:06.144 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:02:04 ago on Sun 22 Sep 2024 03:46:02 AM UTC. 2024-09-22T03:48:06.276 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-22T03:48:06.277 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-22T03:48:06.277 INFO:teuthology.orchestra.run.smithi098.stdout: Package Arch Version Repository Size 2024-09-22T03:48:06.277 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-22T03:48:06.277 INFO:teuthology.orchestra.run.smithi098.stdout:Installing: 2024-09-22T03:48:06.277 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-fuse x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 883 k 2024-09-22T03:48:06.277 INFO:teuthology.orchestra.run.smithi098.stdout:Installing dependencies: 2024-09-22T03:48:06.277 INFO:teuthology.orchestra.run.smithi098.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-22T03:48:06.277 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-22T03:48:06.277 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction Summary 2024-09-22T03:48:06.278 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-22T03:48:06.278 INFO:teuthology.orchestra.run.smithi098.stdout:Install 2 Packages 2024-09-22T03:48:06.278 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-22T03:48:06.278 INFO:teuthology.orchestra.run.smithi098.stdout:Total download size: 963 k 2024-09-22T03:48:06.278 INFO:teuthology.orchestra.run.smithi098.stdout:Installed size: 4.1 M 2024-09-22T03:48:06.278 INFO:teuthology.orchestra.run.smithi098.stdout:Downloading Packages: 2024-09-22T03:48:06.328 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-22T03:48:06.328 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:48:06.329 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2024-09-22T03:48:06.329 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-cephadm-2:19.3.0-5092.g62da54b4.el9.noarch 2024-09-22T03:48:06.329 INFO:teuthology.orchestra.run.smithi037.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-22T03:48:06.329 INFO:teuthology.orchestra.run.smithi037.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-22T03:48:06.329 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-22T03:48:06.329 INFO:teuthology.orchestra.run.smithi037.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-22T03:48:06.329 INFO:teuthology.orchestra.run.smithi037.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-22T03:48:06.329 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:48:06.329 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-09-22T03:48:06.581 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install ceph-fuse 2024-09-22T03:48:06.613 INFO:teuthology.orchestra.run.smithi098.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 363 kB/s | 80 kB 00:00 2024-09-22T03:48:06.730 INFO:teuthology.orchestra.run.smithi098.stdout:(2/2): ceph-fuse-19.3.0-5092.g62da54b4.el9.x86_ 2.6 MB/s | 883 kB 00:00 2024-09-22T03:48:06.731 INFO:teuthology.orchestra.run.smithi098.stdout:-------------------------------------------------------------------------------- 2024-09-22T03:48:06.731 INFO:teuthology.orchestra.run.smithi098.stdout:Total 2.1 MB/s | 963 kB 00:00 2024-09-22T03:48:06.743 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction check 2024-09-22T03:48:06.767 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction check succeeded. 2024-09-22T03:48:06.767 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction test 2024-09-22T03:48:06.846 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction test succeeded. 2024-09-22T03:48:06.846 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction 2024-09-22T03:48:07.035 INFO:teuthology.orchestra.run.smithi098.stdout: Preparing : 1/1 2024-09-22T03:48:07.185 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:02:05 ago on Sun 22 Sep 2024 03:46:02 AM UTC. 2024-09-22T03:48:07.191 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-22T03:48:07.254 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-fuse-2:19.3.0-5092.g62da54b4.el9.x86_64 2/2 2024-09-22T03:48:07.322 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-09-22T03:48:07.323 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-09-22T03:48:07.323 INFO:teuthology.orchestra.run.smithi037.stdout: Package Arch Version Repository Size 2024-09-22T03:48:07.323 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-09-22T03:48:07.323 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2024-09-22T03:48:07.323 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-fuse x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 883 k 2024-09-22T03:48:07.323 INFO:teuthology.orchestra.run.smithi037.stdout:Installing dependencies: 2024-09-22T03:48:07.323 INFO:teuthology.orchestra.run.smithi037.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-22T03:48:07.323 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:48:07.323 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2024-09-22T03:48:07.323 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-09-22T03:48:07.323 INFO:teuthology.orchestra.run.smithi037.stdout:Install 2 Packages 2024-09-22T03:48:07.323 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:48:07.324 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 963 k 2024-09-22T03:48:07.324 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 4.1 M 2024-09-22T03:48:07.324 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2024-09-22T03:48:07.743 INFO:teuthology.orchestra.run.smithi037.stdout:(1/2): ceph-fuse-19.3.0-5092.g62da54b4.el9.x86_ 2.3 MB/s | 883 kB 00:00 2024-09-22T03:48:07.926 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-fuse-2:19.3.0-5092.g62da54b4.el9.x86_64 2/2 2024-09-22T03:48:07.926 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-fuse-2:19.3.0-5092.g62da54b4.el9.x86_64 1/2 2024-09-22T03:48:08.018 INFO:teuthology.orchestra.run.smithi037.stdout:(2/2): fuse-2.9.9-16.el9.x86_64.rpm 123 kB/s | 80 kB 00:00 2024-09-22T03:48:08.019 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2024-09-22T03:48:08.019 INFO:teuthology.orchestra.run.smithi037.stdout:Total 1.4 MB/s | 963 kB 00:00 2024-09-22T03:48:08.032 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2024-09-22T03:48:08.058 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2024-09-22T03:48:08.058 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2024-09-22T03:48:08.144 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2024-09-22T03:48:08.145 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2024-09-22T03:48:08.216 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-22T03:48:08.216 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-22T03:48:08.216 INFO:teuthology.orchestra.run.smithi098.stdout:Installed: 2024-09-22T03:48:08.216 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-fuse-2:19.3.0-5092.g62da54b4.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-22T03:48:08.216 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-22T03:48:08.216 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-22T03:48:08.343 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2024-09-22T03:48:08.495 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install ceph-volume 2024-09-22T03:48:08.501 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-22T03:48:08.578 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-fuse-2:19.3.0-5092.g62da54b4.el9.x86_64 2/2 2024-09-22T03:48:09.086 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:02:07 ago on Sun 22 Sep 2024 03:46:02 AM UTC. 2024-09-22T03:48:09.220 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-22T03:48:09.220 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-22T03:48:09.220 INFO:teuthology.orchestra.run.smithi098.stdout: Package Arch Version Repository Size 2024-09-22T03:48:09.221 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-22T03:48:09.221 INFO:teuthology.orchestra.run.smithi098.stdout:Installing: 2024-09-22T03:48:09.221 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-volume noarch 2:19.3.0-5092.g62da54b4.el9 ceph-noarch 285 k 2024-09-22T03:48:09.221 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-22T03:48:09.221 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction Summary 2024-09-22T03:48:09.221 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-22T03:48:09.221 INFO:teuthology.orchestra.run.smithi098.stdout:Install 1 Package 2024-09-22T03:48:09.221 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-22T03:48:09.221 INFO:teuthology.orchestra.run.smithi098.stdout:Total download size: 285 k 2024-09-22T03:48:09.221 INFO:teuthology.orchestra.run.smithi098.stdout:Installed size: 1.3 M 2024-09-22T03:48:09.221 INFO:teuthology.orchestra.run.smithi098.stdout:Downloading Packages: 2024-09-22T03:48:09.324 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-fuse-2:19.3.0-5092.g62da54b4.el9.x86_64 2/2 2024-09-22T03:48:09.324 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-fuse-2:19.3.0-5092.g62da54b4.el9.x86_64 1/2 2024-09-22T03:48:09.453 INFO:teuthology.orchestra.run.smithi098.stdout:ceph-volume-19.3.0-5092.g62da54b4.el9.noarch.rp 1.2 MB/s | 285 kB 00:00 2024-09-22T03:48:09.454 INFO:teuthology.orchestra.run.smithi098.stdout:-------------------------------------------------------------------------------- 2024-09-22T03:48:09.454 INFO:teuthology.orchestra.run.smithi098.stdout:Total 1.2 MB/s | 285 kB 00:00 2024-09-22T03:48:09.454 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction check 2024-09-22T03:48:09.462 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction check succeeded. 2024-09-22T03:48:09.462 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction test 2024-09-22T03:48:09.492 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction test succeeded. 2024-09-22T03:48:09.492 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction 2024-09-22T03:48:09.607 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-22T03:48:09.607 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:48:09.607 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2024-09-22T03:48:09.607 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-fuse-2:19.3.0-5092.g62da54b4.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-22T03:48:09.607 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:48:09.607 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-09-22T03:48:09.730 INFO:teuthology.orchestra.run.smithi098.stdout: Preparing : 1/1 2024-09-22T03:48:09.805 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-volume-2:19.3.0-5092.g62da54b4.el9.noarch 1/1 2024-09-22T03:48:09.820 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-volume-2:19.3.0-5092.g62da54b4.el9.noarch 1/1 2024-09-22T03:48:09.821 INFO:teuthology.orchestra.run.smithi098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T03:48:09.821 INFO:teuthology.orchestra.run.smithi098.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-22T03:48:09.821 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-22T03:48:09.920 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install ceph-volume 2024-09-22T03:48:10.536 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:02:08 ago on Sun 22 Sep 2024 03:46:02 AM UTC. 2024-09-22T03:48:10.675 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-09-22T03:48:10.675 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-09-22T03:48:10.675 INFO:teuthology.orchestra.run.smithi037.stdout: Package Arch Version Repository Size 2024-09-22T03:48:10.675 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-09-22T03:48:10.676 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2024-09-22T03:48:10.676 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-volume noarch 2:19.3.0-5092.g62da54b4.el9 ceph-noarch 285 k 2024-09-22T03:48:10.676 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:48:10.676 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2024-09-22T03:48:10.676 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-09-22T03:48:10.676 INFO:teuthology.orchestra.run.smithi037.stdout:Install 1 Package 2024-09-22T03:48:10.676 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:48:10.676 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 285 k 2024-09-22T03:48:10.677 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 1.3 M 2024-09-22T03:48:10.677 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2024-09-22T03:48:10.838 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-volume-2:19.3.0-5092.g62da54b4.el9.noarch 1/1 2024-09-22T03:48:10.838 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-22T03:48:10.838 INFO:teuthology.orchestra.run.smithi098.stdout:Installed: 2024-09-22T03:48:10.838 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-volume-2:19.3.0-5092.g62da54b4.el9.noarch 2024-09-22T03:48:10.838 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-22T03:48:10.838 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-22T03:48:10.889 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-volume-19.3.0-5092.g62da54b4.el9.noarch.rp 1.3 MB/s | 285 kB 00:00 2024-09-22T03:48:10.890 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2024-09-22T03:48:10.890 INFO:teuthology.orchestra.run.smithi037.stdout:Total 1.3 MB/s | 285 kB 00:00 2024-09-22T03:48:10.890 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2024-09-22T03:48:10.899 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2024-09-22T03:48:10.899 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2024-09-22T03:48:10.934 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2024-09-22T03:48:10.935 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2024-09-22T03:48:11.158 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install librados-devel 2024-09-22T03:48:11.168 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2024-09-22T03:48:11.232 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-volume-2:19.3.0-5092.g62da54b4.el9.noarch 1/1 2024-09-22T03:48:11.250 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-volume-2:19.3.0-5092.g62da54b4.el9.noarch 1/1 2024-09-22T03:48:11.250 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T03:48:11.250 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-22T03:48:11.250 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:48:11.754 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:02:09 ago on Sun 22 Sep 2024 03:46:02 AM UTC. 2024-09-22T03:48:11.889 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-22T03:48:11.889 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-22T03:48:11.889 INFO:teuthology.orchestra.run.smithi098.stdout: Package Arch Version Repo Size 2024-09-22T03:48:11.889 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-22T03:48:11.890 INFO:teuthology.orchestra.run.smithi098.stdout:Installing: 2024-09-22T03:48:11.890 INFO:teuthology.orchestra.run.smithi098.stdout: librados-devel x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 125 k 2024-09-22T03:48:11.890 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-22T03:48:11.890 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction Summary 2024-09-22T03:48:11.890 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-22T03:48:11.890 INFO:teuthology.orchestra.run.smithi098.stdout:Install 1 Package 2024-09-22T03:48:11.890 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-22T03:48:11.890 INFO:teuthology.orchestra.run.smithi098.stdout:Total download size: 125 k 2024-09-22T03:48:11.891 INFO:teuthology.orchestra.run.smithi098.stdout:Installed size: 445 k 2024-09-22T03:48:11.891 INFO:teuthology.orchestra.run.smithi098.stdout:Downloading Packages: 2024-09-22T03:48:12.075 INFO:teuthology.orchestra.run.smithi098.stdout:librados-devel-19.3.0-5092.g62da54b4.el9.x86_64 675 kB/s | 125 kB 00:00 2024-09-22T03:48:12.076 INFO:teuthology.orchestra.run.smithi098.stdout:-------------------------------------------------------------------------------- 2024-09-22T03:48:12.076 INFO:teuthology.orchestra.run.smithi098.stdout:Total 669 kB/s | 125 kB 00:00 2024-09-22T03:48:12.076 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction check 2024-09-22T03:48:12.082 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction check succeeded. 2024-09-22T03:48:12.082 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction test 2024-09-22T03:48:12.147 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction test succeeded. 2024-09-22T03:48:12.148 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction 2024-09-22T03:48:12.302 INFO:teuthology.orchestra.run.smithi098.stdout: Preparing : 1/1 2024-09-22T03:48:12.329 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-volume-2:19.3.0-5092.g62da54b4.el9.noarch 1/1 2024-09-22T03:48:12.329 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:48:12.329 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2024-09-22T03:48:12.329 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-volume-2:19.3.0-5092.g62da54b4.el9.noarch 2024-09-22T03:48:12.329 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:48:12.329 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-09-22T03:48:12.398 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : librados-devel-2:19.3.0-5092.g62da54b4.el9.x86_64 1/1 2024-09-22T03:48:12.650 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install librados-devel 2024-09-22T03:48:12.820 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: librados-devel-2:19.3.0-5092.g62da54b4.el9.x86_64 1/1 2024-09-22T03:48:13.078 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librados-devel-2:19.3.0-5092.g62da54b4.el9.x86_64 1/1 2024-09-22T03:48:13.078 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-22T03:48:13.078 INFO:teuthology.orchestra.run.smithi098.stdout:Installed: 2024-09-22T03:48:13.078 INFO:teuthology.orchestra.run.smithi098.stdout: librados-devel-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-22T03:48:13.078 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-22T03:48:13.078 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-22T03:48:13.264 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:02:11 ago on Sun 22 Sep 2024 03:46:02 AM UTC. 2024-09-22T03:48:13.345 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install libcephfs2 2024-09-22T03:48:13.402 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-09-22T03:48:13.403 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-09-22T03:48:13.403 INFO:teuthology.orchestra.run.smithi037.stdout: Package Arch Version Repo Size 2024-09-22T03:48:13.403 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-09-22T03:48:13.403 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2024-09-22T03:48:13.403 INFO:teuthology.orchestra.run.smithi037.stdout: librados-devel x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 125 k 2024-09-22T03:48:13.403 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:48:13.403 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2024-09-22T03:48:13.403 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-09-22T03:48:13.404 INFO:teuthology.orchestra.run.smithi037.stdout:Install 1 Package 2024-09-22T03:48:13.404 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:48:13.404 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 125 k 2024-09-22T03:48:13.404 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 445 k 2024-09-22T03:48:13.404 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2024-09-22T03:48:13.627 INFO:teuthology.orchestra.run.smithi037.stdout:librados-devel-19.3.0-5092.g62da54b4.el9.x86_64 560 kB/s | 125 kB 00:00 2024-09-22T03:48:13.627 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2024-09-22T03:48:13.628 INFO:teuthology.orchestra.run.smithi037.stdout:Total 556 kB/s | 125 kB 00:00 2024-09-22T03:48:13.628 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2024-09-22T03:48:13.634 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2024-09-22T03:48:13.634 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2024-09-22T03:48:13.701 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2024-09-22T03:48:13.702 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2024-09-22T03:48:13.857 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2024-09-22T03:48:13.939 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:02:11 ago on Sun 22 Sep 2024 03:46:02 AM UTC. 2024-09-22T03:48:13.961 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : librados-devel-2:19.3.0-5092.g62da54b4.el9.x86_64 1/1 2024-09-22T03:48:14.031 INFO:teuthology.orchestra.run.smithi098.stdout:Package libcephfs2-2:19.3.0-5092.g62da54b4.el9.x86_64 is already installed. 2024-09-22T03:48:14.076 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-22T03:48:14.077 INFO:teuthology.orchestra.run.smithi098.stdout:Nothing to do. 2024-09-22T03:48:14.077 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-22T03:48:14.141 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install libcephfs-devel 2024-09-22T03:48:14.382 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librados-devel-2:19.3.0-5092.g62da54b4.el9.x86_64 1/1 2024-09-22T03:48:14.652 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librados-devel-2:19.3.0-5092.g62da54b4.el9.x86_64 1/1 2024-09-22T03:48:14.652 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:48:14.653 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2024-09-22T03:48:14.653 INFO:teuthology.orchestra.run.smithi037.stdout: librados-devel-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-22T03:48:14.653 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:48:14.653 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-09-22T03:48:14.722 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:02:12 ago on Sun 22 Sep 2024 03:46:02 AM UTC. 2024-09-22T03:48:14.856 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-22T03:48:14.857 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-22T03:48:14.857 INFO:teuthology.orchestra.run.smithi098.stdout: Package Arch Version Repo Size 2024-09-22T03:48:14.857 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-22T03:48:14.857 INFO:teuthology.orchestra.run.smithi098.stdout:Installing: 2024-09-22T03:48:14.857 INFO:teuthology.orchestra.run.smithi098.stdout: libcephfs-devel x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 32 k 2024-09-22T03:48:14.857 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-22T03:48:14.857 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction Summary 2024-09-22T03:48:14.857 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-22T03:48:14.858 INFO:teuthology.orchestra.run.smithi098.stdout:Install 1 Package 2024-09-22T03:48:14.858 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-22T03:48:14.858 INFO:teuthology.orchestra.run.smithi098.stdout:Total download size: 32 k 2024-09-22T03:48:14.858 INFO:teuthology.orchestra.run.smithi098.stdout:Installed size: 142 k 2024-09-22T03:48:14.858 INFO:teuthology.orchestra.run.smithi098.stdout:Downloading Packages: 2024-09-22T03:48:14.922 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install libcephfs2 2024-09-22T03:48:15.005 INFO:teuthology.orchestra.run.smithi098.stdout:libcephfs-devel-19.3.0-5092.g62da54b4.el9.x86_6 216 kB/s | 32 kB 00:00 2024-09-22T03:48:15.006 INFO:teuthology.orchestra.run.smithi098.stdout:-------------------------------------------------------------------------------- 2024-09-22T03:48:15.006 INFO:teuthology.orchestra.run.smithi098.stdout:Total 214 kB/s | 32 kB 00:00 2024-09-22T03:48:15.006 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction check 2024-09-22T03:48:15.009 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction check succeeded. 2024-09-22T03:48:15.009 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction test 2024-09-22T03:48:15.031 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction test succeeded. 2024-09-22T03:48:15.031 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction 2024-09-22T03:48:15.124 INFO:teuthology.orchestra.run.smithi098.stdout: Preparing : 1/1 2024-09-22T03:48:15.227 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libcephfs-devel-2:19.3.0-5092.g62da54b4.el9.x86_64 1/1 2024-09-22T03:48:15.540 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:02:13 ago on Sun 22 Sep 2024 03:46:02 AM UTC. 2024-09-22T03:48:15.629 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: libcephfs-devel-2:19.3.0-5092.g62da54b4.el9.x86_64 1/1 2024-09-22T03:48:15.638 INFO:teuthology.orchestra.run.smithi037.stdout:Package libcephfs2-2:19.3.0-5092.g62da54b4.el9.x86_64 is already installed. 2024-09-22T03:48:15.685 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-09-22T03:48:15.686 INFO:teuthology.orchestra.run.smithi037.stdout:Nothing to do. 2024-09-22T03:48:15.686 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-09-22T03:48:15.759 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install libcephfs-devel 2024-09-22T03:48:15.875 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libcephfs-devel-2:19.3.0-5092.g62da54b4.el9.x86_64 1/1 2024-09-22T03:48:15.876 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-22T03:48:15.876 INFO:teuthology.orchestra.run.smithi098.stdout:Installed: 2024-09-22T03:48:15.876 INFO:teuthology.orchestra.run.smithi098.stdout: libcephfs-devel-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-22T03:48:15.876 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-22T03:48:15.876 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-22T03:48:16.063 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install librados2 2024-09-22T03:48:16.370 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:02:14 ago on Sun 22 Sep 2024 03:46:02 AM UTC. 2024-09-22T03:48:16.511 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-09-22T03:48:16.511 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-09-22T03:48:16.511 INFO:teuthology.orchestra.run.smithi037.stdout: Package Arch Version Repo Size 2024-09-22T03:48:16.511 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-09-22T03:48:16.512 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2024-09-22T03:48:16.512 INFO:teuthology.orchestra.run.smithi037.stdout: libcephfs-devel x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 32 k 2024-09-22T03:48:16.512 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:48:16.512 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2024-09-22T03:48:16.512 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-09-22T03:48:16.512 INFO:teuthology.orchestra.run.smithi037.stdout:Install 1 Package 2024-09-22T03:48:16.512 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:48:16.512 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 32 k 2024-09-22T03:48:16.512 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 142 k 2024-09-22T03:48:16.513 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2024-09-22T03:48:16.637 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:02:14 ago on Sun 22 Sep 2024 03:46:02 AM UTC. 2024-09-22T03:48:16.664 INFO:teuthology.orchestra.run.smithi037.stdout:libcephfs-devel-19.3.0-5092.g62da54b4.el9.x86_6 210 kB/s | 32 kB 00:00 2024-09-22T03:48:16.664 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2024-09-22T03:48:16.665 INFO:teuthology.orchestra.run.smithi037.stdout:Total 208 kB/s | 32 kB 00:00 2024-09-22T03:48:16.665 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2024-09-22T03:48:16.668 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2024-09-22T03:48:16.669 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2024-09-22T03:48:16.690 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2024-09-22T03:48:16.691 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2024-09-22T03:48:16.725 INFO:teuthology.orchestra.run.smithi098.stdout:Package librados2-2:19.3.0-5092.g62da54b4.el9.x86_64 is already installed. 2024-09-22T03:48:16.769 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-22T03:48:16.770 INFO:teuthology.orchestra.run.smithi098.stdout:Nothing to do. 2024-09-22T03:48:16.770 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-22T03:48:16.785 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2024-09-22T03:48:16.872 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install librbd1 2024-09-22T03:48:16.915 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libcephfs-devel-2:19.3.0-5092.g62da54b4.el9.x86_64 1/1 2024-09-22T03:48:17.332 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libcephfs-devel-2:19.3.0-5092.g62da54b4.el9.x86_64 1/1 2024-09-22T03:48:17.456 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:02:15 ago on Sun 22 Sep 2024 03:46:02 AM UTC. 2024-09-22T03:48:17.544 INFO:teuthology.orchestra.run.smithi098.stdout:Package librbd1-2:19.3.0-5092.g62da54b4.el9.x86_64 is already installed. 2024-09-22T03:48:17.568 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libcephfs-devel-2:19.3.0-5092.g62da54b4.el9.x86_64 1/1 2024-09-22T03:48:17.568 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:48:17.568 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2024-09-22T03:48:17.568 INFO:teuthology.orchestra.run.smithi037.stdout: libcephfs-devel-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-22T03:48:17.568 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:48:17.568 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-09-22T03:48:17.588 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-22T03:48:17.589 INFO:teuthology.orchestra.run.smithi098.stdout:Nothing to do. 2024-09-22T03:48:17.589 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-22T03:48:17.658 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install python3-rados 2024-09-22T03:48:17.745 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install librados2 2024-09-22T03:48:18.231 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:02:16 ago on Sun 22 Sep 2024 03:46:02 AM UTC. 2024-09-22T03:48:18.320 INFO:teuthology.orchestra.run.smithi098.stdout:Package python3-rados-2:19.3.0-5092.g62da54b4.el9.x86_64 is already installed. 2024-09-22T03:48:18.350 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:02:16 ago on Sun 22 Sep 2024 03:46:02 AM UTC. 2024-09-22T03:48:18.364 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-22T03:48:18.365 INFO:teuthology.orchestra.run.smithi098.stdout:Nothing to do. 2024-09-22T03:48:18.366 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-22T03:48:18.441 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install python3-rgw 2024-09-22T03:48:18.441 INFO:teuthology.orchestra.run.smithi037.stdout:Package librados2-2:19.3.0-5092.g62da54b4.el9.x86_64 is already installed. 2024-09-22T03:48:18.487 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-09-22T03:48:18.488 INFO:teuthology.orchestra.run.smithi037.stdout:Nothing to do. 2024-09-22T03:48:18.488 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-09-22T03:48:18.561 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install librbd1 2024-09-22T03:48:19.020 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:02:17 ago on Sun 22 Sep 2024 03:46:02 AM UTC. 2024-09-22T03:48:19.109 INFO:teuthology.orchestra.run.smithi098.stdout:Package python3-rgw-2:19.3.0-5092.g62da54b4.el9.x86_64 is already installed. 2024-09-22T03:48:19.153 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-22T03:48:19.154 INFO:teuthology.orchestra.run.smithi098.stdout:Nothing to do. 2024-09-22T03:48:19.154 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-22T03:48:19.166 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:02:17 ago on Sun 22 Sep 2024 03:46:02 AM UTC. 2024-09-22T03:48:19.223 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install python3-cephfs 2024-09-22T03:48:19.258 INFO:teuthology.orchestra.run.smithi037.stdout:Package librbd1-2:19.3.0-5092.g62da54b4.el9.x86_64 is already installed. 2024-09-22T03:48:19.304 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-09-22T03:48:19.305 INFO:teuthology.orchestra.run.smithi037.stdout:Nothing to do. 2024-09-22T03:48:19.306 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-09-22T03:48:19.378 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install python3-rados 2024-09-22T03:48:19.800 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:02:17 ago on Sun 22 Sep 2024 03:46:02 AM UTC. 2024-09-22T03:48:19.889 INFO:teuthology.orchestra.run.smithi098.stdout:Package python3-cephfs-2:19.3.0-5092.g62da54b4.el9.x86_64 is already installed. 2024-09-22T03:48:19.932 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-22T03:48:19.933 INFO:teuthology.orchestra.run.smithi098.stdout:Nothing to do. 2024-09-22T03:48:19.933 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-22T03:48:19.985 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:02:17 ago on Sun 22 Sep 2024 03:46:02 AM UTC. 2024-09-22T03:48:19.998 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install python3-rbd 2024-09-22T03:48:20.078 INFO:teuthology.orchestra.run.smithi037.stdout:Package python3-rados-2:19.3.0-5092.g62da54b4.el9.x86_64 is already installed. 2024-09-22T03:48:20.124 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-09-22T03:48:20.125 INFO:teuthology.orchestra.run.smithi037.stdout:Nothing to do. 2024-09-22T03:48:20.125 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-09-22T03:48:20.195 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install python3-rgw 2024-09-22T03:48:20.571 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:02:18 ago on Sun 22 Sep 2024 03:46:02 AM UTC. 2024-09-22T03:48:20.659 INFO:teuthology.orchestra.run.smithi098.stdout:Package python3-rbd-2:19.3.0-5092.g62da54b4.el9.x86_64 is already installed. 2024-09-22T03:48:20.702 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-22T03:48:20.703 INFO:teuthology.orchestra.run.smithi098.stdout:Nothing to do. 2024-09-22T03:48:20.703 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-22T03:48:20.775 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install rbd-fuse 2024-09-22T03:48:20.796 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:02:18 ago on Sun 22 Sep 2024 03:46:02 AM UTC. 2024-09-22T03:48:20.887 INFO:teuthology.orchestra.run.smithi037.stdout:Package python3-rgw-2:19.3.0-5092.g62da54b4.el9.x86_64 is already installed. 2024-09-22T03:48:20.934 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-09-22T03:48:20.935 INFO:teuthology.orchestra.run.smithi037.stdout:Nothing to do. 2024-09-22T03:48:20.935 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-09-22T03:48:21.007 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install python3-cephfs 2024-09-22T03:48:21.359 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:02:19 ago on Sun 22 Sep 2024 03:46:02 AM UTC. 2024-09-22T03:48:21.492 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-22T03:48:21.493 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-22T03:48:21.493 INFO:teuthology.orchestra.run.smithi098.stdout: Package Architecture Version Repository Size 2024-09-22T03:48:21.493 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-22T03:48:21.493 INFO:teuthology.orchestra.run.smithi098.stdout:Installing: 2024-09-22T03:48:21.493 INFO:teuthology.orchestra.run.smithi098.stdout: rbd-fuse x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 91 k 2024-09-22T03:48:21.493 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-22T03:48:21.494 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction Summary 2024-09-22T03:48:21.494 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-22T03:48:21.494 INFO:teuthology.orchestra.run.smithi098.stdout:Install 1 Package 2024-09-22T03:48:21.494 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-22T03:48:21.494 INFO:teuthology.orchestra.run.smithi098.stdout:Total download size: 91 k 2024-09-22T03:48:21.495 INFO:teuthology.orchestra.run.smithi098.stdout:Installed size: 321 k 2024-09-22T03:48:21.495 INFO:teuthology.orchestra.run.smithi098.stdout:Downloading Packages: 2024-09-22T03:48:21.611 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:02:19 ago on Sun 22 Sep 2024 03:46:02 AM UTC. 2024-09-22T03:48:21.692 INFO:teuthology.orchestra.run.smithi098.stdout:rbd-fuse-19.3.0-5092.g62da54b4.el9.x86_64.rpm 461 kB/s | 91 kB 00:00 2024-09-22T03:48:21.692 INFO:teuthology.orchestra.run.smithi098.stdout:-------------------------------------------------------------------------------- 2024-09-22T03:48:21.692 INFO:teuthology.orchestra.run.smithi098.stdout:Total 458 kB/s | 91 kB 00:00 2024-09-22T03:48:21.693 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction check 2024-09-22T03:48:21.701 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction check succeeded. 2024-09-22T03:48:21.701 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction test 2024-09-22T03:48:21.702 INFO:teuthology.orchestra.run.smithi037.stdout:Package python3-cephfs-2:19.3.0-5092.g62da54b4.el9.x86_64 is already installed. 2024-09-22T03:48:21.748 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-09-22T03:48:21.749 INFO:teuthology.orchestra.run.smithi037.stdout:Nothing to do. 2024-09-22T03:48:21.750 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-09-22T03:48:21.764 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction test succeeded. 2024-09-22T03:48:21.765 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction 2024-09-22T03:48:21.823 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install python3-rbd 2024-09-22T03:48:21.912 INFO:teuthology.orchestra.run.smithi098.stdout: Preparing : 1/1 2024-09-22T03:48:22.031 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : rbd-fuse-2:19.3.0-5092.g62da54b4.el9.x86_64 1/1 2024-09-22T03:48:22.409 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: rbd-fuse-2:19.3.0-5092.g62da54b4.el9.x86_64 1/1 2024-09-22T03:48:22.424 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:02:20 ago on Sun 22 Sep 2024 03:46:02 AM UTC. 2024-09-22T03:48:22.515 INFO:teuthology.orchestra.run.smithi037.stdout:Package python3-rbd-2:19.3.0-5092.g62da54b4.el9.x86_64 is already installed. 2024-09-22T03:48:22.562 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-09-22T03:48:22.563 INFO:teuthology.orchestra.run.smithi037.stdout:Nothing to do. 2024-09-22T03:48:22.563 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-09-22T03:48:22.628 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install rbd-fuse 2024-09-22T03:48:22.660 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : rbd-fuse-2:19.3.0-5092.g62da54b4.el9.x86_64 1/1 2024-09-22T03:48:22.660 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-22T03:48:22.661 INFO:teuthology.orchestra.run.smithi098.stdout:Installed: 2024-09-22T03:48:22.661 INFO:teuthology.orchestra.run.smithi098.stdout: rbd-fuse-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-22T03:48:22.661 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-22T03:48:22.661 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-22T03:48:22.911 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install rbd-mirror 2024-09-22T03:48:23.236 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:02:21 ago on Sun 22 Sep 2024 03:46:02 AM UTC. 2024-09-22T03:48:23.375 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-09-22T03:48:23.375 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-09-22T03:48:23.375 INFO:teuthology.orchestra.run.smithi037.stdout: Package Architecture Version Repository Size 2024-09-22T03:48:23.375 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-09-22T03:48:23.375 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2024-09-22T03:48:23.375 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-fuse x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 91 k 2024-09-22T03:48:23.375 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:48:23.376 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2024-09-22T03:48:23.376 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-09-22T03:48:23.376 INFO:teuthology.orchestra.run.smithi037.stdout:Install 1 Package 2024-09-22T03:48:23.376 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:48:23.376 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 91 k 2024-09-22T03:48:23.376 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 321 k 2024-09-22T03:48:23.376 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2024-09-22T03:48:23.504 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:02:21 ago on Sun 22 Sep 2024 03:46:02 AM UTC. 2024-09-22T03:48:23.575 INFO:teuthology.orchestra.run.smithi037.stdout:rbd-fuse-19.3.0-5092.g62da54b4.el9.x86_64.rpm 458 kB/s | 91 kB 00:00 2024-09-22T03:48:23.576 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2024-09-22T03:48:23.576 INFO:teuthology.orchestra.run.smithi037.stdout:Total 454 kB/s | 91 kB 00:00 2024-09-22T03:48:23.576 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2024-09-22T03:48:23.586 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2024-09-22T03:48:23.586 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2024-09-22T03:48:23.642 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-22T03:48:23.643 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-22T03:48:23.643 INFO:teuthology.orchestra.run.smithi098.stdout: Package Arch Version Repo Size 2024-09-22T03:48:23.643 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-22T03:48:23.643 INFO:teuthology.orchestra.run.smithi098.stdout:Installing: 2024-09-22T03:48:23.643 INFO:teuthology.orchestra.run.smithi098.stdout: rbd-mirror x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 3.5 M 2024-09-22T03:48:23.643 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-22T03:48:23.643 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction Summary 2024-09-22T03:48:23.643 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-22T03:48:23.643 INFO:teuthology.orchestra.run.smithi098.stdout:Install 1 Package 2024-09-22T03:48:23.644 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-22T03:48:23.644 INFO:teuthology.orchestra.run.smithi098.stdout:Total download size: 3.5 M 2024-09-22T03:48:23.644 INFO:teuthology.orchestra.run.smithi098.stdout:Installed size: 30 M 2024-09-22T03:48:23.644 INFO:teuthology.orchestra.run.smithi098.stdout:Downloading Packages: 2024-09-22T03:48:23.654 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2024-09-22T03:48:23.654 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2024-09-22T03:48:23.811 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2024-09-22T03:48:23.919 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : rbd-fuse-2:19.3.0-5092.g62da54b4.el9.x86_64 1/1 2024-09-22T03:48:23.995 INFO:teuthology.orchestra.run.smithi098.stdout:rbd-mirror-19.3.0-5092.g62da54b4.el9.x86_64.rpm 10 MB/s | 3.5 MB 00:00 2024-09-22T03:48:23.995 INFO:teuthology.orchestra.run.smithi098.stdout:-------------------------------------------------------------------------------- 2024-09-22T03:48:23.996 INFO:teuthology.orchestra.run.smithi098.stdout:Total 10 MB/s | 3.5 MB 00:00 2024-09-22T03:48:23.996 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction check 2024-09-22T03:48:24.007 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction check succeeded. 2024-09-22T03:48:24.007 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction test 2024-09-22T03:48:24.091 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction test succeeded. 2024-09-22T03:48:24.091 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction 2024-09-22T03:48:24.340 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: rbd-fuse-2:19.3.0-5092.g62da54b4.el9.x86_64 1/1 2024-09-22T03:48:24.610 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : rbd-fuse-2:19.3.0-5092.g62da54b4.el9.x86_64 1/1 2024-09-22T03:48:24.610 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:48:24.610 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2024-09-22T03:48:24.610 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-fuse-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-22T03:48:24.611 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:48:24.611 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-09-22T03:48:24.675 INFO:teuthology.orchestra.run.smithi098.stdout: Preparing : 1/1 2024-09-22T03:48:24.729 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : rbd-mirror-2:19.3.0-5092.g62da54b4.el9.x86_64 1/1 2024-09-22T03:48:24.753 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: rbd-mirror-2:19.3.0-5092.g62da54b4.el9.x86_64 1/1 2024-09-22T03:48:24.753 INFO:teuthology.orchestra.run.smithi098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T03:48:24.753 INFO:teuthology.orchestra.run.smithi098.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-22T03:48:24.753 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-22T03:48:24.753 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-22T03:48:24.753 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-22T03:48:24.906 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install rbd-mirror 2024-09-22T03:48:25.517 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:02:23 ago on Sun 22 Sep 2024 03:46:02 AM UTC. 2024-09-22T03:48:25.657 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-09-22T03:48:25.658 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-09-22T03:48:25.658 INFO:teuthology.orchestra.run.smithi037.stdout: Package Arch Version Repo Size 2024-09-22T03:48:25.658 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-09-22T03:48:25.658 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2024-09-22T03:48:25.658 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-mirror x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 3.5 M 2024-09-22T03:48:25.658 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:48:25.658 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2024-09-22T03:48:25.659 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-09-22T03:48:25.659 INFO:teuthology.orchestra.run.smithi037.stdout:Install 1 Package 2024-09-22T03:48:25.659 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:48:25.659 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 3.5 M 2024-09-22T03:48:25.659 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 30 M 2024-09-22T03:48:25.659 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2024-09-22T03:48:25.979 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : rbd-mirror-2:19.3.0-5092.g62da54b4.el9.x86_64 1/1 2024-09-22T03:48:25.979 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-22T03:48:25.979 INFO:teuthology.orchestra.run.smithi098.stdout:Installed: 2024-09-22T03:48:25.980 INFO:teuthology.orchestra.run.smithi098.stdout: rbd-mirror-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-22T03:48:25.980 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-22T03:48:25.980 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-22T03:48:26.028 INFO:teuthology.orchestra.run.smithi037.stdout:rbd-mirror-19.3.0-5092.g62da54b4.el9.x86_64.rpm 9.5 MB/s | 3.5 MB 00:00 2024-09-22T03:48:26.029 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2024-09-22T03:48:26.029 INFO:teuthology.orchestra.run.smithi037.stdout:Total 9.5 MB/s | 3.5 MB 00:00 2024-09-22T03:48:26.029 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2024-09-22T03:48:26.042 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2024-09-22T03:48:26.042 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2024-09-22T03:48:26.130 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2024-09-22T03:48:26.131 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2024-09-22T03:48:26.215 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install rbd-nbd 2024-09-22T03:48:26.750 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2024-09-22T03:48:26.804 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : rbd-mirror-2:19.3.0-5092.g62da54b4.el9.x86_64 1/1 2024-09-22T03:48:26.807 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:02:24 ago on Sun 22 Sep 2024 03:46:02 AM UTC. 2024-09-22T03:48:26.831 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: rbd-mirror-2:19.3.0-5092.g62da54b4.el9.x86_64 1/1 2024-09-22T03:48:26.831 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T03:48:26.831 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-22T03:48:26.831 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-22T03:48:26.831 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-22T03:48:26.831 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:48:26.940 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-22T03:48:26.941 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-22T03:48:26.941 INFO:teuthology.orchestra.run.smithi098.stdout: Package Architecture Version Repository Size 2024-09-22T03:48:26.941 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-22T03:48:26.941 INFO:teuthology.orchestra.run.smithi098.stdout:Installing: 2024-09-22T03:48:26.941 INFO:teuthology.orchestra.run.smithi098.stdout: rbd-nbd x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 176 k 2024-09-22T03:48:26.941 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-22T03:48:26.941 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction Summary 2024-09-22T03:48:26.941 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-22T03:48:26.941 INFO:teuthology.orchestra.run.smithi098.stdout:Install 1 Package 2024-09-22T03:48:26.941 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-22T03:48:26.942 INFO:teuthology.orchestra.run.smithi098.stdout:Total download size: 176 k 2024-09-22T03:48:26.942 INFO:teuthology.orchestra.run.smithi098.stdout:Installed size: 685 k 2024-09-22T03:48:26.942 INFO:teuthology.orchestra.run.smithi098.stdout:Downloading Packages: 2024-09-22T03:48:27.157 INFO:teuthology.orchestra.run.smithi098.stdout:rbd-nbd-19.3.0-5092.g62da54b4.el9.x86_64.rpm 819 kB/s | 176 kB 00:00 2024-09-22T03:48:27.158 INFO:teuthology.orchestra.run.smithi098.stdout:-------------------------------------------------------------------------------- 2024-09-22T03:48:27.158 INFO:teuthology.orchestra.run.smithi098.stdout:Total 813 kB/s | 176 kB 00:00 2024-09-22T03:48:27.159 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction check 2024-09-22T03:48:27.168 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction check succeeded. 2024-09-22T03:48:27.168 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction test 2024-09-22T03:48:27.232 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction test succeeded. 2024-09-22T03:48:27.232 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction 2024-09-22T03:48:27.388 INFO:teuthology.orchestra.run.smithi098.stdout: Preparing : 1/1 2024-09-22T03:48:27.497 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : rbd-nbd-2:19.3.0-5092.g62da54b4.el9.x86_64 1/1 2024-09-22T03:48:28.007 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: rbd-nbd-2:19.3.0-5092.g62da54b4.el9.x86_64 1/1 2024-09-22T03:48:28.201 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : rbd-mirror-2:19.3.0-5092.g62da54b4.el9.x86_64 1/1 2024-09-22T03:48:28.201 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:48:28.201 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2024-09-22T03:48:28.201 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-mirror-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-22T03:48:28.201 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:48:28.201 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-09-22T03:48:28.290 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : rbd-nbd-2:19.3.0-5092.g62da54b4.el9.x86_64 1/1 2024-09-22T03:48:28.290 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-22T03:48:28.290 INFO:teuthology.orchestra.run.smithi098.stdout:Installed: 2024-09-22T03:48:28.290 INFO:teuthology.orchestra.run.smithi098.stdout: rbd-nbd-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-22T03:48:28.290 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-22T03:48:28.290 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-22T03:48:28.441 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install rbd-nbd 2024-09-22T03:48:28.567 DEBUG:teuthology.parallel:result is None 2024-09-22T03:48:29.050 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:02:27 ago on Sun 22 Sep 2024 03:46:02 AM UTC. 2024-09-22T03:48:29.188 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-09-22T03:48:29.188 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-09-22T03:48:29.188 INFO:teuthology.orchestra.run.smithi037.stdout: Package Architecture Version Repository Size 2024-09-22T03:48:29.188 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-09-22T03:48:29.188 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2024-09-22T03:48:29.188 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-nbd x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 176 k 2024-09-22T03:48:29.188 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:48:29.189 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2024-09-22T03:48:29.189 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-09-22T03:48:29.189 INFO:teuthology.orchestra.run.smithi037.stdout:Install 1 Package 2024-09-22T03:48:29.189 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:48:29.189 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 176 k 2024-09-22T03:48:29.189 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 685 k 2024-09-22T03:48:29.189 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2024-09-22T03:48:29.423 INFO:teuthology.orchestra.run.smithi037.stdout:rbd-nbd-19.3.0-5092.g62da54b4.el9.x86_64.rpm 757 kB/s | 176 kB 00:00 2024-09-22T03:48:29.423 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2024-09-22T03:48:29.424 INFO:teuthology.orchestra.run.smithi037.stdout:Total 751 kB/s | 176 kB 00:00 2024-09-22T03:48:29.424 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2024-09-22T03:48:29.435 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2024-09-22T03:48:29.435 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2024-09-22T03:48:29.503 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2024-09-22T03:48:29.504 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2024-09-22T03:48:29.671 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2024-09-22T03:48:29.773 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : rbd-nbd-2:19.3.0-5092.g62da54b4.el9.x86_64 1/1 2024-09-22T03:48:30.233 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: rbd-nbd-2:19.3.0-5092.g62da54b4.el9.x86_64 1/1 2024-09-22T03:48:30.501 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : rbd-nbd-2:19.3.0-5092.g62da54b4.el9.x86_64 1/1 2024-09-22T03:48:30.501 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:48:30.501 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2024-09-22T03:48:30.501 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-nbd-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-22T03:48:30.501 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:48:30.501 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-09-22T03:48:30.786 DEBUG:teuthology.parallel:result is None 2024-09-22T03:48:30.786 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=62da54b4b83a96ca9976b7e1d0c8272a564a2208 2024-09-22T03:48:30.927 DEBUG:teuthology.orchestra.run.smithi037:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-22T03:48:30.950 INFO:teuthology.orchestra.run.smithi037.stdout:19.3.0-5092.g62da54b4.el9 2024-09-22T03:48:30.951 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5092.g62da54b4.el9 2024-09-22T03:48:30.951 INFO:teuthology.task.install:The correct ceph version 19.3.0-5092.g62da54b4 is installed. 2024-09-22T03:48:30.953 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=62da54b4b83a96ca9976b7e1d0c8272a564a2208 2024-09-22T03:48:31.095 DEBUG:teuthology.orchestra.run.smithi098:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-22T03:48:31.122 INFO:teuthology.orchestra.run.smithi098.stdout:19.3.0-5092.g62da54b4.el9 2024-09-22T03:48:31.123 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5092.g62da54b4.el9 2024-09-22T03:48:31.123 INFO:teuthology.task.install:The correct ceph version 19.3.0-5092.g62da54b4 is installed. 2024-09-22T03:48:31.125 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-22T03:48:31.125 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-22T03:48:31.125 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-22T03:48:31.153 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-22T03:48:31.153 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-22T03:48:31.193 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-22T03:48:31.193 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-22T03:48:31.193 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/usr/bin/daemon-helper 2024-09-22T03:48:31.220 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-22T03:48:31.287 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-22T03:48:31.287 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/usr/bin/daemon-helper 2024-09-22T03:48:31.315 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-22T03:48:31.382 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-22T03:48:31.382 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-22T03:48:31.382 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-22T03:48:31.408 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-22T03:48:31.474 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-22T03:48:31.474 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-22T03:48:31.501 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-22T03:48:31.568 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-22T03:48:31.569 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-22T03:48:31.569 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/usr/bin/stdin-killer 2024-09-22T03:48:31.594 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-22T03:48:31.661 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-22T03:48:31.661 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/usr/bin/stdin-killer 2024-09-22T03:48:31.687 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-22T03:48:31.753 INFO:teuthology.run_tasks:Running task ceph... 2024-09-22T03:48:31.835 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-22T03:48:31.835 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 777 /var/log/ceph 2024-09-22T03:48:31.837 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod 777 /var/log/ceph 2024-09-22T03:48:31.861 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-22T03:48:31.861 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-22T03:48:31.903 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-22T03:48:31.928 INFO:tasks.ceph:Creating extra log directories... 2024-09-22T03:48:31.928 DEBUG:teuthology.orchestra.run.smithi037:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-22T03:48:31.969 DEBUG:teuthology.orchestra.run.smithi098:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-22T03:48:32.003 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-22T03:48:32.003 INFO:tasks.ceph:config {'conf': {'osd': {'debug monc': 20, 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore rocksdb cf': False, 'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'err to stderr': True, 'log flush on exit': True, 'log to file': False, 'log to stderr': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.3, 'osd delete sleep': 1, 'osd failsafe full ratio': 0.95, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd snap trim sleep': 2}, 'client.0': {'debug ms': 1, 'debug objecter': 20, 'debug rados': 20}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc', 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 3}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'osd pool default crimson': True, 'paxos service trim min': 10}, 'osd.0': {'crimson seastar cpu cores': '0-2'}, 'osd.1': {'crimson seastar cpu cores': '3-5'}, 'osd.2': {'crimson seastar cpu cores': '0-2'}, 'osd.3': {'crimson seastar cpu cores': '3-5'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-22T03:48:32.003 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-09-21_20:56:02-crimson-rados-main-distro-crimson-smithi/7914381', 'branch': 'main', 'description': 'crimson-rados/thrash_simple/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore thrashers/simple thrashosds-health workloads/radosbench}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7914381', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'teuthology-2024-09-21_20:56:02-crimson-rados-main-distro-crimson-smithi', 'no_nested_subset': False, 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'main'}, 'ceph': {'conf': {'client.0': {'debug ms': 1, 'debug objecter': 20, 'debug rados': 20}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc', 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 3}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'osd pool default crimson': True, 'paxos service trim min': 10}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore rocksdb cf': False, 'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'err to stderr': True, 'log flush on exit': True, 'log to file': False, 'log to stderr': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.3, 'osd delete sleep': 1, 'osd failsafe full ratio': 0.95, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd snap trim sleep': 2}, 'osd.0': {'crimson seastar cpu cores': '0-2'}, 'osd.1': {'crimson seastar cpu cores': '3-5'}, 'osd.2': {'crimson seastar cpu cores': '0-2'}, 'osd.3': {'crimson seastar cpu cores': '3-5'}}, 'flavor': 'crimson', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'sha1': '62da54b4b83a96ca9976b7e1d0c8272a564a2208'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'crimson', 'sha1': '62da54b4b83a96ca9976b7e1d0c8272a564a2208'}}, 'thrashosds': {'min_in': 4}, 'workunit': {'branch': 'main', 'env': {'CRIMSON_COMPAT': '1'}, 'sha1': '62da54b4b83a96ca9976b7e1d0c8272a564a2208'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 101, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'osd.0', 'osd.1', 'client.0', 'node-exporter.a'], ['mgr.x', 'osd.2', 'osd.3', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 2950, 'sha1': '62da54b4b83a96ca9976b7e1d0c8272a564a2208', 'sleep_before_teardown': 0, 'subset': '0/1', 'suite': 'crimson-rados', 'suite_branch': 'main', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_62da54b4b83a96ca9976b7e1d0c8272a564a2208/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': '62da54b4b83a96ca9976b7e1d0c8272a564a2208', 'targets': {'smithi037.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC1Suj3tpSL6tNWBBvV4xEUtk4NqLjmnfN9L1rz8pr2+Kf+O4QQVbT2Pb1ZJl/k770ZjvRSI75x+rfPAF2Bn7fw=', 'smithi098.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBI/gqTqAsK8EhVyWFtGDRZYFDH35ajID2WfpTMs5fA9Sm6zJ8pX7Z0lbZizgkhsh0EfvEsoobBxjcAKdPKjO/yY='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'osd': {'debug monc': 20, 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore rocksdb cf': False, 'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'err to stderr': True, 'log flush on exit': True, 'log to file': False, 'log to stderr': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.3, 'osd delete sleep': 1, 'osd failsafe full ratio': 0.95, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd snap trim sleep': 2}, 'client.0': {'debug ms': 1, 'debug objecter': 20, 'debug rados': 20}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc', 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 3}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'osd pool default crimson': True, 'paxos service trim min': 10}, 'osd.0': {'crimson seastar cpu cores': '0-2'}, 'osd.1': {'crimson seastar cpu cores': '3-5'}, 'osd.2': {'crimson seastar cpu cores': '0-2'}, 'osd.3': {'crimson seastar cpu cores': '3-5'}}, 'flavor': 'crimson', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'sha1': '62da54b4b83a96ca9976b7e1d0c8272a564a2208', 'cluster': 'ceph'}}, {'thrashosds': {'ceph_objectstore_tool': False, 'chance_down': 0, 'chance_inject_pause_short': 0, 'chance_reset_purged_snaps_last': 0, 'chance_thrash_cluster_full': 0, 'chance_thrash_pg_upmap': 0, 'dump_ops_enable': False, 'min_in': 3, 'noscrub_toggle_delay': 0, 'reweight_osd': 0, 'sighup_delay': 0, 'thrash_primary_affinity': False, 'timeout': 2400}}, {'full_sequential': [{'radosbench': {'clients': ['client.0'], 'time': 90}}, {'radosbench': {'clients': ['client.0'], 'time': 90}}, {'radosbench': {'clients': ['client.0'], 'time': 90}}, {'radosbench': {'clients': ['client.0'], 'time': 90}}, {'radosbench': {'clients': ['client.0'], 'time': 90}}]}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-21_20:56:02', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2902'} 2024-09-22T03:48:32.004 DEBUG:teuthology.orchestra.run.smithi037:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-22T03:48:32.035 DEBUG:teuthology.orchestra.run.smithi098:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-22T03:48:32.051 DEBUG:teuthology.orchestra.run.smithi037:> sudo install -d -m0777 -- /var/run/ceph 2024-09-22T03:48:32.091 DEBUG:teuthology.orchestra.run.smithi098:> sudo install -d -m0777 -- /var/run/ceph 2024-09-22T03:48:32.116 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-22T03:48:32.116 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/scratch_devs of=/dev/stdout 2024-09-22T03:48:32.171 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-22T03:48:32.171 DEBUG:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_1 2024-09-22T03:48:32.227 INFO:teuthology.orchestra.run.smithi037.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-22T03:48:32.227 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-22T03:48:32.227 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-22T03:48:32.227 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-22T03:48:32.227 INFO:teuthology.orchestra.run.smithi037.stdout:Context: system_u:object_r:device_t:s0 2024-09-22T03:48:32.227 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2024-09-22 03:48:27.111258632 +0000 2024-09-22T03:48:32.227 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2024-09-22 03:45:23.633978707 +0000 2024-09-22T03:48:32.228 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2024-09-22 03:45:23.633978707 +0000 2024-09-22T03:48:32.228 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: 2024-09-22 03:45:23.633978707 +0000 2024-09-22T03:48:32.228 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-22T03:48:32.291 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2024-09-22T03:48:32.291 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2024-09-22T03:48:32.291 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes copied, 0.000189047 s, 2.7 MB/s 2024-09-22T03:48:32.292 DEBUG:teuthology.orchestra.run.smithi037:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-22T03:48:32.348 DEBUG:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_2 2024-09-22T03:48:32.404 INFO:teuthology.orchestra.run.smithi037.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-22T03:48:32.404 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-22T03:48:32.404 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-22T03:48:32.404 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-22T03:48:32.405 INFO:teuthology.orchestra.run.smithi037.stdout:Context: system_u:object_r:device_t:s0 2024-09-22T03:48:32.405 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2024-09-22 03:48:27.112258619 +0000 2024-09-22T03:48:32.405 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2024-09-22 03:45:23.966974327 +0000 2024-09-22T03:48:32.405 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2024-09-22 03:45:23.966974327 +0000 2024-09-22T03:48:32.405 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: 2024-09-22 03:45:23.966974327 +0000 2024-09-22T03:48:32.405 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-22T03:48:32.469 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2024-09-22T03:48:32.469 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2024-09-22T03:48:32.469 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes copied, 0.000205676 s, 2.5 MB/s 2024-09-22T03:48:32.470 DEBUG:teuthology.orchestra.run.smithi037:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-22T03:48:32.527 DEBUG:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_3 2024-09-22T03:48:32.583 INFO:teuthology.orchestra.run.smithi037.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-22T03:48:32.583 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-22T03:48:32.584 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-09-22T03:48:32.584 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-22T03:48:32.584 INFO:teuthology.orchestra.run.smithi037.stdout:Context: system_u:object_r:device_t:s0 2024-09-22T03:48:32.584 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2024-09-22 03:48:27.112258619 +0000 2024-09-22T03:48:32.584 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2024-09-22 03:45:24.294970012 +0000 2024-09-22T03:48:32.584 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2024-09-22 03:45:24.294970012 +0000 2024-09-22T03:48:32.584 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: 2024-09-22 03:45:24.294970012 +0000 2024-09-22T03:48:32.584 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-22T03:48:32.648 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2024-09-22T03:48:32.648 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2024-09-22T03:48:32.648 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes copied, 0.000189991 s, 2.7 MB/s 2024-09-22T03:48:32.649 DEBUG:teuthology.orchestra.run.smithi037:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-22T03:48:32.707 DEBUG:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_4 2024-09-22T03:48:32.762 INFO:teuthology.orchestra.run.smithi037.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-22T03:48:32.763 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-22T03:48:32.763 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-22T03:48:32.763 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-22T03:48:32.763 INFO:teuthology.orchestra.run.smithi037.stdout:Context: system_u:object_r:device_t:s0 2024-09-22T03:48:32.763 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2024-09-22 03:48:27.112258619 +0000 2024-09-22T03:48:32.763 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2024-09-22 03:45:24.634965540 +0000 2024-09-22T03:48:32.763 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2024-09-22 03:45:24.634965540 +0000 2024-09-22T03:48:32.763 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: 2024-09-22 03:45:24.634965540 +0000 2024-09-22T03:48:32.763 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-22T03:48:32.826 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2024-09-22T03:48:32.827 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2024-09-22T03:48:32.827 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes copied, 0.000225997 s, 2.3 MB/s 2024-09-22T03:48:32.828 DEBUG:teuthology.orchestra.run.smithi037:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-22T03:48:32.884 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2024-09-22T03:48:32.884 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-22T03:48:32.885 DEBUG:teuthology.orchestra.run.smithi098:> dd if=/scratch_devs of=/dev/stdout 2024-09-22T03:48:32.902 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-22T03:48:32.903 DEBUG:teuthology.orchestra.run.smithi098:> stat /dev/vg_nvme/lv_1 2024-09-22T03:48:32.959 INFO:teuthology.orchestra.run.smithi098.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-22T03:48:32.960 INFO:teuthology.orchestra.run.smithi098.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-22T03:48:32.960 INFO:teuthology.orchestra.run.smithi098.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-09-22T03:48:32.960 INFO:teuthology.orchestra.run.smithi098.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-22T03:48:32.960 INFO:teuthology.orchestra.run.smithi098.stdout:Context: system_u:object_r:device_t:s0 2024-09-22T03:48:32.960 INFO:teuthology.orchestra.run.smithi098.stdout:Access: 2024-09-22 03:48:25.000650444 +0000 2024-09-22T03:48:32.960 INFO:teuthology.orchestra.run.smithi098.stdout:Modify: 2024-09-22 03:45:22.273163906 +0000 2024-09-22T03:48:32.960 INFO:teuthology.orchestra.run.smithi098.stdout:Change: 2024-09-22 03:45:22.273163906 +0000 2024-09-22T03:48:32.960 INFO:teuthology.orchestra.run.smithi098.stdout: Birth: 2024-09-22 03:45:22.273163906 +0000 2024-09-22T03:48:32.960 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-22T03:48:33.024 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records in 2024-09-22T03:48:33.025 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records out 2024-09-22T03:48:33.025 INFO:teuthology.orchestra.run.smithi098.stderr:512 bytes copied, 0.000219218 s, 2.3 MB/s 2024-09-22T03:48:33.026 DEBUG:teuthology.orchestra.run.smithi098:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-22T03:48:33.083 DEBUG:teuthology.orchestra.run.smithi098:> stat /dev/vg_nvme/lv_2 2024-09-22T03:48:33.139 INFO:teuthology.orchestra.run.smithi098.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-22T03:48:33.139 INFO:teuthology.orchestra.run.smithi098.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-22T03:48:33.139 INFO:teuthology.orchestra.run.smithi098.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-22T03:48:33.139 INFO:teuthology.orchestra.run.smithi098.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-22T03:48:33.139 INFO:teuthology.orchestra.run.smithi098.stdout:Context: system_u:object_r:device_t:s0 2024-09-22T03:48:33.139 INFO:teuthology.orchestra.run.smithi098.stdout:Access: 2024-09-22 03:48:25.001650431 +0000 2024-09-22T03:48:33.139 INFO:teuthology.orchestra.run.smithi098.stdout:Modify: 2024-09-22 03:45:22.603159886 +0000 2024-09-22T03:48:33.139 INFO:teuthology.orchestra.run.smithi098.stdout:Change: 2024-09-22 03:45:22.603159886 +0000 2024-09-22T03:48:33.139 INFO:teuthology.orchestra.run.smithi098.stdout: Birth: 2024-09-22 03:45:22.603159886 +0000 2024-09-22T03:48:33.139 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-22T03:48:33.203 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records in 2024-09-22T03:48:33.203 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records out 2024-09-22T03:48:33.203 INFO:teuthology.orchestra.run.smithi098.stderr:512 bytes copied, 0.000241816 s, 2.1 MB/s 2024-09-22T03:48:33.204 DEBUG:teuthology.orchestra.run.smithi098:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-22T03:48:33.262 DEBUG:teuthology.orchestra.run.smithi098:> stat /dev/vg_nvme/lv_3 2024-09-22T03:48:33.317 INFO:teuthology.orchestra.run.smithi098.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-22T03:48:33.317 INFO:teuthology.orchestra.run.smithi098.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-22T03:48:33.318 INFO:teuthology.orchestra.run.smithi098.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-22T03:48:33.318 INFO:teuthology.orchestra.run.smithi098.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-22T03:48:33.318 INFO:teuthology.orchestra.run.smithi098.stdout:Context: system_u:object_r:device_t:s0 2024-09-22T03:48:33.318 INFO:teuthology.orchestra.run.smithi098.stdout:Access: 2024-09-22 03:48:25.001650431 +0000 2024-09-22T03:48:33.318 INFO:teuthology.orchestra.run.smithi098.stdout:Modify: 2024-09-22 03:45:22.933155866 +0000 2024-09-22T03:48:33.318 INFO:teuthology.orchestra.run.smithi098.stdout:Change: 2024-09-22 03:45:22.933155866 +0000 2024-09-22T03:48:33.318 INFO:teuthology.orchestra.run.smithi098.stdout: Birth: 2024-09-22 03:45:22.933155866 +0000 2024-09-22T03:48:33.318 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-22T03:48:33.382 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records in 2024-09-22T03:48:33.382 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records out 2024-09-22T03:48:33.382 INFO:teuthology.orchestra.run.smithi098.stderr:512 bytes copied, 0.000187158 s, 2.7 MB/s 2024-09-22T03:48:33.383 DEBUG:teuthology.orchestra.run.smithi098:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-22T03:48:33.439 DEBUG:teuthology.orchestra.run.smithi098:> stat /dev/vg_nvme/lv_4 2024-09-22T03:48:33.495 INFO:teuthology.orchestra.run.smithi098.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-22T03:48:33.495 INFO:teuthology.orchestra.run.smithi098.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-22T03:48:33.495 INFO:teuthology.orchestra.run.smithi098.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-09-22T03:48:33.495 INFO:teuthology.orchestra.run.smithi098.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-22T03:48:33.495 INFO:teuthology.orchestra.run.smithi098.stdout:Context: system_u:object_r:device_t:s0 2024-09-22T03:48:33.495 INFO:teuthology.orchestra.run.smithi098.stdout:Access: 2024-09-22 03:48:25.001650431 +0000 2024-09-22T03:48:33.496 INFO:teuthology.orchestra.run.smithi098.stdout:Modify: 2024-09-22 03:45:23.276151688 +0000 2024-09-22T03:48:33.496 INFO:teuthology.orchestra.run.smithi098.stdout:Change: 2024-09-22 03:45:23.276151688 +0000 2024-09-22T03:48:33.496 INFO:teuthology.orchestra.run.smithi098.stdout: Birth: 2024-09-22 03:45:23.276151688 +0000 2024-09-22T03:48:33.496 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-22T03:48:33.558 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records in 2024-09-22T03:48:33.558 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records out 2024-09-22T03:48:33.558 INFO:teuthology.orchestra.run.smithi098.stderr:512 bytes copied, 0.000212145 s, 2.4 MB/s 2024-09-22T03:48:33.560 DEBUG:teuthology.orchestra.run.smithi098:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-22T03:48:33.616 INFO:tasks.ceph:osd dev map: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2024-09-22T03:48:33.616 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi037.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@smithi098.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'}} 2024-09-22T03:48:33.616 INFO:tasks.ceph:Generating config... 2024-09-22T03:48:33.617 INFO:tasks.ceph:[osd] debug monc = 20 2024-09-22T03:48:33.617 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-22T03:48:33.618 INFO:tasks.ceph:[osd] bluestore compression algorithm = snappy 2024-09-22T03:48:33.618 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2024-09-22T03:48:33.618 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-22T03:48:33.618 INFO:tasks.ceph:[osd] bluestore rocksdb cf = False 2024-09-22T03:48:33.618 INFO:tasks.ceph:[osd] crimson alien thread cpu cores = 6-7 2024-09-22T03:48:33.618 INFO:tasks.ceph:[osd] crimson osd obc lru size = 10 2024-09-22T03:48:33.618 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-09-22T03:48:33.618 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-09-22T03:48:33.618 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-22T03:48:33.618 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-22T03:48:33.618 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-09-22T03:48:33.618 INFO:tasks.ceph:[osd] err to stderr = True 2024-09-22T03:48:33.618 INFO:tasks.ceph:[osd] log flush on exit = True 2024-09-22T03:48:33.618 INFO:tasks.ceph:[osd] log to file = False 2024-09-22T03:48:33.619 INFO:tasks.ceph:[osd] log to stderr = True 2024-09-22T03:48:33.619 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-22T03:48:33.619 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-22T03:48:33.619 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-22T03:48:33.619 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-09-22T03:48:33.619 INFO:tasks.ceph:[osd] osd debug reject backfill probability = 0.3 2024-09-22T03:48:33.619 INFO:tasks.ceph:[osd] osd delete sleep = 1 2024-09-22T03:48:33.619 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-22T03:48:33.619 INFO:tasks.ceph:[osd] osd max backfills = 3 2024-09-22T03:48:33.619 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-09-22T03:48:33.619 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-22T03:48:33.619 INFO:tasks.ceph:[osd] osd scrub max interval = 120 2024-09-22T03:48:33.619 INFO:tasks.ceph:[osd] osd scrub min interval = 60 2024-09-22T03:48:33.619 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-09-22T03:48:33.620 INFO:tasks.ceph:[osd] osd snap trim sleep = 2 2024-09-22T03:48:33.620 INFO:tasks.ceph:[client.0] debug ms = 1 2024-09-22T03:48:33.620 INFO:tasks.ceph:[client.0] debug objecter = 20 2024-09-22T03:48:33.620 INFO:tasks.ceph:[client.0] debug rados = 20 2024-09-22T03:48:33.620 INFO:tasks.ceph:[global] enable experimental unrecoverable data corrupting features = crimson 2024-09-22T03:48:33.620 INFO:tasks.ceph:[global] ms client mode = crc 2024-09-22T03:48:33.620 INFO:tasks.ceph:[global] ms cluster mode = crc 2024-09-22T03:48:33.620 INFO:tasks.ceph:[global] ms mon client mode = crc 2024-09-22T03:48:33.620 INFO:tasks.ceph:[global] ms mon cluster mode = crc 2024-09-22T03:48:33.620 INFO:tasks.ceph:[global] ms mon service mode = crc 2024-09-22T03:48:33.620 INFO:tasks.ceph:[global] ms service mode = crc 2024-09-22T03:48:33.620 INFO:tasks.ceph:[global] osd_pool_default_min_size = 2 2024-09-22T03:48:33.620 INFO:tasks.ceph:[global] osd_pool_default_size = 3 2024-09-22T03:48:33.620 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-22T03:48:33.620 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-22T03:48:33.621 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-22T03:48:33.621 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-22T03:48:33.621 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-22T03:48:33.621 INFO:tasks.ceph:[mon] mon min osdmap epochs = 50 2024-09-22T03:48:33.621 INFO:tasks.ceph:[mon] mon osdmap full prune interval = 2 2024-09-22T03:48:33.621 INFO:tasks.ceph:[mon] mon osdmap full prune min = 15 2024-09-22T03:48:33.621 INFO:tasks.ceph:[mon] mon osdmap full prune txsize = 2 2024-09-22T03:48:33.621 INFO:tasks.ceph:[mon] osd pool default crimson = True 2024-09-22T03:48:33.621 INFO:tasks.ceph:[mon] paxos service trim min = 10 2024-09-22T03:48:33.621 INFO:tasks.ceph:[osd.0] crimson seastar cpu cores = 0-2 2024-09-22T03:48:33.621 INFO:tasks.ceph:[osd.1] crimson seastar cpu cores = 3-5 2024-09-22T03:48:33.621 INFO:tasks.ceph:[osd.2] crimson seastar cpu cores = 0-2 2024-09-22T03:48:33.621 INFO:tasks.ceph:[osd.3] crimson seastar cpu cores = 3-5 2024-09-22T03:48:33.622 INFO:tasks.ceph:Setting up mon.a... 2024-09-22T03:48:33.622 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-22T03:48:33.693 INFO:teuthology.orchestra.run.smithi037.stdout:creating /etc/ceph/ceph.keyring 2024-09-22T03:48:33.697 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-22T03:48:33.754 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-22T03:48:33.780 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.37')] 2024-09-22T03:48:33.781 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.37', 'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc', 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 3}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': 120, 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug monc': 20, 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore rocksdb cf': False, 'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'err to stderr': True, 'log flush on exit': True, 'log to file': False, 'log to stderr': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.3, 'osd delete sleep': 1, 'osd failsafe full ratio': 0.95, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd snap trim sleep': 2}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'osd pool default crimson': True, 'paxos service trim min': 10}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}, 'client.0': {'debug ms': 1, 'debug objecter': 20, 'debug rados': 20}, 'osd.0': {'crimson seastar cpu cores': '0-2'}, 'osd.1': {'crimson seastar cpu cores': '3-5'}, 'osd.2': {'crimson seastar cpu cores': '0-2'}, 'osd.3': {'crimson seastar cpu cores': '3-5'}} 2024-09-22T03:48:33.782 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-22T03:48:33.782 DEBUG:teuthology.orchestra.run.smithi037:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-22T03:48:33.837 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.37 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-22T03:48:33.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:48:33.932+0000 7fd5ebf1ef00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:48:33.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:48:33.932+0000 7fd5ebf1ef00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:48:33.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:48:33.932+0000 7fd5ebf1ef00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:48:33.934 INFO:teuthology.orchestra.run.smithi037.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-22T03:48:33.934 INFO:teuthology.orchestra.run.smithi037.stdout:monmaptool: generated fsid 9eda29d9-a2b0-48de-a9bc-7b5579d66932 2024-09-22T03:48:33.934 INFO:teuthology.orchestra.run.smithi037.stdout:setting min_mon_release = quincy 2024-09-22T03:48:33.934 INFO:teuthology.orchestra.run.smithi037.stdout:epoch 0 2024-09-22T03:48:33.934 INFO:teuthology.orchestra.run.smithi037.stdout:fsid 9eda29d9-a2b0-48de-a9bc-7b5579d66932 2024-09-22T03:48:33.934 INFO:teuthology.orchestra.run.smithi037.stdout:last_changed 2024-09-22T03:48:33.933454+0000 2024-09-22T03:48:33.934 INFO:teuthology.orchestra.run.smithi037.stdout:created 2024-09-22T03:48:33.933454+0000 2024-09-22T03:48:33.934 INFO:teuthology.orchestra.run.smithi037.stdout:min_mon_release 17 (quincy) 2024-09-22T03:48:33.935 INFO:teuthology.orchestra.run.smithi037.stdout:election_strategy: 1 2024-09-22T03:48:33.935 INFO:teuthology.orchestra.run.smithi037.stdout:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-22T03:48:33.935 INFO:teuthology.orchestra.run.smithi037.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2024-09-22T03:48:33.936 DEBUG:teuthology.orchestra.run.smithi037:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-22T03:48:33.956 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 9eda29d9-a2b0-48de-a9bc-7b5579d66932... 2024-09-22T03:48:33.957 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-22T03:48:33.999 DEBUG:teuthology.orchestra.run.smithi098:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-22T03:48:34.041 INFO:teuthology.orchestra.run.smithi037.stdout:[global] 2024-09-22T03:48:34.041 INFO:teuthology.orchestra.run.smithi037.stdout: chdir = "" 2024-09-22T03:48:34.041 INFO:teuthology.orchestra.run.smithi037.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-22T03:48:34.041 INFO:teuthology.orchestra.run.smithi037.stdout: auth supported = cephx 2024-09-22T03:48:34.041 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:48:34.041 INFO:teuthology.orchestra.run.smithi037.stdout: filestore xattr use omap = true 2024-09-22T03:48:34.041 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:48:34.041 INFO:teuthology.orchestra.run.smithi037.stdout: mon clock drift allowed = 1.000 2024-09-22T03:48:34.041 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:48:34.042 INFO:teuthology.orchestra.run.smithi037.stdout: osd crush chooseleaf type = 0 2024-09-22T03:48:34.042 INFO:teuthology.orchestra.run.smithi037.stdout: auth debug = true 2024-09-22T03:48:34.042 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:48:34.042 INFO:teuthology.orchestra.run.smithi037.stdout: ms die on old message = true 2024-09-22T03:48:34.042 INFO:teuthology.orchestra.run.smithi037.stdout: ms die on bug = true 2024-09-22T03:48:34.042 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:48:34.042 INFO:teuthology.orchestra.run.smithi037.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-22T03:48:34.042 INFO:teuthology.orchestra.run.smithi037.stdout: mon pg warn max object skew = 0 2024-09-22T03:48:34.042 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:48:34.042 INFO:teuthology.orchestra.run.smithi037.stdout: # disable pg_autoscaler by default for new pools 2024-09-22T03:48:34.042 INFO:teuthology.orchestra.run.smithi037.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-22T03:48:34.042 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:48:34.043 INFO:teuthology.orchestra.run.smithi037.stdout: osd pool default size = 2 2024-09-22T03:48:34.043 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:48:34.043 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd allow primary affinity = true 2024-09-22T03:48:34.043 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd allow pg remap = true 2024-09-22T03:48:34.043 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on legacy crush tunables = false 2024-09-22T03:48:34.043 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on crush straw calc version zero = false 2024-09-22T03:48:34.043 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on no sortbitwise = false 2024-09-22T03:48:34.043 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on osd down out interval zero = false 2024-09-22T03:48:34.043 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on too few osds = false 2024-09-22T03:48:34.043 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-22T03:48:34.043 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-22T03:48:34.043 INFO:teuthology.orchestra.run.smithi037.stdout: mon_allow_pool_size_one = true 2024-09-22T03:48:34.043 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:48:34.043 INFO:teuthology.orchestra.run.smithi037.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-22T03:48:34.043 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:48:34.044 INFO:teuthology.orchestra.run.smithi037.stdout: osd default data pool replay window = 5 2024-09-22T03:48:34.044 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:48:34.044 INFO:teuthology.orchestra.run.smithi037.stdout: mon allow pool delete = true 2024-09-22T03:48:34.044 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:48:34.044 INFO:teuthology.orchestra.run.smithi037.stdout: mon cluster log file level = debug 2024-09-22T03:48:34.044 INFO:teuthology.orchestra.run.smithi037.stdout: debug asserts on shutdown = true 2024-09-22T03:48:34.044 INFO:teuthology.orchestra.run.smithi037.stdout: mon health detail to clog = false 2024-09-22T03:48:34.044 INFO:teuthology.orchestra.run.smithi037.stdout: mon host = 172.21.15.37 2024-09-22T03:48:34.044 INFO:teuthology.orchestra.run.smithi037.stdout: enable experimental unrecoverable data corrupting features = crimson 2024-09-22T03:48:34.044 INFO:teuthology.orchestra.run.smithi037.stdout: ms client mode = crc 2024-09-22T03:48:34.044 INFO:teuthology.orchestra.run.smithi037.stdout: ms cluster mode = crc 2024-09-22T03:48:34.044 INFO:teuthology.orchestra.run.smithi037.stdout: ms mon client mode = crc 2024-09-22T03:48:34.044 INFO:teuthology.orchestra.run.smithi037.stdout: ms mon cluster mode = crc 2024-09-22T03:48:34.044 INFO:teuthology.orchestra.run.smithi037.stdout: ms mon service mode = crc 2024-09-22T03:48:34.045 INFO:teuthology.orchestra.run.smithi037.stdout: ms service mode = crc 2024-09-22T03:48:34.045 INFO:teuthology.orchestra.run.smithi037.stdout: osd_pool_default_min_size = 2 2024-09-22T03:48:34.045 INFO:teuthology.orchestra.run.smithi037.stdout: osd_pool_default_size = 3 2024-09-22T03:48:34.045 INFO:teuthology.orchestra.run.smithi037.stdout: fsid = 9eda29d9-a2b0-48de-a9bc-7b5579d66932 2024-09-22T03:48:34.045 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:48:34.045 INFO:teuthology.orchestra.run.smithi037.stdout:[osd] 2024-09-22T03:48:34.045 INFO:teuthology.orchestra.run.smithi037.stdout: osd journal size = 100 2024-09-22T03:48:34.045 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:48:34.045 INFO:teuthology.orchestra.run.smithi037.stdout: osd scrub load threshold = 5.0 2024-09-22T03:48:34.045 INFO:teuthology.orchestra.run.smithi037.stdout: osd scrub max interval = 120 2024-09-22T03:48:34.045 INFO:teuthology.orchestra.run.smithi037.stdout: osd mclock profile = high_recovery_ops 2024-09-22T03:48:34.045 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:48:34.045 INFO:teuthology.orchestra.run.smithi037.stdout: osd recover clone overlap = true 2024-09-22T03:48:34.046 INFO:teuthology.orchestra.run.smithi037.stdout: osd recovery max chunk = 1048576 2024-09-22T03:48:34.046 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:48:34.046 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug shutdown = true 2024-09-22T03:48:34.046 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug op order = true 2024-09-22T03:48:34.046 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug verify stray on activate = true 2024-09-22T03:48:34.046 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug trim objects = true 2024-09-22T03:48:34.046 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:48:34.046 INFO:teuthology.orchestra.run.smithi037.stdout: osd open classes on start = true 2024-09-22T03:48:34.046 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug pg log writeout = true 2024-09-22T03:48:34.046 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:48:34.046 INFO:teuthology.orchestra.run.smithi037.stdout: osd deep scrub update digest min age = 30 2024-09-22T03:48:34.046 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:48:34.046 INFO:teuthology.orchestra.run.smithi037.stdout: osd map max advance = 10 2024-09-22T03:48:34.046 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:48:34.047 INFO:teuthology.orchestra.run.smithi037.stdout: journal zero on create = true 2024-09-22T03:48:34.047 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:48:34.047 INFO:teuthology.orchestra.run.smithi037.stdout: filestore ondisk finisher threads = 3 2024-09-22T03:48:34.047 INFO:teuthology.orchestra.run.smithi037.stdout: filestore apply finisher threads = 3 2024-09-22T03:48:34.047 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:48:34.047 INFO:teuthology.orchestra.run.smithi037.stdout: bdev debug aio = true 2024-09-22T03:48:34.047 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug misdirected ops = true 2024-09-22T03:48:34.047 INFO:teuthology.orchestra.run.smithi037.stdout: debug monc = 20 2024-09-22T03:48:34.047 INFO:teuthology.orchestra.run.smithi037.stdout: bluestore block size = 96636764160 2024-09-22T03:48:34.047 INFO:teuthology.orchestra.run.smithi037.stdout: bluestore compression algorithm = snappy 2024-09-22T03:48:34.047 INFO:teuthology.orchestra.run.smithi037.stdout: bluestore compression mode = aggressive 2024-09-22T03:48:34.047 INFO:teuthology.orchestra.run.smithi037.stdout: bluestore fsck on mount = True 2024-09-22T03:48:34.047 INFO:teuthology.orchestra.run.smithi037.stdout: bluestore rocksdb cf = False 2024-09-22T03:48:34.047 INFO:teuthology.orchestra.run.smithi037.stdout: crimson alien thread cpu cores = 6-7 2024-09-22T03:48:34.047 INFO:teuthology.orchestra.run.smithi037.stdout: crimson osd obc lru size = 10 2024-09-22T03:48:34.048 INFO:teuthology.orchestra.run.smithi037.stdout: debug bluefs = 20 2024-09-22T03:48:34.048 INFO:teuthology.orchestra.run.smithi037.stdout: debug bluestore = 20 2024-09-22T03:48:34.048 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2024-09-22T03:48:34.048 INFO:teuthology.orchestra.run.smithi037.stdout: debug osd = 20 2024-09-22T03:48:34.048 INFO:teuthology.orchestra.run.smithi037.stdout: debug rocksdb = 10 2024-09-22T03:48:34.048 INFO:teuthology.orchestra.run.smithi037.stdout: err to stderr = True 2024-09-22T03:48:34.048 INFO:teuthology.orchestra.run.smithi037.stdout: log flush on exit = True 2024-09-22T03:48:34.048 INFO:teuthology.orchestra.run.smithi037.stdout: log to file = False 2024-09-22T03:48:34.048 INFO:teuthology.orchestra.run.smithi037.stdout: log to stderr = True 2024-09-22T03:48:34.048 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd backfillfull_ratio = 0.85 2024-09-22T03:48:34.049 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd full ratio = 0.9 2024-09-22T03:48:34.049 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd nearfull ratio = 0.8 2024-09-22T03:48:34.049 INFO:teuthology.orchestra.run.smithi037.stdout: osd blocked scrub grace period = 3600 2024-09-22T03:48:34.049 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug reject backfill probability = 0.3 2024-09-22T03:48:34.049 INFO:teuthology.orchestra.run.smithi037.stdout: osd delete sleep = 1 2024-09-22T03:48:34.049 INFO:teuthology.orchestra.run.smithi037.stdout: osd failsafe full ratio = 0.95 2024-09-22T03:48:34.049 INFO:teuthology.orchestra.run.smithi037.stdout: osd max backfills = 3 2024-09-22T03:48:34.049 INFO:teuthology.orchestra.run.smithi037.stdout: osd max markdown count = 1000 2024-09-22T03:48:34.049 INFO:teuthology.orchestra.run.smithi037.stdout: osd objectstore = bluestore 2024-09-22T03:48:34.049 INFO:teuthology.orchestra.run.smithi037.stdout: osd scrub min interval = 60 2024-09-22T03:48:34.049 INFO:teuthology.orchestra.run.smithi037.stdout: osd shutdown pgref assert = True 2024-09-22T03:48:34.049 INFO:teuthology.orchestra.run.smithi037.stdout: osd snap trim sleep = 2 2024-09-22T03:48:34.049 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:48:34.050 INFO:teuthology.orchestra.run.smithi037.stdout:[mgr] 2024-09-22T03:48:34.050 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2024-09-22T03:48:34.050 INFO:teuthology.orchestra.run.smithi037.stdout: debug mgr = 20 2024-09-22T03:48:34.050 INFO:teuthology.orchestra.run.smithi037.stdout: debug mon = 20 2024-09-22T03:48:34.050 INFO:teuthology.orchestra.run.smithi037.stdout: debug auth = 20 2024-09-22T03:48:34.050 INFO:teuthology.orchestra.run.smithi037.stdout: mon reweight min pgs per osd = 4 2024-09-22T03:48:34.050 INFO:teuthology.orchestra.run.smithi037.stdout: mon reweight min bytes per osd = 10 2024-09-22T03:48:34.050 INFO:teuthology.orchestra.run.smithi037.stdout: mgr/telemetry/nag = false 2024-09-22T03:48:34.050 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:48:34.050 INFO:teuthology.orchestra.run.smithi037.stdout:[mon] 2024-09-22T03:48:34.050 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2024-09-22T03:48:34.050 INFO:teuthology.orchestra.run.smithi037.stdout: debug mon = 20 2024-09-22T03:48:34.050 INFO:teuthology.orchestra.run.smithi037.stdout: debug paxos = 20 2024-09-22T03:48:34.050 INFO:teuthology.orchestra.run.smithi037.stdout: debug auth = 20 2024-09-22T03:48:34.050 INFO:teuthology.orchestra.run.smithi037.stdout: mon data avail warn = 5 2024-09-22T03:48:34.051 INFO:teuthology.orchestra.run.smithi037.stdout: mon mgr mkfs grace = 240 2024-09-22T03:48:34.051 INFO:teuthology.orchestra.run.smithi037.stdout: mon reweight min pgs per osd = 4 2024-09-22T03:48:34.051 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd reporter subtree level = osd 2024-09-22T03:48:34.051 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd prime pg temp = true 2024-09-22T03:48:34.051 INFO:teuthology.orchestra.run.smithi037.stdout: mon reweight min bytes per osd = 10 2024-09-22T03:48:34.051 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:48:34.051 INFO:teuthology.orchestra.run.smithi037.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-22T03:48:34.051 INFO:teuthology.orchestra.run.smithi037.stdout: auth mon ticket ttl = 660 # 11m 2024-09-22T03:48:34.051 INFO:teuthology.orchestra.run.smithi037.stdout: auth service ticket ttl = 240 # 4m 2024-09-22T03:48:34.051 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:48:34.051 INFO:teuthology.orchestra.run.smithi037.stdout: # don't complain about insecure global_id in the test suite 2024-09-22T03:48:34.051 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-22T03:48:34.051 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-22T03:48:34.051 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:48:34.052 INFO:teuthology.orchestra.run.smithi037.stdout: # 1m isn't quite enough 2024-09-22T03:48:34.052 INFO:teuthology.orchestra.run.smithi037.stdout: mon_down_mkfs_grace = 2m 2024-09-22T03:48:34.052 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:48:34.052 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_filestore_osds = false 2024-09-22T03:48:34.052 INFO:teuthology.orchestra.run.smithi037.stdout: mon min osdmap epochs = 50 2024-09-22T03:48:34.052 INFO:teuthology.orchestra.run.smithi037.stdout: mon osdmap full prune interval = 2 2024-09-22T03:48:34.052 INFO:teuthology.orchestra.run.smithi037.stdout: mon osdmap full prune min = 15 2024-09-22T03:48:34.052 INFO:teuthology.orchestra.run.smithi037.stdout: mon osdmap full prune txsize = 2 2024-09-22T03:48:34.052 INFO:teuthology.orchestra.run.smithi037.stdout: osd pool default crimson = True 2024-09-22T03:48:34.052 INFO:teuthology.orchestra.run.smithi037.stdout: paxos service trim min = 10 2024-09-22T03:48:34.052 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:48:34.052 INFO:teuthology.orchestra.run.smithi037.stdout:[client] 2024-09-22T03:48:34.052 INFO:teuthology.orchestra.run.smithi037.stdout: rgw cache enabled = true 2024-09-22T03:48:34.052 INFO:teuthology.orchestra.run.smithi037.stdout: rgw enable ops log = true 2024-09-22T03:48:34.053 INFO:teuthology.orchestra.run.smithi037.stdout: rgw enable usage log = true 2024-09-22T03:48:34.053 INFO:teuthology.orchestra.run.smithi037.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-22T03:48:34.053 INFO:teuthology.orchestra.run.smithi037.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-22T03:48:34.053 INFO:teuthology.orchestra.run.smithi037.stdout:[mon.a] 2024-09-22T03:48:34.053 INFO:teuthology.orchestra.run.smithi037.stdout:[client.0] 2024-09-22T03:48:34.053 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2024-09-22T03:48:34.053 INFO:teuthology.orchestra.run.smithi037.stdout: debug objecter = 20 2024-09-22T03:48:34.053 INFO:teuthology.orchestra.run.smithi037.stdout: debug rados = 20 2024-09-22T03:48:34.053 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.0] 2024-09-22T03:48:34.053 INFO:teuthology.orchestra.run.smithi037.stdout: crimson seastar cpu cores = 0-2 2024-09-22T03:48:34.053 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.1] 2024-09-22T03:48:34.053 INFO:teuthology.orchestra.run.smithi037.stdout: crimson seastar cpu cores = 3-5 2024-09-22T03:48:34.053 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.2] 2024-09-22T03:48:34.053 INFO:teuthology.orchestra.run.smithi037.stdout: crimson seastar cpu cores = 0-2 2024-09-22T03:48:34.053 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.3] 2024-09-22T03:48:34.054 INFO:teuthology.orchestra.run.smithi037.stdout: crimson seastar cpu cores = 3-5 2024-09-22T03:48:34.055 INFO:teuthology.orchestra.run.smithi098.stdout:[global] 2024-09-22T03:48:34.055 INFO:teuthology.orchestra.run.smithi098.stdout: chdir = "" 2024-09-22T03:48:34.055 INFO:teuthology.orchestra.run.smithi098.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-22T03:48:34.055 INFO:teuthology.orchestra.run.smithi098.stdout: auth supported = cephx 2024-09-22T03:48:34.055 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-22T03:48:34.055 INFO:teuthology.orchestra.run.smithi098.stdout: filestore xattr use omap = true 2024-09-22T03:48:34.055 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-22T03:48:34.056 INFO:teuthology.orchestra.run.smithi098.stdout: mon clock drift allowed = 1.000 2024-09-22T03:48:34.056 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-22T03:48:34.056 INFO:teuthology.orchestra.run.smithi098.stdout: osd crush chooseleaf type = 0 2024-09-22T03:48:34.056 INFO:teuthology.orchestra.run.smithi098.stdout: auth debug = true 2024-09-22T03:48:34.056 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-22T03:48:34.056 INFO:teuthology.orchestra.run.smithi098.stdout: ms die on old message = true 2024-09-22T03:48:34.056 INFO:teuthology.orchestra.run.smithi098.stdout: ms die on bug = true 2024-09-22T03:48:34.056 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-22T03:48:34.056 INFO:teuthology.orchestra.run.smithi098.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-22T03:48:34.056 INFO:teuthology.orchestra.run.smithi098.stdout: mon pg warn max object skew = 0 2024-09-22T03:48:34.056 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-22T03:48:34.056 INFO:teuthology.orchestra.run.smithi098.stdout: # disable pg_autoscaler by default for new pools 2024-09-22T03:48:34.056 INFO:teuthology.orchestra.run.smithi098.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-22T03:48:34.056 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-22T03:48:34.057 INFO:teuthology.orchestra.run.smithi098.stdout: osd pool default size = 2 2024-09-22T03:48:34.057 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-22T03:48:34.057 INFO:teuthology.orchestra.run.smithi098.stdout: mon osd allow primary affinity = true 2024-09-22T03:48:34.057 INFO:teuthology.orchestra.run.smithi098.stdout: mon osd allow pg remap = true 2024-09-22T03:48:34.057 INFO:teuthology.orchestra.run.smithi098.stdout: mon warn on legacy crush tunables = false 2024-09-22T03:48:34.057 INFO:teuthology.orchestra.run.smithi098.stdout: mon warn on crush straw calc version zero = false 2024-09-22T03:48:34.057 INFO:teuthology.orchestra.run.smithi098.stdout: mon warn on no sortbitwise = false 2024-09-22T03:48:34.057 INFO:teuthology.orchestra.run.smithi098.stdout: mon warn on osd down out interval zero = false 2024-09-22T03:48:34.057 INFO:teuthology.orchestra.run.smithi098.stdout: mon warn on too few osds = false 2024-09-22T03:48:34.057 INFO:teuthology.orchestra.run.smithi098.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-22T03:48:34.057 INFO:teuthology.orchestra.run.smithi098.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-22T03:48:34.057 INFO:teuthology.orchestra.run.smithi098.stdout: mon_allow_pool_size_one = true 2024-09-22T03:48:34.057 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-22T03:48:34.057 INFO:teuthology.orchestra.run.smithi098.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-22T03:48:34.058 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-22T03:48:34.058 INFO:teuthology.orchestra.run.smithi098.stdout: osd default data pool replay window = 5 2024-09-22T03:48:34.058 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-22T03:48:34.058 INFO:teuthology.orchestra.run.smithi098.stdout: mon allow pool delete = true 2024-09-22T03:48:34.058 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-22T03:48:34.058 INFO:teuthology.orchestra.run.smithi098.stdout: mon cluster log file level = debug 2024-09-22T03:48:34.058 INFO:teuthology.orchestra.run.smithi098.stdout: debug asserts on shutdown = true 2024-09-22T03:48:34.058 INFO:teuthology.orchestra.run.smithi098.stdout: mon health detail to clog = false 2024-09-22T03:48:34.058 INFO:teuthology.orchestra.run.smithi098.stdout: mon host = 172.21.15.37 2024-09-22T03:48:34.058 INFO:teuthology.orchestra.run.smithi098.stdout: enable experimental unrecoverable data corrupting features = crimson 2024-09-22T03:48:34.058 INFO:teuthology.orchestra.run.smithi098.stdout: ms client mode = crc 2024-09-22T03:48:34.058 INFO:teuthology.orchestra.run.smithi098.stdout: ms cluster mode = crc 2024-09-22T03:48:34.058 INFO:teuthology.orchestra.run.smithi098.stdout: ms mon client mode = crc 2024-09-22T03:48:34.058 INFO:teuthology.orchestra.run.smithi098.stdout: ms mon cluster mode = crc 2024-09-22T03:48:34.058 INFO:teuthology.orchestra.run.smithi098.stdout: ms mon service mode = crc 2024-09-22T03:48:34.059 INFO:teuthology.orchestra.run.smithi098.stdout: ms service mode = crc 2024-09-22T03:48:34.059 INFO:teuthology.orchestra.run.smithi098.stdout: osd_pool_default_min_size = 2 2024-09-22T03:48:34.059 INFO:teuthology.orchestra.run.smithi098.stdout: osd_pool_default_size = 3 2024-09-22T03:48:34.059 INFO:teuthology.orchestra.run.smithi098.stdout: fsid = 9eda29d9-a2b0-48de-a9bc-7b5579d66932 2024-09-22T03:48:34.059 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-22T03:48:34.059 INFO:teuthology.orchestra.run.smithi098.stdout:[osd] 2024-09-22T03:48:34.059 INFO:teuthology.orchestra.run.smithi098.stdout: osd journal size = 100 2024-09-22T03:48:34.059 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-22T03:48:34.059 INFO:teuthology.orchestra.run.smithi098.stdout: osd scrub load threshold = 5.0 2024-09-22T03:48:34.059 INFO:teuthology.orchestra.run.smithi098.stdout: osd scrub max interval = 120 2024-09-22T03:48:34.059 INFO:teuthology.orchestra.run.smithi098.stdout: osd mclock profile = high_recovery_ops 2024-09-22T03:48:34.059 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-22T03:48:34.059 INFO:teuthology.orchestra.run.smithi098.stdout: osd recover clone overlap = true 2024-09-22T03:48:34.059 INFO:teuthology.orchestra.run.smithi098.stdout: osd recovery max chunk = 1048576 2024-09-22T03:48:34.060 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-22T03:48:34.060 INFO:teuthology.orchestra.run.smithi098.stdout: osd debug shutdown = true 2024-09-22T03:48:34.060 INFO:teuthology.orchestra.run.smithi098.stdout: osd debug op order = true 2024-09-22T03:48:34.060 INFO:teuthology.orchestra.run.smithi098.stdout: osd debug verify stray on activate = true 2024-09-22T03:48:34.060 INFO:teuthology.orchestra.run.smithi098.stdout: osd debug trim objects = true 2024-09-22T03:48:34.060 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-22T03:48:34.060 INFO:teuthology.orchestra.run.smithi098.stdout: osd open classes on start = true 2024-09-22T03:48:34.060 INFO:teuthology.orchestra.run.smithi098.stdout: osd debug pg log writeout = true 2024-09-22T03:48:34.060 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-22T03:48:34.060 INFO:teuthology.orchestra.run.smithi098.stdout: osd deep scrub update digest min age = 30 2024-09-22T03:48:34.060 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-22T03:48:34.060 INFO:teuthology.orchestra.run.smithi098.stdout: osd map max advance = 10 2024-09-22T03:48:34.060 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-22T03:48:34.060 INFO:teuthology.orchestra.run.smithi098.stdout: journal zero on create = true 2024-09-22T03:48:34.061 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-22T03:48:34.061 INFO:teuthology.orchestra.run.smithi098.stdout: filestore ondisk finisher threads = 3 2024-09-22T03:48:34.061 INFO:teuthology.orchestra.run.smithi098.stdout: filestore apply finisher threads = 3 2024-09-22T03:48:34.061 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-22T03:48:34.061 INFO:teuthology.orchestra.run.smithi098.stdout: bdev debug aio = true 2024-09-22T03:48:34.061 INFO:teuthology.orchestra.run.smithi098.stdout: osd debug misdirected ops = true 2024-09-22T03:48:34.061 INFO:teuthology.orchestra.run.smithi098.stdout: debug monc = 20 2024-09-22T03:48:34.061 INFO:teuthology.orchestra.run.smithi098.stdout: bluestore block size = 96636764160 2024-09-22T03:48:34.061 INFO:teuthology.orchestra.run.smithi098.stdout: bluestore compression algorithm = snappy 2024-09-22T03:48:34.061 INFO:teuthology.orchestra.run.smithi098.stdout: bluestore compression mode = aggressive 2024-09-22T03:48:34.061 INFO:teuthology.orchestra.run.smithi098.stdout: bluestore fsck on mount = True 2024-09-22T03:48:34.061 INFO:teuthology.orchestra.run.smithi098.stdout: bluestore rocksdb cf = False 2024-09-22T03:48:34.061 INFO:teuthology.orchestra.run.smithi098.stdout: crimson alien thread cpu cores = 6-7 2024-09-22T03:48:34.061 INFO:teuthology.orchestra.run.smithi098.stdout: crimson osd obc lru size = 10 2024-09-22T03:48:34.061 INFO:teuthology.orchestra.run.smithi098.stdout: debug bluefs = 20 2024-09-22T03:48:34.062 INFO:teuthology.orchestra.run.smithi098.stdout: debug bluestore = 20 2024-09-22T03:48:34.062 INFO:teuthology.orchestra.run.smithi098.stdout: debug ms = 1 2024-09-22T03:48:34.062 INFO:teuthology.orchestra.run.smithi098.stdout: debug osd = 20 2024-09-22T03:48:34.062 INFO:teuthology.orchestra.run.smithi098.stdout: debug rocksdb = 10 2024-09-22T03:48:34.062 INFO:teuthology.orchestra.run.smithi098.stdout: err to stderr = True 2024-09-22T03:48:34.062 INFO:teuthology.orchestra.run.smithi098.stdout: log flush on exit = True 2024-09-22T03:48:34.062 INFO:teuthology.orchestra.run.smithi098.stdout: log to file = False 2024-09-22T03:48:34.062 INFO:teuthology.orchestra.run.smithi098.stdout: log to stderr = True 2024-09-22T03:48:34.062 INFO:teuthology.orchestra.run.smithi098.stdout: mon osd backfillfull_ratio = 0.85 2024-09-22T03:48:34.062 INFO:teuthology.orchestra.run.smithi098.stdout: mon osd full ratio = 0.9 2024-09-22T03:48:34.062 INFO:teuthology.orchestra.run.smithi098.stdout: mon osd nearfull ratio = 0.8 2024-09-22T03:48:34.062 INFO:teuthology.orchestra.run.smithi098.stdout: osd blocked scrub grace period = 3600 2024-09-22T03:48:34.063 INFO:teuthology.orchestra.run.smithi098.stdout: osd debug reject backfill probability = 0.3 2024-09-22T03:48:34.063 INFO:teuthology.orchestra.run.smithi098.stdout: osd delete sleep = 1 2024-09-22T03:48:34.063 INFO:teuthology.orchestra.run.smithi098.stdout: osd failsafe full ratio = 0.95 2024-09-22T03:48:34.063 INFO:teuthology.orchestra.run.smithi098.stdout: osd max backfills = 3 2024-09-22T03:48:34.063 INFO:teuthology.orchestra.run.smithi098.stdout: osd max markdown count = 1000 2024-09-22T03:48:34.063 INFO:teuthology.orchestra.run.smithi098.stdout: osd objectstore = bluestore 2024-09-22T03:48:34.063 INFO:teuthology.orchestra.run.smithi098.stdout: osd scrub min interval = 60 2024-09-22T03:48:34.063 INFO:teuthology.orchestra.run.smithi098.stdout: osd shutdown pgref assert = True 2024-09-22T03:48:34.063 INFO:teuthology.orchestra.run.smithi098.stdout: osd snap trim sleep = 2 2024-09-22T03:48:34.063 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-22T03:48:34.063 INFO:teuthology.orchestra.run.smithi098.stdout:[mgr] 2024-09-22T03:48:34.063 INFO:teuthology.orchestra.run.smithi098.stdout: debug ms = 1 2024-09-22T03:48:34.063 INFO:teuthology.orchestra.run.smithi098.stdout: debug mgr = 20 2024-09-22T03:48:34.063 INFO:teuthology.orchestra.run.smithi098.stdout: debug mon = 20 2024-09-22T03:48:34.063 INFO:teuthology.orchestra.run.smithi098.stdout: debug auth = 20 2024-09-22T03:48:34.064 INFO:teuthology.orchestra.run.smithi098.stdout: mon reweight min pgs per osd = 4 2024-09-22T03:48:34.064 INFO:teuthology.orchestra.run.smithi098.stdout: mon reweight min bytes per osd = 10 2024-09-22T03:48:34.064 INFO:teuthology.orchestra.run.smithi098.stdout: mgr/telemetry/nag = false 2024-09-22T03:48:34.064 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-22T03:48:34.064 INFO:teuthology.orchestra.run.smithi098.stdout:[mon] 2024-09-22T03:48:34.064 INFO:teuthology.orchestra.run.smithi098.stdout: debug ms = 1 2024-09-22T03:48:34.064 INFO:teuthology.orchestra.run.smithi098.stdout: debug mon = 20 2024-09-22T03:48:34.064 INFO:teuthology.orchestra.run.smithi098.stdout: debug paxos = 20 2024-09-22T03:48:34.064 INFO:teuthology.orchestra.run.smithi098.stdout: debug auth = 20 2024-09-22T03:48:34.064 INFO:teuthology.orchestra.run.smithi098.stdout: mon data avail warn = 5 2024-09-22T03:48:34.064 INFO:teuthology.orchestra.run.smithi098.stdout: mon mgr mkfs grace = 240 2024-09-22T03:48:34.064 INFO:teuthology.orchestra.run.smithi098.stdout: mon reweight min pgs per osd = 4 2024-09-22T03:48:34.064 INFO:teuthology.orchestra.run.smithi098.stdout: mon osd reporter subtree level = osd 2024-09-22T03:48:34.064 INFO:teuthology.orchestra.run.smithi098.stdout: mon osd prime pg temp = true 2024-09-22T03:48:34.065 INFO:teuthology.orchestra.run.smithi098.stdout: mon reweight min bytes per osd = 10 2024-09-22T03:48:34.065 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-22T03:48:34.065 INFO:teuthology.orchestra.run.smithi098.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-22T03:48:34.065 INFO:teuthology.orchestra.run.smithi098.stdout: auth mon ticket ttl = 660 # 11m 2024-09-22T03:48:34.065 INFO:teuthology.orchestra.run.smithi098.stdout: auth service ticket ttl = 240 # 4m 2024-09-22T03:48:34.065 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-22T03:48:34.065 INFO:teuthology.orchestra.run.smithi098.stdout: # don't complain about insecure global_id in the test suite 2024-09-22T03:48:34.065 INFO:teuthology.orchestra.run.smithi098.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-22T03:48:34.065 INFO:teuthology.orchestra.run.smithi098.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-22T03:48:34.065 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-22T03:48:34.065 INFO:teuthology.orchestra.run.smithi098.stdout: # 1m isn't quite enough 2024-09-22T03:48:34.065 INFO:teuthology.orchestra.run.smithi098.stdout: mon_down_mkfs_grace = 2m 2024-09-22T03:48:34.065 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-22T03:48:34.065 INFO:teuthology.orchestra.run.smithi098.stdout: mon_warn_on_filestore_osds = false 2024-09-22T03:48:34.066 INFO:teuthology.orchestra.run.smithi098.stdout: mon min osdmap epochs = 50 2024-09-22T03:48:34.066 INFO:teuthology.orchestra.run.smithi098.stdout: mon osdmap full prune interval = 2 2024-09-22T03:48:34.066 INFO:teuthology.orchestra.run.smithi098.stdout: mon osdmap full prune min = 15 2024-09-22T03:48:34.066 INFO:teuthology.orchestra.run.smithi098.stdout: mon osdmap full prune txsize = 2 2024-09-22T03:48:34.066 INFO:teuthology.orchestra.run.smithi098.stdout: osd pool default crimson = True 2024-09-22T03:48:34.066 INFO:teuthology.orchestra.run.smithi098.stdout: paxos service trim min = 10 2024-09-22T03:48:34.066 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-22T03:48:34.066 INFO:teuthology.orchestra.run.smithi098.stdout:[client] 2024-09-22T03:48:34.066 INFO:teuthology.orchestra.run.smithi098.stdout: rgw cache enabled = true 2024-09-22T03:48:34.066 INFO:teuthology.orchestra.run.smithi098.stdout: rgw enable ops log = true 2024-09-22T03:48:34.066 INFO:teuthology.orchestra.run.smithi098.stdout: rgw enable usage log = true 2024-09-22T03:48:34.066 INFO:teuthology.orchestra.run.smithi098.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-22T03:48:34.066 INFO:teuthology.orchestra.run.smithi098.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-22T03:48:34.066 INFO:teuthology.orchestra.run.smithi098.stdout:[mon.a] 2024-09-22T03:48:34.067 INFO:teuthology.orchestra.run.smithi098.stdout:[client.0] 2024-09-22T03:48:34.067 INFO:teuthology.orchestra.run.smithi098.stdout: debug ms = 1 2024-09-22T03:48:34.067 INFO:teuthology.orchestra.run.smithi098.stdout: debug objecter = 20 2024-09-22T03:48:34.067 INFO:teuthology.orchestra.run.smithi098.stdout: debug rados = 20 2024-09-22T03:48:34.067 INFO:teuthology.orchestra.run.smithi098.stdout:[osd.0] 2024-09-22T03:48:34.067 INFO:teuthology.orchestra.run.smithi098.stdout: crimson seastar cpu cores = 0-2 2024-09-22T03:48:34.067 INFO:teuthology.orchestra.run.smithi098.stdout:[osd.1] 2024-09-22T03:48:34.067 INFO:teuthology.orchestra.run.smithi098.stdout: crimson seastar cpu cores = 3-5 2024-09-22T03:48:34.067 INFO:teuthology.orchestra.run.smithi098.stdout:[osd.2] 2024-09-22T03:48:34.067 INFO:teuthology.orchestra.run.smithi098.stdout: crimson seastar cpu cores = 0-2 2024-09-22T03:48:34.067 INFO:teuthology.orchestra.run.smithi098.stdout:[osd.3] 2024-09-22T03:48:34.067 INFO:teuthology.orchestra.run.smithi098.stdout: crimson seastar cpu cores = 3-5 2024-09-22T03:48:34.067 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-22T03:48:34.068 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-22T03:48:34.166 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-22T03:48:34.166 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-22T03:48:34.166 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-22T03:48:34.183 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-22T03:48:34.183 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-22T03:48:34.239 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi037.front.sepia.ceph.com 2024-09-22T03:48:34.239 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-22T03:48:34.239 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-22T03:48:34.239 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-22T03:48:34.315 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-22T03:48:34.316 DEBUG:teuthology.orchestra.run.smithi037:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-22T03:48:34.372 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi098.front.sepia.ceph.com 2024-09-22T03:48:34.372 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-22T03:48:34.372 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-22T03:48:34.372 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-22T03:48:34.408 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-22T03:48:34.409 DEBUG:teuthology.orchestra.run.smithi098:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-22T03:48:34.464 INFO:tasks.ceph:Setting up mon nodes... 2024-09-22T03:48:34.464 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-22T03:48:34.464 DEBUG:teuthology.orchestra.run.smithi098:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-22T03:48:34.589 INFO:teuthology.orchestra.run.smithi098.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-22T03:48:34.592 INFO:tasks.ceph:Setting up mds nodes... 2024-09-22T03:48:34.593 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-22T03:48:34.593 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-22T03:48:34.643 INFO:teuthology.orchestra.run.smithi037.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-22T03:48:34.657 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-22T03:48:34.707 INFO:teuthology.orchestra.run.smithi098.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-22T03:48:34.720 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-22T03:48:34.720 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi037.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@smithi098.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'}} 2024-09-22T03:48:34.720 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-22T03:48:34.746 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2024-09-22T03:48:34.746 INFO:tasks.ceph:role: osd.0 2024-09-22T03:48:34.746 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi037.front.sepia.ceph.com 2024-09-22T03:48:34.746 DEBUG:teuthology.orchestra.run.smithi037:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-22T03:48:34.821 INFO:teuthology.orchestra.run.smithi037.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-22T03:48:34.821 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-22T03:48:34.821 INFO:teuthology.orchestra.run.smithi037.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-22T03:48:34.821 INFO:teuthology.orchestra.run.smithi037.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-22T03:48:34.821 INFO:teuthology.orchestra.run.smithi037.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-22T03:48:34.821 INFO:teuthology.orchestra.run.smithi037.stdout: = sunit=0 swidth=0 blks 2024-09-22T03:48:34.821 INFO:teuthology.orchestra.run.smithi037.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-22T03:48:34.821 INFO:teuthology.orchestra.run.smithi037.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-22T03:48:34.821 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-22T03:48:34.821 INFO:teuthology.orchestra.run.smithi037.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-22T03:48:35.316 INFO:teuthology.orchestra.run.smithi037.stdout:Discarding blocks...Done. 2024-09-22T03:48:35.318 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi037.front.sepia.ceph.com -o noatime 2024-09-22T03:48:35.318 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-22T03:48:35.446 DEBUG:teuthology.orchestra.run.smithi037:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-22T03:48:35.478 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-22T03:48:35.545 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2024-09-22T03:48:35.545 INFO:tasks.ceph:role: osd.1 2024-09-22T03:48:35.545 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi037.front.sepia.ceph.com 2024-09-22T03:48:35.545 DEBUG:teuthology.orchestra.run.smithi037:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-22T03:48:35.618 INFO:teuthology.orchestra.run.smithi037.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-22T03:48:35.618 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-22T03:48:35.618 INFO:teuthology.orchestra.run.smithi037.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-22T03:48:35.618 INFO:teuthology.orchestra.run.smithi037.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-22T03:48:35.619 INFO:teuthology.orchestra.run.smithi037.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-22T03:48:35.619 INFO:teuthology.orchestra.run.smithi037.stdout: = sunit=0 swidth=0 blks 2024-09-22T03:48:35.619 INFO:teuthology.orchestra.run.smithi037.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-22T03:48:35.619 INFO:teuthology.orchestra.run.smithi037.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-22T03:48:35.619 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-22T03:48:35.619 INFO:teuthology.orchestra.run.smithi037.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-22T03:48:36.077 INFO:teuthology.orchestra.run.smithi037.stdout:Discarding blocks...Done. 2024-09-22T03:48:36.079 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi037.front.sepia.ceph.com -o noatime 2024-09-22T03:48:36.079 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-22T03:48:36.167 DEBUG:teuthology.orchestra.run.smithi037:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-22T03:48:36.198 DEBUG:teuthology.orchestra.run.smithi037:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-22T03:48:36.519 INFO:teuthology.orchestra.run.smithi037.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-22T03:48:36.520 INFO:teuthology.orchestra.run.smithi037.stderr:INFO 2024-09-22 03:48:36,520 seastar - Reactor backend: linux-aio 2024-09-22T03:48:36.535 INFO:teuthology.orchestra.run.smithi037.stderr:==27832==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-22T03:48:36.643 INFO:teuthology.orchestra.run.smithi037.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbc8b6ef 0xbb64079 0xbb655e4 0xbb657fa 0xbb65950 0xbb65e19 0x3e6ef 0x36281b4 0x3628967 0x5df84d1 0x5dfb1e9 0x5dfbe00 0x713a942 0x714c115 0x714d5b2 0x714d637 0x714d739 0x714d831 0x714da3e 0x714dc24 0x714df73 0x714e317 0x714e547 0x714e7b1 0x714ea7e 0x714ec9c 0x714ed54 0x714ee1a 0x714eefb 0x5c46eec 0x5c46ff6 0x5c470b2 0x5c4716e 0x5c4722a 0x5c47377 0x5c47502 0x5c478c3 0x5c616c6 0xbb78627 0xbb904a5 0xbc3dd4f 0xbc3f39d 0xb90dc6d 0xb90e4a5 0x3961ae8 0x39632c2 0x3803c18 0x2958f 0x2963f 0x35eb9a4 2024-09-22T03:48:36.643 INFO:teuthology.orchestra.run.smithi037.stderr:kernel callstack: 2024-09-22T03:48:36.668 INFO:teuthology.orchestra.run.smithi037.stderr:INFO 2024-09-22 03:48:36,668 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2024-09-22T03:48:36.668 INFO:teuthology.orchestra.run.smithi037.stderr:INFO 2024-09-22 03:48:36,668 [shard 0:main] osd - get_early_config: set --thread-affinity 1 --cpuset 0-2 2024-09-22T03:48:36.669 INFO:teuthology.orchestra.run.smithi037.stderr:DEBUG 2024-09-22 03:48:36,669 [shard 0:main] seastar - reactor::drain 2024-09-22T03:48:37.214 INFO:teuthology.orchestra.run.smithi037.stderr:----------------------------------------------------- 2024-09-22T03:48:37.214 INFO:teuthology.orchestra.run.smithi037.stderr:Suppressions used: 2024-09-22T03:48:37.215 INFO:teuthology.orchestra.run.smithi037.stderr: count bytes template 2024-09-22T03:48:37.215 INFO:teuthology.orchestra.run.smithi037.stderr: 1 8 MallocExtension::Register 2024-09-22T03:48:37.215 INFO:teuthology.orchestra.run.smithi037.stderr:----------------------------------------------------- 2024-09-22T03:48:37.215 INFO:teuthology.orchestra.run.smithi037.stderr: 2024-09-22T03:48:37.273 INFO:teuthology.orchestra.run.smithi037.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-22T03:48:37.277 INFO:teuthology.orchestra.run.smithi037.stderr:INFO 2024-09-22 03:48:37,277 seastar - Reactor backend: linux-aio 2024-09-22T03:48:37.288 INFO:teuthology.orchestra.run.smithi037.stderr:==27828==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-22T03:48:37.352 INFO:teuthology.orchestra.run.smithi037.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbc8b6ef 0xbb64079 0xbb655e4 0xbb657fa 0xbb65950 0xbb65e19 0x3e6ef 0x390ff 0x4ab1c 0x5fccc96 0x5fcce92 0x5fcd08f 0x5fcd365 0x601ba63 0x601bc69 0x5f9bdb6 0x5f9bf90 0x5f9c51c 0x5de40ab 0x5dfc2ed 0x713a942 0x714c115 0x714d5b2 0x714d637 0x714d739 0x714d831 0x714da3e 0x714dc24 0x714df73 0x714e317 0x714e547 0x714e7b1 0x714ea7e 0x714ec9c 0x714ed54 0x714ee1a 0x714eefb 0x5c46eec 0x5c46ff6 0x5c470b2 0x5c4716e 0x5c4722a 0x5c47377 0x5c47502 0x5c478c3 0x5c616c6 0xbb78627 0xbb904a5 0xbc3dd4f 0xbc3f39d 0xb90dc6d 0xb90e4a5 0x3804428 0x2958f 0x2963f 0x35eb9a4 2024-09-22T03:48:37.353 INFO:teuthology.orchestra.run.smithi037.stderr:kernel callstack: 2024-09-22T03:48:42.019 INFO:teuthology.orchestra.run.smithi037.stderr:----------------------------------------------------- 2024-09-22T03:48:42.019 INFO:teuthology.orchestra.run.smithi037.stderr:Suppressions used: 2024-09-22T03:48:42.019 INFO:teuthology.orchestra.run.smithi037.stderr: count bytes template 2024-09-22T03:48:42.019 INFO:teuthology.orchestra.run.smithi037.stderr: 1 8 MallocExtension::Register 2024-09-22T03:48:42.019 INFO:teuthology.orchestra.run.smithi037.stderr:----------------------------------------------------- 2024-09-22T03:48:42.019 INFO:teuthology.orchestra.run.smithi037.stderr: 2024-09-22T03:48:42.041 DEBUG:teuthology.orchestra.run.smithi037:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-22T03:48:42.067 DEBUG:teuthology.orchestra.run.smithi037:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-22T03:48:42.373 INFO:teuthology.orchestra.run.smithi037.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-22T03:48:42.374 INFO:teuthology.orchestra.run.smithi037.stderr:INFO 2024-09-22 03:48:42,373 seastar - Reactor backend: linux-aio 2024-09-22T03:48:42.379 INFO:teuthology.orchestra.run.smithi037.stderr:==28019==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-22T03:48:42.487 INFO:teuthology.orchestra.run.smithi037.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbc8b6ef 0xbb64079 0xbb655e4 0xbb657fa 0xbb65950 0xbb65e19 0x3e6ef 0x446db 0xfe5da 0x3626869 0x3626983 0x5f9cbca 0x5de40ab 0x5dfc2ed 0x713a942 0x714c115 0x714d5b2 0x714d637 0x714d739 0x714d831 0x714da3e 0x714dc24 0x714df73 0x714e317 0x714e547 0x714e7b1 0x714ea7e 0x714ec9c 0x714ed54 0x714ee1a 0x714eefb 0x5c46eec 0x5c46ff6 0x5c470b2 0x5c4716e 0x5c4722a 0x5c47377 0x5c47502 0x5c478c3 0x5c616c6 0xbb78627 0xbb904a5 0xbc3dd4f 0xbc3f39d 0xb90dc6d 0xb90e4a5 0x3961ae8 0x39632c2 0x3803c18 0x2958f 0x2963f 0x35eb9a4 2024-09-22T03:48:42.487 INFO:teuthology.orchestra.run.smithi037.stderr:kernel callstack: 2024-09-22T03:48:42.512 INFO:teuthology.orchestra.run.smithi037.stderr:INFO 2024-09-22 03:48:42,512 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2024-09-22T03:48:42.512 INFO:teuthology.orchestra.run.smithi037.stderr:INFO 2024-09-22 03:48:42,512 [shard 0:main] osd - get_early_config: set --thread-affinity 1 --cpuset 3-5 2024-09-22T03:48:42.513 INFO:teuthology.orchestra.run.smithi037.stderr:DEBUG 2024-09-22 03:48:42,513 [shard 0:main] seastar - reactor::drain 2024-09-22T03:48:43.042 INFO:teuthology.orchestra.run.smithi037.stderr:----------------------------------------------------- 2024-09-22T03:48:43.042 INFO:teuthology.orchestra.run.smithi037.stderr:Suppressions used: 2024-09-22T03:48:43.042 INFO:teuthology.orchestra.run.smithi037.stderr: count bytes template 2024-09-22T03:48:43.042 INFO:teuthology.orchestra.run.smithi037.stderr: 1 8 MallocExtension::Register 2024-09-22T03:48:43.042 INFO:teuthology.orchestra.run.smithi037.stderr:----------------------------------------------------- 2024-09-22T03:48:43.042 INFO:teuthology.orchestra.run.smithi037.stderr: 2024-09-22T03:48:43.101 INFO:teuthology.orchestra.run.smithi037.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-22T03:48:43.105 INFO:teuthology.orchestra.run.smithi037.stderr:INFO 2024-09-22 03:48:43,104 seastar - Reactor backend: linux-aio 2024-09-22T03:48:43.119 INFO:teuthology.orchestra.run.smithi037.stderr:==28017==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-22T03:48:43.184 INFO:teuthology.orchestra.run.smithi037.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbc8b6ef 0xbb64079 0xbb655e4 0xbb657fa 0xbb65950 0xbb65e19 0x3e6ef 0x10797f 0xdd2e1 0x4ab1c 0x5fccc96 0x5fcceac 0x5fcd08f 0x5fcd365 0x601ba63 0x601bc69 0x5f9bdb6 0x5f9bf90 0x5f9c51c 0x5de40ab 0x5dfc2ed 0x713a942 0x714c115 0x714d5b2 0x714d637 0x714d739 0x714d831 0x714da3e 0x714dc24 0x714df73 0x714e317 0x714e547 0x714e7b1 0x714ea7e 0x714ec9c 0x714ed54 0x714ee1a 0x714eefb 0x5c46eec 0x5c46ff6 0x5c470b2 0x5c4716e 0x5c4722a 0x5c47377 0x5c47502 0x5c478c3 0x5c616c6 0xbb78627 0xbb904a5 0xbc3dd4f 0xbc3f39d 0xb90dc6d 0xb90e4a5 0x3804428 0x2958f 0x2963f 0x35eb9a4 2024-09-22T03:48:43.184 INFO:teuthology.orchestra.run.smithi037.stderr:kernel callstack: 2024-09-22T03:48:48.119 INFO:teuthology.orchestra.run.smithi037.stderr:----------------------------------------------------- 2024-09-22T03:48:48.119 INFO:teuthology.orchestra.run.smithi037.stderr:Suppressions used: 2024-09-22T03:48:48.119 INFO:teuthology.orchestra.run.smithi037.stderr: count bytes template 2024-09-22T03:48:48.119 INFO:teuthology.orchestra.run.smithi037.stderr: 1 8 MallocExtension::Register 2024-09-22T03:48:48.119 INFO:teuthology.orchestra.run.smithi037.stderr:----------------------------------------------------- 2024-09-22T03:48:48.120 INFO:teuthology.orchestra.run.smithi037.stderr: 2024-09-22T03:48:48.142 DEBUG:teuthology.orchestra.run.smithi037:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-22T03:48:48.168 DEBUG:teuthology.orchestra.run.smithi098:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-22T03:48:48.199 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2024-09-22T03:48:48.199 INFO:tasks.ceph:role: osd.2 2024-09-22T03:48:48.199 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi098.front.sepia.ceph.com 2024-09-22T03:48:48.199 DEBUG:teuthology.orchestra.run.smithi098:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-22T03:48:48.275 INFO:teuthology.orchestra.run.smithi098.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-22T03:48:48.275 INFO:teuthology.orchestra.run.smithi098.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-22T03:48:48.275 INFO:teuthology.orchestra.run.smithi098.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-22T03:48:48.275 INFO:teuthology.orchestra.run.smithi098.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-22T03:48:48.275 INFO:teuthology.orchestra.run.smithi098.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-22T03:48:48.275 INFO:teuthology.orchestra.run.smithi098.stdout: = sunit=0 swidth=0 blks 2024-09-22T03:48:48.276 INFO:teuthology.orchestra.run.smithi098.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-22T03:48:48.276 INFO:teuthology.orchestra.run.smithi098.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-22T03:48:48.276 INFO:teuthology.orchestra.run.smithi098.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-22T03:48:48.276 INFO:teuthology.orchestra.run.smithi098.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-22T03:48:48.800 INFO:teuthology.orchestra.run.smithi098.stdout:Discarding blocks...Done. 2024-09-22T03:48:48.802 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi098.front.sepia.ceph.com -o noatime 2024-09-22T03:48:48.802 DEBUG:teuthology.orchestra.run.smithi098:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2024-09-22T03:48:48.934 DEBUG:teuthology.orchestra.run.smithi098:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-22T03:48:48.969 DEBUG:teuthology.orchestra.run.smithi098:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-22T03:48:49.035 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2024-09-22T03:48:49.036 INFO:tasks.ceph:role: osd.3 2024-09-22T03:48:49.036 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi098.front.sepia.ceph.com 2024-09-22T03:48:49.036 DEBUG:teuthology.orchestra.run.smithi098:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-22T03:48:49.111 INFO:teuthology.orchestra.run.smithi098.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-22T03:48:49.111 INFO:teuthology.orchestra.run.smithi098.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-22T03:48:49.111 INFO:teuthology.orchestra.run.smithi098.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-22T03:48:49.111 INFO:teuthology.orchestra.run.smithi098.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-22T03:48:49.111 INFO:teuthology.orchestra.run.smithi098.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-22T03:48:49.111 INFO:teuthology.orchestra.run.smithi098.stdout: = sunit=0 swidth=0 blks 2024-09-22T03:48:49.111 INFO:teuthology.orchestra.run.smithi098.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-22T03:48:49.111 INFO:teuthology.orchestra.run.smithi098.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-22T03:48:49.111 INFO:teuthology.orchestra.run.smithi098.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-22T03:48:49.112 INFO:teuthology.orchestra.run.smithi098.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-22T03:48:49.557 INFO:teuthology.orchestra.run.smithi098.stdout:Discarding blocks...Done. 2024-09-22T03:48:49.559 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi098.front.sepia.ceph.com -o noatime 2024-09-22T03:48:49.559 DEBUG:teuthology.orchestra.run.smithi098:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-3 2024-09-22T03:48:49.650 DEBUG:teuthology.orchestra.run.smithi098:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-22T03:48:49.679 DEBUG:teuthology.orchestra.run.smithi098:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-22T03:48:50.001 INFO:teuthology.orchestra.run.smithi098.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-22T03:48:50.002 INFO:teuthology.orchestra.run.smithi098.stderr:INFO 2024-09-22 03:48:50,001 seastar - Reactor backend: linux-aio 2024-09-22T03:48:50.018 INFO:teuthology.orchestra.run.smithi098.stderr:==27619==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-22T03:48:50.144 INFO:teuthology.orchestra.run.smithi098.stderr:INFO 2024-09-22 03:48:50,144 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2024-09-22T03:48:50.144 INFO:teuthology.orchestra.run.smithi098.stderr:INFO 2024-09-22 03:48:50,144 [shard 0:main] osd - get_early_config: set --thread-affinity 1 --cpuset 0-2 2024-09-22T03:48:50.145 INFO:teuthology.orchestra.run.smithi098.stderr:DEBUG 2024-09-22 03:48:50,145 [shard 0:main] seastar - reactor::drain 2024-09-22T03:48:50.689 INFO:teuthology.orchestra.run.smithi098.stderr:----------------------------------------------------- 2024-09-22T03:48:50.689 INFO:teuthology.orchestra.run.smithi098.stderr:Suppressions used: 2024-09-22T03:48:50.689 INFO:teuthology.orchestra.run.smithi098.stderr: count bytes template 2024-09-22T03:48:50.689 INFO:teuthology.orchestra.run.smithi098.stderr: 1 8 MallocExtension::Register 2024-09-22T03:48:50.689 INFO:teuthology.orchestra.run.smithi098.stderr:----------------------------------------------------- 2024-09-22T03:48:50.689 INFO:teuthology.orchestra.run.smithi098.stderr: 2024-09-22T03:48:50.751 INFO:teuthology.orchestra.run.smithi098.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-22T03:48:50.754 INFO:teuthology.orchestra.run.smithi098.stderr:INFO 2024-09-22 03:48:50,754 seastar - Reactor backend: linux-aio 2024-09-22T03:48:50.764 INFO:teuthology.orchestra.run.smithi098.stderr:==27615==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-22T03:48:50.829 INFO:teuthology.orchestra.run.smithi098.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbc8b6ef 0xbb64079 0xbb655e4 0xbb657fa 0xbb65950 0xbb65e19 0x3e6ef 0x5fccb82 0x5fcceac 0x5fcd08f 0x5fcd365 0x601ba63 0x601bc69 0x5f9bdb6 0x5f9c2ea 0x5de40ab 0x5dfc2ed 0x713a942 0x714c115 0x714d5b2 0x714d637 0x714d739 0x714d831 0x714da3e 0x714dc24 0x714df73 0x714e317 0x714e547 0x714e7b1 0x714ea7e 0x714ec9c 0x714ed54 0x714ee1a 0x714eefb 0x5c46eec 0x5c46ff6 0x5c470b2 0x5c4716e 0x5c4722a 0x5c47377 0x5c47502 0x5c478c3 0x5c616c6 0xbb78627 0xbb904a5 0xbc3dd4f 0xbc3f39d 0xb90dc6d 0xb90e4a5 0x3804428 0x2958f 0x2963f 0x35eb9a4 2024-09-22T03:48:50.829 INFO:teuthology.orchestra.run.smithi098.stderr:kernel callstack: 2024-09-22T03:48:55.435 INFO:teuthology.orchestra.run.smithi098.stderr:----------------------------------------------------- 2024-09-22T03:48:55.435 INFO:teuthology.orchestra.run.smithi098.stderr:Suppressions used: 2024-09-22T03:48:55.435 INFO:teuthology.orchestra.run.smithi098.stderr: count bytes template 2024-09-22T03:48:55.435 INFO:teuthology.orchestra.run.smithi098.stderr: 1 8 MallocExtension::Register 2024-09-22T03:48:55.435 INFO:teuthology.orchestra.run.smithi098.stderr:----------------------------------------------------- 2024-09-22T03:48:55.435 INFO:teuthology.orchestra.run.smithi098.stderr: 2024-09-22T03:48:55.457 DEBUG:teuthology.orchestra.run.smithi098:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-22T03:48:55.482 DEBUG:teuthology.orchestra.run.smithi098:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-22T03:48:55.757 INFO:teuthology.orchestra.run.smithi098.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-22T03:48:55.758 INFO:teuthology.orchestra.run.smithi098.stderr:INFO 2024-09-22 03:48:55,757 seastar - Reactor backend: linux-aio 2024-09-22T03:48:55.763 INFO:teuthology.orchestra.run.smithi098.stderr:==27806==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-22T03:48:55.888 INFO:teuthology.orchestra.run.smithi098.stderr:INFO 2024-09-22 03:48:55,888 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2024-09-22T03:48:55.888 INFO:teuthology.orchestra.run.smithi098.stderr:INFO 2024-09-22 03:48:55,888 [shard 0:main] osd - get_early_config: set --thread-affinity 1 --cpuset 3-5 2024-09-22T03:48:55.889 INFO:teuthology.orchestra.run.smithi098.stderr:DEBUG 2024-09-22 03:48:55,889 [shard 0:main] seastar - reactor::drain 2024-09-22T03:48:56.388 INFO:teuthology.orchestra.run.smithi098.stderr:----------------------------------------------------- 2024-09-22T03:48:56.389 INFO:teuthology.orchestra.run.smithi098.stderr:Suppressions used: 2024-09-22T03:48:56.389 INFO:teuthology.orchestra.run.smithi098.stderr: count bytes template 2024-09-22T03:48:56.389 INFO:teuthology.orchestra.run.smithi098.stderr: 1 8 MallocExtension::Register 2024-09-22T03:48:56.389 INFO:teuthology.orchestra.run.smithi098.stderr:----------------------------------------------------- 2024-09-22T03:48:56.389 INFO:teuthology.orchestra.run.smithi098.stderr: 2024-09-22T03:48:56.443 INFO:teuthology.orchestra.run.smithi098.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-22T03:48:56.447 INFO:teuthology.orchestra.run.smithi098.stderr:INFO 2024-09-22 03:48:56,446 seastar - Reactor backend: linux-aio 2024-09-22T03:48:56.461 INFO:teuthology.orchestra.run.smithi098.stderr:==27804==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-22T03:48:56.526 INFO:teuthology.orchestra.run.smithi098.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbc8b6ef 0xbb64079 0xbb655e4 0xbb657fa 0xbb65950 0xbb65e19 0x3e6ef 0x4ab7c 0x3614433 0x5f9c50a 0x5de40ab 0x5dfc2ed 0x713a942 0x714c115 0x714d5b2 0x714d637 0x714d739 0x714d831 0x714da3e 0x714dc24 0x714df73 0x714e317 0x714e547 0x714e7b1 0x714ea7e 0x714ec9c 0x714ed54 0x714ee1a 0x714eefb 0x5c46eec 0x5c46ff6 0x5c470b2 0x5c4716e 0x5c4722a 0x5c47377 0x5c47502 0x5c478c3 0x5c616c6 0xbb78627 0xbb904a5 0xbc3dd4f 0xbc3f39d 0xb90dc6d 0xb90e4a5 0x3804428 0x2958f 0x2963f 0x35eb9a4 2024-09-22T03:48:56.526 INFO:teuthology.orchestra.run.smithi098.stderr:kernel callstack: 2024-09-22T03:49:01.387 INFO:teuthology.orchestra.run.smithi098.stderr:----------------------------------------------------- 2024-09-22T03:49:01.387 INFO:teuthology.orchestra.run.smithi098.stderr:Suppressions used: 2024-09-22T03:49:01.387 INFO:teuthology.orchestra.run.smithi098.stderr: count bytes template 2024-09-22T03:49:01.387 INFO:teuthology.orchestra.run.smithi098.stderr: 1 8 MallocExtension::Register 2024-09-22T03:49:01.387 INFO:teuthology.orchestra.run.smithi098.stderr:----------------------------------------------------- 2024-09-22T03:49:01.387 INFO:teuthology.orchestra.run.smithi098.stderr: 2024-09-22T03:49:01.408 DEBUG:teuthology.orchestra.run.smithi098:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-22T03:49:01.433 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-22T03:49:01.433 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-22T03:49:01.433 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-22T03:49:01.464 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-22T03:49:01.465 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-22T03:49:01.535 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-22T03:49:01.536 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-22T03:49:01.560 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-22T03:49:01.560 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-22T03:49:01.624 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-22T03:49:01.624 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-22T03:49:01.689 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-22T03:49:01.689 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-22T03:49:01.709 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-22T03:49:01.709 DEBUG:teuthology.orchestra.run.smithi098:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-22T03:49:01.744 INFO:tasks.ceph:Adding keys to all mons... 2024-09-22T03:49:01.744 DEBUG:teuthology.orchestra.run.smithi037:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-22T03:49:01.777 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.0] 2024-09-22T03:49:01.777 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQCVk+9mzKyVGhAA12CQhmzaV2zrw1WWbqwcIA== 2024-09-22T03:49:01.777 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.1] 2024-09-22T03:49:01.777 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQCbk+9mdSF+EBAACpJayEfw20Mmy8LuxFcYQA== 2024-09-22T03:49:01.777 INFO:teuthology.orchestra.run.smithi037.stdout:[mgr.x] 2024-09-22T03:49:01.777 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQCSk+9mtaAlIxAAHpFkm5M27yH1R1OCiLsPnA== 2024-09-22T03:49:01.777 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.2] 2024-09-22T03:49:01.777 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQCik+9mIekvNhAAoAwXZYiy58Ssgc/C/53Qaw== 2024-09-22T03:49:01.777 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.3] 2024-09-22T03:49:01.777 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQCok+9mq4hpJBAApCS3w8/c5qKg9/P/EOEGCQ== 2024-09-22T03:49:01.777 INFO:teuthology.orchestra.run.smithi037.stdout:[client.0] 2024-09-22T03:49:01.778 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQCSk+9mxzJgJhAAOq9IIqDrjm27E0XHIn13HA== 2024-09-22T03:49:01.778 INFO:teuthology.orchestra.run.smithi037.stdout:[client.1] 2024-09-22T03:49:01.778 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQCSk+9mZj0qKhAAezn+Ac3BWcI2yQvCFJqgaw== 2024-09-22T03:49:01.778 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-22T03:49:01.890 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-22T03:49:01.955 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-22T03:49:02.017 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-22T03:49:02.079 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-22T03:49:02.141 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-22T03:49:02.208 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-22T03:49:02.274 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-22T03:49:02.274 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-22T03:49:02.299 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-22T03:49:02.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:49:02.411+0000 7f37aed2ac00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:02.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:49:02.411+0000 7f37aed2ac00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:02.426 DEBUG:teuthology.orchestra.run.smithi037:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-22T03:49:02.451 DEBUG:teuthology.orchestra.run.smithi037:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-22T03:49:02.506 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-22T03:49:02.507 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-22T03:49:02.507 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-22T03:49:02.549 INFO:tasks.ceph.mon.a:Started 2024-09-22T03:49:02.549 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-22T03:49:02.550 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-22T03:49:02.550 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-22T03:49:02.552 INFO:tasks.ceph.mgr.x:Started 2024-09-22T03:49:02.552 DEBUG:tasks.ceph:set 0 configs 2024-09-22T03:49:02.553 INFO:tasks.ceph:Setting crush tunables to default 2024-09-22T03:49:02.553 DEBUG:teuthology.orchestra.run.smithi037:> sudo ceph --cluster ceph osd crush tunables default 2024-09-22T03:49:02.632 INFO:tasks.ceph.mon.a.smithi037.stderr:2024-09-22T03:49:02.631+0000 7fe814a67c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:02.633 INFO:tasks.ceph.mon.a.smithi037.stderr:2024-09-22T03:49:02.631+0000 7fe814a67c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:02.633 INFO:tasks.ceph.mon.a.smithi037.stderr:2024-09-22T03:49:02.631+0000 7fe814a67c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:02.656 INFO:tasks.ceph.mgr.x.smithi098.stderr:2024-09-22T03:49:02.655+0000 7f6fe63cf000 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:02.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:49:02.657+0000 7ff648991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:02.668 INFO:tasks.ceph.mgr.x.smithi098.stderr:2024-09-22T03:49:02.667+0000 7f6fe63cf000 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:02.668 INFO:tasks.ceph.mgr.x.smithi098.stderr:2024-09-22T03:49:02.667+0000 7f6fe63cf000 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:02.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:49:02.668+0000 7ff648991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:02.743 INFO:teuthology.orchestra.run.smithi037.stderr:adjusted tunables profile to default 2024-09-22T03:49:02.755 INFO:tasks.ceph:check_enable_crimson: True 2024-09-22T03:49:02.755 INFO:tasks.ceph:check_enable_crimson: setting set-allow-crimson 2024-09-22T03:49:02.755 DEBUG:teuthology.orchestra.run.smithi037:> sudo ceph --cluster ceph osd set-allow-crimson --yes-i-really-mean-it 2024-09-22T03:49:02.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:49:02.859+0000 7f1aa1b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:02.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:49:02.868+0000 7f1aa1b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:02.952 INFO:tasks.ceph.mon.a.smithi037.stderr:2024-09-22T03:49:02.951+0000 7fe80b3f4640 -1 WARNING: experimental feature 'crimson' is enabled 2024-09-22T03:49:02.952 INFO:tasks.ceph.mon.a.smithi037.stderr:Please be aware that this feature is experimental, untested, 2024-09-22T03:49:02.952 INFO:tasks.ceph.mon.a.smithi037.stderr:unsupported, and may result in data corruption, data loss, 2024-09-22T03:49:02.952 INFO:tasks.ceph.mon.a.smithi037.stderr:and/or irreparable damage to your cluster. Do not use 2024-09-22T03:49:02.953 INFO:tasks.ceph.mon.a.smithi037.stderr:feature with important data. 2024-09-22T03:49:02.953 INFO:tasks.ceph.mon.a.smithi037.stderr: 2024-09-22T03:49:03.760 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-22T03:49:03.760 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-22T03:49:03.760 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-22T03:49:03.790 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-22T03:49:03.790 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-22T03:49:03.858 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-22T03:49:03.859 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-22T03:49:03.884 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-22T03:49:03.884 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-22T03:49:03.949 DEBUG:teuthology.orchestra.run.smithi098:> sudo ceph --cluster ceph osd new 69ea14de-3fb4-408e-a111-1ad6fe1b1c18 0 2024-09-22T03:49:04.097 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-22T03:49:04.090+0000 7f8caf791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:04.100 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-22T03:49:04.100+0000 7f8caf791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:04.179 INFO:teuthology.orchestra.run.smithi098.stdout:0 2024-09-22T03:49:04.191 DEBUG:teuthology.orchestra.run.smithi098:> sudo ceph --cluster ceph osd new 868fe8cf-1915-4ae9-929b-c256a587d2ec 1 2024-09-22T03:49:04.300 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-22T03:49:04.293+0000 7f1d08b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:04.303 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-22T03:49:04.302+0000 7f1d08b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:04.379 INFO:teuthology.orchestra.run.smithi098.stdout:1 2024-09-22T03:49:04.390 DEBUG:teuthology.orchestra.run.smithi098:> sudo ceph --cluster ceph osd new 68d5f134-2d34-4808-8747-59a974df8bd4 2 2024-09-22T03:49:04.499 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-22T03:49:04.491+0000 7fdfe1791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:04.501 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-22T03:49:04.501+0000 7fdfe1791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:04.580 INFO:teuthology.orchestra.run.smithi098.stdout:2 2024-09-22T03:49:04.591 DEBUG:teuthology.orchestra.run.smithi098:> sudo ceph --cluster ceph osd new 9f81fabd-2b76-42a1-9e97-fc2087b5d32c 3 2024-09-22T03:49:04.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-22T03:49:04.692+0000 7f2e0c311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:04.702 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-22T03:49:04.701+0000 7f2e0c311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:04.781 INFO:teuthology.orchestra.run.smithi098.stdout:3 2024-09-22T03:49:04.793 DEBUG:teuthology.orchestra.run.smithi037:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.0.log 2024-09-22T03:49:04.829 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-22T03:49:04.830 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2>> /var/log/ceph/ceph-osd.0.log 2024-09-22T03:49:04.872 INFO:tasks.ceph.osd.0:Started 2024-09-22T03:49:04.873 DEBUG:teuthology.orchestra.run.smithi037:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.1.log 2024-09-22T03:49:04.906 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-22T03:49:04.906 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2>> /var/log/ceph/ceph-osd.1.log 2024-09-22T03:49:04.955 INFO:tasks.ceph.osd.1:Started 2024-09-22T03:49:04.955 DEBUG:teuthology.orchestra.run.smithi098:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.2.log 2024-09-22T03:49:04.991 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-22T03:49:04.991 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2>> /var/log/ceph/ceph-osd.2.log 2024-09-22T03:49:05.043 INFO:tasks.ceph.osd.2:Started 2024-09-22T03:49:05.044 DEBUG:teuthology.orchestra.run.smithi098:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.3.log 2024-09-22T03:49:05.078 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-22T03:49:05.078 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2>> /var/log/ceph/ceph-osd.3.log 2024-09-22T03:49:05.133 INFO:tasks.ceph.osd.3:Started 2024-09-22T03:49:05.134 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-22T03:49:05.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:49:05.262+0000 7fcacb991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:05.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:49:05.271+0000 7fcacb991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:05.410 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:49:05.410 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":7,"fsid":"9eda29d9-a2b0-48de-a9bc-7b5579d66932","created":"2024-09-22T03:49:02.654999+0000","modified":"2024-09-22T03:49:04.779488+0000","last_up_change":"0.000000","last_in_change":"2024-09-22T03:49:04.779488+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"69ea14de-3fb4-408e-a111-1ad6fe1b1c18","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"868fe8cf-1915-4ae9-929b-c256a587d2ec","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"68d5f134-2d34-4808-8747-59a974df8bd4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"9f81fabd-2b76-42a1-9e97-fc2087b5d32c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-22T03:49:05.425 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-22T03:49:05.425 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-22T03:49:05.828 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-22T03:49:05.937 INFO:teuthology.misc.health.smithi037.stderr:2024-09-22T03:49:05.930+0000 7fd07b6e3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:05.941 INFO:teuthology.misc.health.smithi037.stderr:2024-09-22T03:49:05.940+0000 7fd07b6e3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:06.014 INFO:teuthology.misc.health.smithi037.stdout: 2024-09-22T03:49:06.014 INFO:teuthology.misc.health.smithi037.stdout:{"epoch":7,"fsid":"9eda29d9-a2b0-48de-a9bc-7b5579d66932","created":"2024-09-22T03:49:02.654999+0000","modified":"2024-09-22T03:49:04.779488+0000","last_up_change":"0.000000","last_in_change":"2024-09-22T03:49:04.779488+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"69ea14de-3fb4-408e-a111-1ad6fe1b1c18","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"868fe8cf-1915-4ae9-929b-c256a587d2ec","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"68d5f134-2d34-4808-8747-59a974df8bd4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"9f81fabd-2b76-42a1-9e97-fc2087b5d32c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-22T03:49:06.024 DEBUG:teuthology.misc:0 of 4 OSDs are up 2024-09-22T03:49:07.967 INFO:tasks.ceph.mgr.x.smithi098.stderr:2024-09-22T03:49:07.966+0000 7f6f8359e640 -1 mgr.server handle_report got status from non-daemon mon.a 2024-09-22T03:49:12.429 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-22T03:49:12.547 INFO:teuthology.misc.health.smithi037.stderr:2024-09-22T03:49:12.541+0000 7f78868a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:12.553 INFO:teuthology.misc.health.smithi037.stderr:2024-09-22T03:49:12.552+0000 7f78868a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:12.773 INFO:teuthology.misc.health.smithi037.stdout: 2024-09-22T03:49:12.773 INFO:teuthology.misc.health.smithi037.stdout:{"epoch":11,"fsid":"9eda29d9-a2b0-48de-a9bc-7b5579d66932","created":"2024-09-22T03:49:02.654999+0000","modified":"2024-09-22T03:49:11.985020+0000","last_up_change":"2024-09-22T03:49:10.979949+0000","last_in_change":"2024-09-22T03:49:04.779488+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-22T03:49:10.979703+0000","flags":294945,"flags_names":"hashpspool,nopgchange,creating,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.75,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"69ea14de-3fb4-408e-a111-1ad6fe1b1c18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":2258804031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6801","nonce":2258804031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":2258804031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6803","nonce":2258804031}]},"public_addr":"172.21.15.37:6800/2258804031","cluster_addr":"172.21.15.37:6801/2258804031","heartbeat_back_addr":"172.21.15.37:6802/2258804031","heartbeat_front_addr":"172.21.15.37:6803/2258804031","state":["exists","up"]},{"osd":1,"uuid":"868fe8cf-1915-4ae9-929b-c256a587d2ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1511839425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6807","nonce":1511839425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1511839425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6805","nonce":1511839425}]},"public_addr":"172.21.15.37:6808/1511839425","cluster_addr":"172.21.15.37:6807/1511839425","heartbeat_back_addr":"172.21.15.37:6804/1511839425","heartbeat_front_addr":"172.21.15.37:6805/1511839425","state":["exists","up"]},{"osd":2,"uuid":"68d5f134-2d34-4808-8747-59a974df8bd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":1340825941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6803","nonce":1340825941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":1340825941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6809","nonce":1340825941}]},"public_addr":"172.21.15.98:6804/1340825941","cluster_addr":"172.21.15.98:6803/1340825941","heartbeat_back_addr":"172.21.15.98:6808/1340825941","heartbeat_front_addr":"172.21.15.98:6809/1340825941","state":["exists","up"]},{"osd":3,"uuid":"9f81fabd-2b76-42a1-9e97-fc2087b5d32c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6805","nonce":3037275240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":3037275240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6807","nonce":3037275240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":3037275240}]},"public_addr":"172.21.15.98:6805/3037275240","cluster_addr":"172.21.15.98:6802/3037275240","heartbeat_back_addr":"172.21.15.98:6807/3037275240","heartbeat_front_addr":"172.21.15.98:6806/3037275240","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-22T03:49:12.788 DEBUG:teuthology.misc:4 of 4 OSDs are up 2024-09-22T03:49:12.788 INFO:tasks.ceph:Creating RBD pool 2024-09-22T03:49:12.788 DEBUG:teuthology.orchestra.run.smithi037:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-22T03:49:12.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:49:12.897+0000 7efe2f991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:12.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:49:12.909+0000 7efe2f991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:13.997 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'rbd' created 2024-09-22T03:49:14.019 DEBUG:teuthology.orchestra.run.smithi037:> rbd --cluster ceph pool init rbd 2024-09-22T03:49:14.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:49:14.142+0000 7fcf9dad2ac0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:14.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:49:14.142+0000 7fcf9dad2ac0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:14.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:49:14.148+0000 7fcf9dad2ac0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:17.051 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-22T03:49:17.051 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-22T03:49:17.052 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-22T03:49:17.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:49:17.165+0000 7faee16a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:17.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:49:17.175+0000 7faee16a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:17.376 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:49:17.389 INFO:teuthology.orchestra.run.smithi037.stdout:[{"version":1,"timestamp":"0.000000","name":"","changes":[]}] 2024-09-22T03:49:17.389 INFO:tasks.ceph_manager:config epoch is 1 2024-09-22T03:49:17.390 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-22T03:49:17.390 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-22T03:49:17.390 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-22T03:49:17.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:49:17.498+0000 7f631dc46640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:17.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:49:17.506+0000 7f631dc46640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:17.761 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:49:17.773 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":5,"flags":0,"active_gid":4100,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":2763640642},{"type":"v1","addr":"172.21.15.98:6801","nonce":2763640642}]},"active_addr":"172.21.15.98:6801/2763640642","active_change":"2024-09-22T03:49:06.956539+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.8","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.98:0","nonce":2498729050}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.98:0","nonce":2509253152}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.98:0","nonce":442014797}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.98:0","nonce":1252726127}]}]} 2024-09-22T03:49:17.775 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-22T03:49:17.775 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-22T03:49:17.775 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-22T03:49:17.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:49:17.883+0000 7f5cc8ed1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:17.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:49:17.892+0000 7f5cc8ed1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:18.094 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:49:18.094 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":16,"fsid":"9eda29d9-a2b0-48de-a9bc-7b5579d66932","created":"2024-09-22T03:49:02.654999+0000","modified":"2024-09-22T03:49:17.011637+0000","last_up_change":"2024-09-22T03:49:10.979949+0000","last_in_change":"2024-09-22T03:49:04.779488+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-22T03:49:10.979703+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.75,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-22T03:49:13.119488+0000","flags":270369,"flags_names":"hashpspool,nopgchange,selfmanaged_snaps,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":16,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"69ea14de-3fb4-408e-a111-1ad6fe1b1c18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":2258804031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6801","nonce":2258804031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":2258804031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6803","nonce":2258804031}]},"public_addr":"172.21.15.37:6800/2258804031","cluster_addr":"172.21.15.37:6801/2258804031","heartbeat_back_addr":"172.21.15.37:6802/2258804031","heartbeat_front_addr":"172.21.15.37:6803/2258804031","state":["exists","up"]},{"osd":1,"uuid":"868fe8cf-1915-4ae9-929b-c256a587d2ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1511839425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6807","nonce":1511839425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1511839425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6805","nonce":1511839425}]},"public_addr":"172.21.15.37:6808/1511839425","cluster_addr":"172.21.15.37:6807/1511839425","heartbeat_back_addr":"172.21.15.37:6804/1511839425","heartbeat_front_addr":"172.21.15.37:6805/1511839425","state":["exists","up"]},{"osd":2,"uuid":"68d5f134-2d34-4808-8747-59a974df8bd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":1340825941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6803","nonce":1340825941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":1340825941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6809","nonce":1340825941}]},"public_addr":"172.21.15.98:6804/1340825941","cluster_addr":"172.21.15.98:6803/1340825941","heartbeat_back_addr":"172.21.15.98:6808/1340825941","heartbeat_front_addr":"172.21.15.98:6809/1340825941","state":["exists","up"]},{"osd":3,"uuid":"9f81fabd-2b76-42a1-9e97-fc2087b5d32c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6805","nonce":3037275240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":3037275240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6807","nonce":3037275240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":3037275240}]},"public_addr":"172.21.15.98:6805/3037275240","cluster_addr":"172.21.15.98:6802/3037275240","heartbeat_back_addr":"172.21.15.98:6807/3037275240","heartbeat_front_addr":"172.21.15.98:6806/3037275240","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-22T03:49:18.107 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-22T03:49:18.107 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-22T03:49:18.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:49:18.215+0000 7f95e0d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:18.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:49:18.224+0000 7f95e0d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:18.428 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:49:18.428 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":16,"fsid":"9eda29d9-a2b0-48de-a9bc-7b5579d66932","created":"2024-09-22T03:49:02.654999+0000","modified":"2024-09-22T03:49:17.011637+0000","last_up_change":"2024-09-22T03:49:10.979949+0000","last_in_change":"2024-09-22T03:49:04.779488+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-22T03:49:10.979703+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.75,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-22T03:49:13.119488+0000","flags":270369,"flags_names":"hashpspool,nopgchange,selfmanaged_snaps,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":16,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"69ea14de-3fb4-408e-a111-1ad6fe1b1c18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":2258804031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6801","nonce":2258804031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":2258804031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6803","nonce":2258804031}]},"public_addr":"172.21.15.37:6800/2258804031","cluster_addr":"172.21.15.37:6801/2258804031","heartbeat_back_addr":"172.21.15.37:6802/2258804031","heartbeat_front_addr":"172.21.15.37:6803/2258804031","state":["exists","up"]},{"osd":1,"uuid":"868fe8cf-1915-4ae9-929b-c256a587d2ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1511839425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6807","nonce":1511839425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1511839425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6805","nonce":1511839425}]},"public_addr":"172.21.15.37:6808/1511839425","cluster_addr":"172.21.15.37:6807/1511839425","heartbeat_back_addr":"172.21.15.37:6804/1511839425","heartbeat_front_addr":"172.21.15.37:6805/1511839425","state":["exists","up"]},{"osd":2,"uuid":"68d5f134-2d34-4808-8747-59a974df8bd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":1340825941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6803","nonce":1340825941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":1340825941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6809","nonce":1340825941}]},"public_addr":"172.21.15.98:6804/1340825941","cluster_addr":"172.21.15.98:6803/1340825941","heartbeat_back_addr":"172.21.15.98:6808/1340825941","heartbeat_front_addr":"172.21.15.98:6809/1340825941","state":["exists","up"]},{"osd":3,"uuid":"9f81fabd-2b76-42a1-9e97-fc2087b5d32c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6805","nonce":3037275240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":3037275240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6807","nonce":3037275240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":3037275240}]},"public_addr":"172.21.15.98:6805/3037275240","cluster_addr":"172.21.15.98:6802/3037275240","heartbeat_back_addr":"172.21.15.98:6807/3037275240","heartbeat_front_addr":"172.21.15.98:6806/3037275240","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-22T03:49:18.441 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-22T03:49:18.441 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-22T03:49:18.442 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-22T03:49:18.442 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-22T03:49:18.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:49:18.562+0000 7f54a8511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:18.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:49:18.562+0000 7f3af70bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:18.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:49:18.562+0000 7f1be56d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:18.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:49:18.562+0000 7efc6069c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:18.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:49:18.573+0000 7f1be56d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:18.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:49:18.573+0000 7f3af70bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:18.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:49:18.574+0000 7efc6069c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:18.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:49:18.574+0000 7f54a8511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:18.608 INFO:teuthology.orchestra.run.smithi037.stdout:42949672967 2024-09-22T03:49:18.608 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-22T03:49:18.613 INFO:teuthology.orchestra.run.smithi037.stdout:38654705672 2024-09-22T03:49:18.613 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-22T03:49:18.614 INFO:teuthology.orchestra.run.smithi037.stdout:38654705672 2024-09-22T03:49:18.614 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-22T03:49:18.615 INFO:teuthology.orchestra.run.smithi037.stdout:38654705672 2024-09-22T03:49:18.615 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-22T03:49:18.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:49:18.723+0000 7f24c0191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:18.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:49:18.737+0000 7f24c0191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:18.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:49:18.769+0000 7f5dce148640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:18.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:49:18.770+0000 7f856186c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:18.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:49:18.773+0000 7f28e9151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:18.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:49:18.780+0000 7f5dce148640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:18.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:49:18.780+0000 7f856186c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:18.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:49:18.784+0000 7f28e9151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:18.970 INFO:teuthology.orchestra.run.smithi037.stdout:42949672965 2024-09-22T03:49:18.988 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672967 got 42949672965 for osd.1 2024-09-22T03:49:18.992 INFO:teuthology.orchestra.run.smithi037.stdout:38654705669 2024-09-22T03:49:19.006 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705672 got 38654705669 for osd.2 2024-09-22T03:49:19.012 INFO:teuthology.orchestra.run.smithi037.stdout:38654705669 2024-09-22T03:49:19.015 INFO:teuthology.orchestra.run.smithi037.stdout:38654705669 2024-09-22T03:49:19.026 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705672 got 38654705669 for osd.0 2024-09-22T03:49:19.030 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705672 got 38654705669 for osd.3 2024-09-22T03:49:19.989 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-22T03:49:20.007 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-22T03:49:20.027 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-22T03:49:20.030 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-22T03:49:20.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:49:20.120+0000 7f2c3984f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:20.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:49:20.133+0000 7f2c3984f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:20.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:49:20.156+0000 7f2eb9511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:20.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:49:20.160+0000 7f05de24f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:20.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:49:20.160+0000 7f924fd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:20.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:49:20.167+0000 7f2eb9511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:20.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:49:20.171+0000 7f05de24f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:20.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:49:20.172+0000 7f924fd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:20.371 INFO:teuthology.orchestra.run.smithi037.stdout:42949672967 2024-09-22T03:49:20.372 INFO:teuthology.orchestra.run.smithi037.stdout:38654705672 2024-09-22T03:49:20.386 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672967 got 42949672967 for osd.1 2024-09-22T03:49:20.386 DEBUG:teuthology.parallel:result is None 2024-09-22T03:49:20.386 INFO:teuthology.orchestra.run.smithi037.stdout:38654705672 2024-09-22T03:49:20.388 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705672 got 38654705672 for osd.0 2024-09-22T03:49:20.389 DEBUG:teuthology.parallel:result is None 2024-09-22T03:49:20.400 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705672 got 38654705672 for osd.2 2024-09-22T03:49:20.400 DEBUG:teuthology.parallel:result is None 2024-09-22T03:49:20.406 INFO:teuthology.orchestra.run.smithi037.stdout:38654705672 2024-09-22T03:49:20.419 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705672 got 38654705672 for osd.3 2024-09-22T03:49:20.419 DEBUG:teuthology.parallel:result is None 2024-09-22T03:49:20.419 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-22T03:49:20.419 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:49:20.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:49:20.569+0000 7f540fd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:20.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:49:20.577+0000 7f540fd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:20.778 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:49:20.778 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-22T03:49:20.790 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":14,"stamp":"2024-09-22T03:49:18.964243+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":108048,"kb_used_data":720,"kb_used_omap":0,"kb_used_meta":107264,"kb_avail":377379312,"statfs":{"total":386547056640,"available":386436415488,"internally_reserved":0,"allocated":737280,"data_stored":1917593,"data_compressed":90168,"data_compressed_allocated":122880,"data_compressed_original":1720320,"omap_allocated":0,"internal_metadata":109838336},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.904298"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-22T03:49:17.024731+0000","last_change":"2024-09-22T03:49:17.029128+0000","last_active":"2024-09-22T03:49:17.024731+0000","last_peered":"2024-09-22T03:49:17.024731+0000","last_clean":"2024-09-22T03:49:17.024731+0000","last_became_active":"2024-09-22T03:49:15.113396+0000","last_became_peered":"2024-09-22T03:49:15.113396+0000","last_unstale":"2024-09-22T03:49:17.024731+0000","last_undegraded":"2024-09-22T03:49:17.024731+0000","last_fullsized":"2024-09-22T03:49:17.024731+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-22T03:49:17.034122+0000","last_change":"2024-09-22T03:49:17.036402+0000","last_active":"2024-09-22T03:49:17.034122+0000","last_peered":"2024-09-22T03:49:17.034122+0000","last_clean":"2024-09-22T03:49:17.034122+0000","last_became_active":"2024-09-22T03:49:15.108430+0000","last_became_peered":"2024-09-22T03:49:15.108430+0000","last_unstale":"2024-09-22T03:49:17.034122+0000","last_undegraded":"2024-09-22T03:49:17.034122+0000","last_fullsized":"2024-09-22T03:49:17.034122+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-22T03:49:17.028396+0000","last_change":"2024-09-22T03:49:17.032989+0000","last_active":"2024-09-22T03:49:17.028396+0000","last_peered":"2024-09-22T03:49:17.028396+0000","last_clean":"2024-09-22T03:49:17.028396+0000","last_became_active":"2024-09-22T03:49:15.079260+0000","last_became_peered":"2024-09-22T03:49:15.079260+0000","last_unstale":"2024-09-22T03:49:17.028396+0000","last_undegraded":"2024-09-22T03:49:17.028396+0000","last_fullsized":"2024-09-22T03:49:17.028396+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-22T03:49:17.034237+0000","last_change":"2024-09-22T03:49:17.036954+0000","last_active":"2024-09-22T03:49:17.034237+0000","last_peered":"2024-09-22T03:49:17.034237+0000","last_clean":"2024-09-22T03:49:17.034237+0000","last_became_active":"2024-09-22T03:49:15.110506+0000","last_became_peered":"2024-09-22T03:49:15.110506+0000","last_unstale":"2024-09-22T03:49:17.034237+0000","last_undegraded":"2024-09-22T03:49:17.034237+0000","last_fullsized":"2024-09-22T03:49:17.034237+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":18,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-22T03:49:17.031466+0000","last_change":"2024-09-22T03:49:17.031466+0000","last_active":"2024-09-22T03:49:17.031466+0000","last_peered":"2024-09-22T03:49:17.031466+0000","last_clean":"2024-09-22T03:49:17.031466+0000","last_became_active":"2024-09-22T03:49:15.098420+0000","last_became_peered":"2024-09-22T03:49:15.098420+0000","last_unstale":"2024-09-22T03:49:17.031466+0000","last_undegraded":"2024-09-22T03:49:17.031466+0000","last_fullsized":"2024-09-22T03:49:17.031466+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-22T03:49:17.026432+0000","last_change":"2024-09-22T03:49:17.029349+0000","last_active":"2024-09-22T03:49:17.026432+0000","last_peered":"2024-09-22T03:49:17.026432+0000","last_clean":"2024-09-22T03:49:17.026432+0000","last_became_active":"2024-09-22T03:49:15.094890+0000","last_became_peered":"2024-09-22T03:49:15.094890+0000","last_unstale":"2024-09-22T03:49:17.026432+0000","last_undegraded":"2024-09-22T03:49:17.026432+0000","last_fullsized":"2024-09-22T03:49:17.026432+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-22T03:49:17.023982+0000","last_change":"2024-09-22T03:49:17.029339+0000","last_active":"2024-09-22T03:49:17.023982+0000","last_peered":"2024-09-22T03:49:17.023982+0000","last_clean":"2024-09-22T03:49:17.023982+0000","last_became_active":"2024-09-22T03:49:15.097304+0000","last_became_peered":"2024-09-22T03:49:15.097304+0000","last_unstale":"2024-09-22T03:49:17.023982+0000","last_undegraded":"2024-09-22T03:49:17.023982+0000","last_fullsized":"2024-09-22T03:49:17.023982+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":17,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-22T03:49:17.029301+0000","last_change":"2024-09-22T03:49:17.031458+0000","last_active":"2024-09-22T03:49:17.029301+0000","last_peered":"2024-09-22T03:49:17.029301+0000","last_clean":"2024-09-22T03:49:17.029301+0000","last_became_active":"2024-09-22T03:49:15.125490+0000","last_became_peered":"2024-09-22T03:49:15.125490+0000","last_unstale":"2024-09-22T03:49:17.029301+0000","last_undegraded":"2024-09-22T03:49:17.029301+0000","last_fullsized":"2024-09-22T03:49:17.029301+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":91,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-22T03:49:17.030686+0000","last_change":"2024-09-22T03:49:12.034704+0000","last_active":"2024-09-22T03:49:17.030686+0000","last_peered":"2024-09-22T03:49:17.030686+0000","last_clean":"2024-09-22T03:49:17.030686+0000","last_became_active":"2024-09-22T03:49:12.027470+0000","last_became_peered":"2024-09-22T03:49:12.027470+0000","last_unstale":"2024-09-22T03:49:17.030686+0000","last_undegraded":"2024-09-22T03:49:17.030686+0000","last_fullsized":"2024-09-22T03:49:17.030686+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_clean_scrub_stamp":"2024-09-22T03:49:10.979949+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949672967,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27028,"kb_used_data":196,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344812,"statfs":{"total":96636764160,"available":96609087488,"internally_reserved":0,"allocated":200704,"data_stored":626995,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654705672,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":26968,"kb_used_data":136,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344872,"statfs":{"total":96636764160,"available":96609148928,"internally_reserved":0,"allocated":139264,"data_stored":36627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705672,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27028,"kb_used_data":196,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344812,"statfs":{"total":96636764160,"available":96609087488,"internally_reserved":0,"allocated":200704,"data_stored":626995,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705672,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27024,"kb_used_data":192,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344816,"statfs":{"total":96636764160,"available":96609091584,"internally_reserved":0,"allocated":196608,"data_stored":626976,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:49:20.791 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:49:20.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:49:20.899+0000 7f7027191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:20.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:49:20.907+0000 7f7027191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:21.111 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:49:21.111 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-22T03:49:21.124 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":15,"stamp":"2024-09-22T03:49:20.964730+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":108048,"kb_used_data":720,"kb_used_omap":0,"kb_used_meta":107264,"kb_avail":377379312,"statfs":{"total":386547056640,"available":386436415488,"internally_reserved":0,"allocated":737280,"data_stored":1917593,"data_compressed":90168,"data_compressed_allocated":122880,"data_compressed_original":1720320,"omap_allocated":0,"internal_metadata":109838336},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.904785"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-22T03:49:17.024731+0000","last_change":"2024-09-22T03:49:17.029128+0000","last_active":"2024-09-22T03:49:17.024731+0000","last_peered":"2024-09-22T03:49:17.024731+0000","last_clean":"2024-09-22T03:49:17.024731+0000","last_became_active":"2024-09-22T03:49:15.113396+0000","last_became_peered":"2024-09-22T03:49:15.113396+0000","last_unstale":"2024-09-22T03:49:17.024731+0000","last_undegraded":"2024-09-22T03:49:17.024731+0000","last_fullsized":"2024-09-22T03:49:17.024731+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-22T03:49:17.034122+0000","last_change":"2024-09-22T03:49:17.036402+0000","last_active":"2024-09-22T03:49:17.034122+0000","last_peered":"2024-09-22T03:49:17.034122+0000","last_clean":"2024-09-22T03:49:17.034122+0000","last_became_active":"2024-09-22T03:49:15.108430+0000","last_became_peered":"2024-09-22T03:49:15.108430+0000","last_unstale":"2024-09-22T03:49:17.034122+0000","last_undegraded":"2024-09-22T03:49:17.034122+0000","last_fullsized":"2024-09-22T03:49:17.034122+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-22T03:49:17.028396+0000","last_change":"2024-09-22T03:49:17.032989+0000","last_active":"2024-09-22T03:49:17.028396+0000","last_peered":"2024-09-22T03:49:17.028396+0000","last_clean":"2024-09-22T03:49:17.028396+0000","last_became_active":"2024-09-22T03:49:15.079260+0000","last_became_peered":"2024-09-22T03:49:15.079260+0000","last_unstale":"2024-09-22T03:49:17.028396+0000","last_undegraded":"2024-09-22T03:49:17.028396+0000","last_fullsized":"2024-09-22T03:49:17.028396+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-22T03:49:17.034237+0000","last_change":"2024-09-22T03:49:17.036954+0000","last_active":"2024-09-22T03:49:17.034237+0000","last_peered":"2024-09-22T03:49:17.034237+0000","last_clean":"2024-09-22T03:49:17.034237+0000","last_became_active":"2024-09-22T03:49:15.110506+0000","last_became_peered":"2024-09-22T03:49:15.110506+0000","last_unstale":"2024-09-22T03:49:17.034237+0000","last_undegraded":"2024-09-22T03:49:17.034237+0000","last_fullsized":"2024-09-22T03:49:17.034237+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":18,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-22T03:49:17.031466+0000","last_change":"2024-09-22T03:49:17.031466+0000","last_active":"2024-09-22T03:49:17.031466+0000","last_peered":"2024-09-22T03:49:17.031466+0000","last_clean":"2024-09-22T03:49:17.031466+0000","last_became_active":"2024-09-22T03:49:15.098420+0000","last_became_peered":"2024-09-22T03:49:15.098420+0000","last_unstale":"2024-09-22T03:49:17.031466+0000","last_undegraded":"2024-09-22T03:49:17.031466+0000","last_fullsized":"2024-09-22T03:49:17.031466+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-22T03:49:17.026432+0000","last_change":"2024-09-22T03:49:17.029349+0000","last_active":"2024-09-22T03:49:17.026432+0000","last_peered":"2024-09-22T03:49:17.026432+0000","last_clean":"2024-09-22T03:49:17.026432+0000","last_became_active":"2024-09-22T03:49:15.094890+0000","last_became_peered":"2024-09-22T03:49:15.094890+0000","last_unstale":"2024-09-22T03:49:17.026432+0000","last_undegraded":"2024-09-22T03:49:17.026432+0000","last_fullsized":"2024-09-22T03:49:17.026432+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-22T03:49:17.023982+0000","last_change":"2024-09-22T03:49:17.029339+0000","last_active":"2024-09-22T03:49:17.023982+0000","last_peered":"2024-09-22T03:49:17.023982+0000","last_clean":"2024-09-22T03:49:17.023982+0000","last_became_active":"2024-09-22T03:49:15.097304+0000","last_became_peered":"2024-09-22T03:49:15.097304+0000","last_unstale":"2024-09-22T03:49:17.023982+0000","last_undegraded":"2024-09-22T03:49:17.023982+0000","last_fullsized":"2024-09-22T03:49:17.023982+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":17,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-22T03:49:17.029301+0000","last_change":"2024-09-22T03:49:17.031458+0000","last_active":"2024-09-22T03:49:17.029301+0000","last_peered":"2024-09-22T03:49:17.029301+0000","last_clean":"2024-09-22T03:49:17.029301+0000","last_became_active":"2024-09-22T03:49:15.125490+0000","last_became_peered":"2024-09-22T03:49:15.125490+0000","last_unstale":"2024-09-22T03:49:17.029301+0000","last_undegraded":"2024-09-22T03:49:17.029301+0000","last_fullsized":"2024-09-22T03:49:17.029301+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":91,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-22T03:49:17.030686+0000","last_change":"2024-09-22T03:49:12.034704+0000","last_active":"2024-09-22T03:49:17.030686+0000","last_peered":"2024-09-22T03:49:17.030686+0000","last_clean":"2024-09-22T03:49:17.030686+0000","last_became_active":"2024-09-22T03:49:12.027470+0000","last_became_peered":"2024-09-22T03:49:12.027470+0000","last_unstale":"2024-09-22T03:49:17.030686+0000","last_undegraded":"2024-09-22T03:49:17.030686+0000","last_fullsized":"2024-09-22T03:49:17.030686+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_clean_scrub_stamp":"2024-09-22T03:49:10.979949+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949672967,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27028,"kb_used_data":196,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344812,"statfs":{"total":96636764160,"available":96609087488,"internally_reserved":0,"allocated":200704,"data_stored":626995,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654705674,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":26968,"kb_used_data":136,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344872,"statfs":{"total":96636764160,"available":96609148928,"internally_reserved":0,"allocated":139264,"data_stored":36627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705674,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27028,"kb_used_data":196,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344812,"statfs":{"total":96636764160,"available":96609087488,"internally_reserved":0,"allocated":200704,"data_stored":626995,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705674,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27024,"kb_used_data":192,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344816,"statfs":{"total":96636764160,"available":96609091584,"internally_reserved":0,"allocated":196608,"data_stored":626976,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:49:21.125 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-22T03:49:21.125 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-22T03:49:21.125 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-22T03:49:21.125 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-22T03:49:21.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:49:21.235+0000 7f619e4d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:21.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:49:21.242+0000 7f619e4d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:21.482 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:49:21.482 INFO:teuthology.orchestra.run.smithi037.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-22T03:49:21.496 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-22T03:49:21.496 INFO:teuthology.run_tasks:Running task thrashosds... 2024-09-22T03:49:21.514 INFO:tasks.thrashosds:config is {'ceph_objectstore_tool': False, 'chance_down': 0, 'chance_inject_pause_short': 0, 'chance_reset_purged_snaps_last': 0, 'chance_thrash_cluster_full': 0, 'chance_thrash_pg_upmap': 0, 'dump_ops_enable': False, 'min_in': 3, 'noscrub_toggle_delay': 0, 'reweight_osd': 0, 'sighup_delay': 0, 'thrash_primary_affinity': False, 'timeout': 2400, 'optrack_toggle_delay': 2.0, 'random_eio': 0.0} 2024-09-22T03:49:21.514 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'main'}, 'ceph': {'conf': {'client.0': {'debug ms': 1, 'debug objecter': 20, 'debug rados': 20}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc', 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 3}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'osd pool default crimson': True, 'paxos service trim min': 10}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore rocksdb cf': False, 'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'err to stderr': True, 'log flush on exit': True, 'log to file': False, 'log to stderr': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.3, 'osd delete sleep': 1, 'osd failsafe full ratio': 0.95, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd snap trim sleep': 2}, 'osd.0': {'crimson seastar cpu cores': '0-2'}, 'osd.1': {'crimson seastar cpu cores': '3-5'}, 'osd.2': {'crimson seastar cpu cores': '0-2'}, 'osd.3': {'crimson seastar cpu cores': '3-5'}}, 'flavor': 'crimson', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'sha1': '62da54b4b83a96ca9976b7e1d0c8272a564a2208'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'crimson', 'sha1': '62da54b4b83a96ca9976b7e1d0c8272a564a2208'}}, 'thrashosds': {'min_in': 4}, 'workunit': {'branch': 'main', 'env': {'CRIMSON_COMPAT': '1'}, 'sha1': '62da54b4b83a96ca9976b7e1d0c8272a564a2208'}} 2024-09-22T03:49:21.514 INFO:tasks.thrashosds:config is {'ceph_objectstore_tool': False, 'chance_down': 0, 'chance_inject_pause_short': 0, 'chance_reset_purged_snaps_last': 0, 'chance_thrash_cluster_full': 0, 'chance_thrash_pg_upmap': 0, 'dump_ops_enable': False, 'min_in': 4, 'noscrub_toggle_delay': 0, 'reweight_osd': 0, 'sighup_delay': 0, 'thrash_primary_affinity': False, 'timeout': 2400, 'optrack_toggle_delay': 2.0, 'random_eio': 0.0} 2024-09-22T03:49:21.515 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr_debug_aggressive_pg_num_changes true 2024-09-22T03:49:21.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:49:21.623+0000 7fc62a751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:21.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:49:21.635+0000 7fc62a751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:21.853 INFO:tasks.thrashosds:Beginning thrashosds... 2024-09-22T03:49:21.853 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-22T03:49:21.853 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:49:21.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:49:21.961+0000 7fc9d3191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:21.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:49:21.970+0000 7fc9d3191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:22.174 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:49:22.175 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-22T03:49:22.188 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":15,"stamp":"2024-09-22T03:49:20.964730+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":108048,"kb_used_data":720,"kb_used_omap":0,"kb_used_meta":107264,"kb_avail":377379312,"statfs":{"total":386547056640,"available":386436415488,"internally_reserved":0,"allocated":737280,"data_stored":1917593,"data_compressed":90168,"data_compressed_allocated":122880,"data_compressed_original":1720320,"omap_allocated":0,"internal_metadata":109838336},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.904785"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-22T03:49:17.024731+0000","last_change":"2024-09-22T03:49:17.029128+0000","last_active":"2024-09-22T03:49:17.024731+0000","last_peered":"2024-09-22T03:49:17.024731+0000","last_clean":"2024-09-22T03:49:17.024731+0000","last_became_active":"2024-09-22T03:49:15.113396+0000","last_became_peered":"2024-09-22T03:49:15.113396+0000","last_unstale":"2024-09-22T03:49:17.024731+0000","last_undegraded":"2024-09-22T03:49:17.024731+0000","last_fullsized":"2024-09-22T03:49:17.024731+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-22T03:49:17.034122+0000","last_change":"2024-09-22T03:49:17.036402+0000","last_active":"2024-09-22T03:49:17.034122+0000","last_peered":"2024-09-22T03:49:17.034122+0000","last_clean":"2024-09-22T03:49:17.034122+0000","last_became_active":"2024-09-22T03:49:15.108430+0000","last_became_peered":"2024-09-22T03:49:15.108430+0000","last_unstale":"2024-09-22T03:49:17.034122+0000","last_undegraded":"2024-09-22T03:49:17.034122+0000","last_fullsized":"2024-09-22T03:49:17.034122+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-22T03:49:17.028396+0000","last_change":"2024-09-22T03:49:17.032989+0000","last_active":"2024-09-22T03:49:17.028396+0000","last_peered":"2024-09-22T03:49:17.028396+0000","last_clean":"2024-09-22T03:49:17.028396+0000","last_became_active":"2024-09-22T03:49:15.079260+0000","last_became_peered":"2024-09-22T03:49:15.079260+0000","last_unstale":"2024-09-22T03:49:17.028396+0000","last_undegraded":"2024-09-22T03:49:17.028396+0000","last_fullsized":"2024-09-22T03:49:17.028396+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-22T03:49:17.034237+0000","last_change":"2024-09-22T03:49:17.036954+0000","last_active":"2024-09-22T03:49:17.034237+0000","last_peered":"2024-09-22T03:49:17.034237+0000","last_clean":"2024-09-22T03:49:17.034237+0000","last_became_active":"2024-09-22T03:49:15.110506+0000","last_became_peered":"2024-09-22T03:49:15.110506+0000","last_unstale":"2024-09-22T03:49:17.034237+0000","last_undegraded":"2024-09-22T03:49:17.034237+0000","last_fullsized":"2024-09-22T03:49:17.034237+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":18,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-22T03:49:17.031466+0000","last_change":"2024-09-22T03:49:17.031466+0000","last_active":"2024-09-22T03:49:17.031466+0000","last_peered":"2024-09-22T03:49:17.031466+0000","last_clean":"2024-09-22T03:49:17.031466+0000","last_became_active":"2024-09-22T03:49:15.098420+0000","last_became_peered":"2024-09-22T03:49:15.098420+0000","last_unstale":"2024-09-22T03:49:17.031466+0000","last_undegraded":"2024-09-22T03:49:17.031466+0000","last_fullsized":"2024-09-22T03:49:17.031466+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-22T03:49:17.026432+0000","last_change":"2024-09-22T03:49:17.029349+0000","last_active":"2024-09-22T03:49:17.026432+0000","last_peered":"2024-09-22T03:49:17.026432+0000","last_clean":"2024-09-22T03:49:17.026432+0000","last_became_active":"2024-09-22T03:49:15.094890+0000","last_became_peered":"2024-09-22T03:49:15.094890+0000","last_unstale":"2024-09-22T03:49:17.026432+0000","last_undegraded":"2024-09-22T03:49:17.026432+0000","last_fullsized":"2024-09-22T03:49:17.026432+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-22T03:49:17.023982+0000","last_change":"2024-09-22T03:49:17.029339+0000","last_active":"2024-09-22T03:49:17.023982+0000","last_peered":"2024-09-22T03:49:17.023982+0000","last_clean":"2024-09-22T03:49:17.023982+0000","last_became_active":"2024-09-22T03:49:15.097304+0000","last_became_peered":"2024-09-22T03:49:15.097304+0000","last_unstale":"2024-09-22T03:49:17.023982+0000","last_undegraded":"2024-09-22T03:49:17.023982+0000","last_fullsized":"2024-09-22T03:49:17.023982+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":17,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-22T03:49:17.029301+0000","last_change":"2024-09-22T03:49:17.031458+0000","last_active":"2024-09-22T03:49:17.029301+0000","last_peered":"2024-09-22T03:49:17.029301+0000","last_clean":"2024-09-22T03:49:17.029301+0000","last_became_active":"2024-09-22T03:49:15.125490+0000","last_became_peered":"2024-09-22T03:49:15.125490+0000","last_unstale":"2024-09-22T03:49:17.029301+0000","last_undegraded":"2024-09-22T03:49:17.029301+0000","last_fullsized":"2024-09-22T03:49:17.029301+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":91,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-22T03:49:17.030686+0000","last_change":"2024-09-22T03:49:12.034704+0000","last_active":"2024-09-22T03:49:17.030686+0000","last_peered":"2024-09-22T03:49:17.030686+0000","last_clean":"2024-09-22T03:49:17.030686+0000","last_became_active":"2024-09-22T03:49:12.027470+0000","last_became_peered":"2024-09-22T03:49:12.027470+0000","last_unstale":"2024-09-22T03:49:17.030686+0000","last_undegraded":"2024-09-22T03:49:17.030686+0000","last_fullsized":"2024-09-22T03:49:17.030686+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_clean_scrub_stamp":"2024-09-22T03:49:10.979949+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949672967,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27028,"kb_used_data":196,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344812,"statfs":{"total":96636764160,"available":96609087488,"internally_reserved":0,"allocated":200704,"data_stored":626995,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654705674,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":26968,"kb_used_data":136,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344872,"statfs":{"total":96636764160,"available":96609148928,"internally_reserved":0,"allocated":139264,"data_stored":36627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705674,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27028,"kb_used_data":196,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344812,"statfs":{"total":96636764160,"available":96609087488,"internally_reserved":0,"allocated":200704,"data_stored":626995,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705674,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27024,"kb_used_data":192,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344816,"statfs":{"total":96636764160,"available":96609091584,"internally_reserved":0,"allocated":196608,"data_stored":626976,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:49:22.189 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:49:22.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:49:22.296+0000 7f1b0a511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:22.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:49:22.305+0000 7f1b0a511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:22.503 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:49:22.503 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-22T03:49:22.515 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":15,"stamp":"2024-09-22T03:49:20.964730+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":108048,"kb_used_data":720,"kb_used_omap":0,"kb_used_meta":107264,"kb_avail":377379312,"statfs":{"total":386547056640,"available":386436415488,"internally_reserved":0,"allocated":737280,"data_stored":1917593,"data_compressed":90168,"data_compressed_allocated":122880,"data_compressed_original":1720320,"omap_allocated":0,"internal_metadata":109838336},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.904785"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-22T03:49:17.024731+0000","last_change":"2024-09-22T03:49:17.029128+0000","last_active":"2024-09-22T03:49:17.024731+0000","last_peered":"2024-09-22T03:49:17.024731+0000","last_clean":"2024-09-22T03:49:17.024731+0000","last_became_active":"2024-09-22T03:49:15.113396+0000","last_became_peered":"2024-09-22T03:49:15.113396+0000","last_unstale":"2024-09-22T03:49:17.024731+0000","last_undegraded":"2024-09-22T03:49:17.024731+0000","last_fullsized":"2024-09-22T03:49:17.024731+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-22T03:49:17.034122+0000","last_change":"2024-09-22T03:49:17.036402+0000","last_active":"2024-09-22T03:49:17.034122+0000","last_peered":"2024-09-22T03:49:17.034122+0000","last_clean":"2024-09-22T03:49:17.034122+0000","last_became_active":"2024-09-22T03:49:15.108430+0000","last_became_peered":"2024-09-22T03:49:15.108430+0000","last_unstale":"2024-09-22T03:49:17.034122+0000","last_undegraded":"2024-09-22T03:49:17.034122+0000","last_fullsized":"2024-09-22T03:49:17.034122+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-22T03:49:17.028396+0000","last_change":"2024-09-22T03:49:17.032989+0000","last_active":"2024-09-22T03:49:17.028396+0000","last_peered":"2024-09-22T03:49:17.028396+0000","last_clean":"2024-09-22T03:49:17.028396+0000","last_became_active":"2024-09-22T03:49:15.079260+0000","last_became_peered":"2024-09-22T03:49:15.079260+0000","last_unstale":"2024-09-22T03:49:17.028396+0000","last_undegraded":"2024-09-22T03:49:17.028396+0000","last_fullsized":"2024-09-22T03:49:17.028396+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-22T03:49:17.034237+0000","last_change":"2024-09-22T03:49:17.036954+0000","last_active":"2024-09-22T03:49:17.034237+0000","last_peered":"2024-09-22T03:49:17.034237+0000","last_clean":"2024-09-22T03:49:17.034237+0000","last_became_active":"2024-09-22T03:49:15.110506+0000","last_became_peered":"2024-09-22T03:49:15.110506+0000","last_unstale":"2024-09-22T03:49:17.034237+0000","last_undegraded":"2024-09-22T03:49:17.034237+0000","last_fullsized":"2024-09-22T03:49:17.034237+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":18,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-22T03:49:17.031466+0000","last_change":"2024-09-22T03:49:17.031466+0000","last_active":"2024-09-22T03:49:17.031466+0000","last_peered":"2024-09-22T03:49:17.031466+0000","last_clean":"2024-09-22T03:49:17.031466+0000","last_became_active":"2024-09-22T03:49:15.098420+0000","last_became_peered":"2024-09-22T03:49:15.098420+0000","last_unstale":"2024-09-22T03:49:17.031466+0000","last_undegraded":"2024-09-22T03:49:17.031466+0000","last_fullsized":"2024-09-22T03:49:17.031466+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-22T03:49:17.026432+0000","last_change":"2024-09-22T03:49:17.029349+0000","last_active":"2024-09-22T03:49:17.026432+0000","last_peered":"2024-09-22T03:49:17.026432+0000","last_clean":"2024-09-22T03:49:17.026432+0000","last_became_active":"2024-09-22T03:49:15.094890+0000","last_became_peered":"2024-09-22T03:49:15.094890+0000","last_unstale":"2024-09-22T03:49:17.026432+0000","last_undegraded":"2024-09-22T03:49:17.026432+0000","last_fullsized":"2024-09-22T03:49:17.026432+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-22T03:49:17.023982+0000","last_change":"2024-09-22T03:49:17.029339+0000","last_active":"2024-09-22T03:49:17.023982+0000","last_peered":"2024-09-22T03:49:17.023982+0000","last_clean":"2024-09-22T03:49:17.023982+0000","last_became_active":"2024-09-22T03:49:15.097304+0000","last_became_peered":"2024-09-22T03:49:15.097304+0000","last_unstale":"2024-09-22T03:49:17.023982+0000","last_undegraded":"2024-09-22T03:49:17.023982+0000","last_fullsized":"2024-09-22T03:49:17.023982+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":17,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-22T03:49:17.029301+0000","last_change":"2024-09-22T03:49:17.031458+0000","last_active":"2024-09-22T03:49:17.029301+0000","last_peered":"2024-09-22T03:49:17.029301+0000","last_clean":"2024-09-22T03:49:17.029301+0000","last_became_active":"2024-09-22T03:49:15.125490+0000","last_became_peered":"2024-09-22T03:49:15.125490+0000","last_unstale":"2024-09-22T03:49:17.029301+0000","last_undegraded":"2024-09-22T03:49:17.029301+0000","last_fullsized":"2024-09-22T03:49:17.029301+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":91,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-22T03:49:17.030686+0000","last_change":"2024-09-22T03:49:12.034704+0000","last_active":"2024-09-22T03:49:17.030686+0000","last_peered":"2024-09-22T03:49:17.030686+0000","last_clean":"2024-09-22T03:49:17.030686+0000","last_became_active":"2024-09-22T03:49:12.027470+0000","last_became_peered":"2024-09-22T03:49:12.027470+0000","last_unstale":"2024-09-22T03:49:17.030686+0000","last_undegraded":"2024-09-22T03:49:17.030686+0000","last_fullsized":"2024-09-22T03:49:17.030686+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_clean_scrub_stamp":"2024-09-22T03:49:10.979949+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949672967,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27028,"kb_used_data":196,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344812,"statfs":{"total":96636764160,"available":96609087488,"internally_reserved":0,"allocated":200704,"data_stored":626995,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654705674,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":26968,"kb_used_data":136,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344872,"statfs":{"total":96636764160,"available":96609148928,"internally_reserved":0,"allocated":139264,"data_stored":36627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705674,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27028,"kb_used_data":196,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344812,"statfs":{"total":96636764160,"available":96609087488,"internally_reserved":0,"allocated":200704,"data_stored":626995,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705674,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27024,"kb_used_data":192,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344816,"statfs":{"total":96636764160,"available":96609091584,"internally_reserved":0,"allocated":196608,"data_stored":626976,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:49:22.516 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-22T03:49:22.516 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2024-09-22T03:49:22.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:49:22.624+0000 7fd3e8951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:22.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:49:22.633+0000 7fd3e8951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:22.835 INFO:teuthology.orchestra.run.smithi037.stdout:epoch 16 2024-09-22T03:49:22.835 INFO:teuthology.orchestra.run.smithi037.stdout:fsid 9eda29d9-a2b0-48de-a9bc-7b5579d66932 2024-09-22T03:49:22.835 INFO:teuthology.orchestra.run.smithi037.stdout:created 2024-09-22T03:49:02.654999+0000 2024-09-22T03:49:22.835 INFO:teuthology.orchestra.run.smithi037.stdout:modified 2024-09-22T03:49:17.011637+0000 2024-09-22T03:49:22.835 INFO:teuthology.orchestra.run.smithi037.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-22T03:49:22.835 INFO:teuthology.orchestra.run.smithi037.stdout:crush_version 4 2024-09-22T03:49:22.835 INFO:teuthology.orchestra.run.smithi037.stdout:full_ratio 0.95 2024-09-22T03:49:22.835 INFO:teuthology.orchestra.run.smithi037.stdout:backfillfull_ratio 0.9 2024-09-22T03:49:22.836 INFO:teuthology.orchestra.run.smithi037.stdout:nearfull_ratio 0.85 2024-09-22T03:49:22.836 INFO:teuthology.orchestra.run.smithi037.stdout:require_min_compat_client luminous 2024-09-22T03:49:22.836 INFO:teuthology.orchestra.run.smithi037.stdout:min_compat_client jewel 2024-09-22T03:49:22.836 INFO:teuthology.orchestra.run.smithi037.stdout:require_osd_release squid 2024-09-22T03:49:22.836 INFO:teuthology.orchestra.run.smithi037.stdout:stretch_mode_enabled false 2024-09-22T03:49:22.836 INFO:teuthology.orchestra.run.smithi037.stdout:allow_crimson=true 2024-09-22T03:49:22.836 INFO:teuthology.orchestra.run.smithi037.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 12 flags hashpspool,nopgchange,crimson stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 4.00 2024-09-22T03:49:22.836 INFO:teuthology.orchestra.run.smithi037.stdout:pool 2 'rbd' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 16 flags hashpspool,nopgchange,selfmanaged_snaps,crimson stripe_width 0 application rbd read_balance_score 2.00 2024-09-22T03:49:22.836 INFO:teuthology.orchestra.run.smithi037.stdout: removed_snaps_queue [2~1] 2024-09-22T03:49:22.836 INFO:teuthology.orchestra.run.smithi037.stdout:max_osd 4 2024-09-22T03:49:22.836 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) v2:172.21.15.37:6800/2258804031 v2:172.21.15.37:6801/2258804031 exists,up 69ea14de-3fb4-408e-a111-1ad6fe1b1c18 2024-09-22T03:49:22.836 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1 up in weight 1 up_from 10 up_thru 13 down_at 0 last_clean_interval [0,0) v2:172.21.15.37:6808/1511839425 v2:172.21.15.37:6807/1511839425 exists,up 868fe8cf-1915-4ae9-929b-c256a587d2ec 2024-09-22T03:49:22.836 INFO:teuthology.orchestra.run.smithi037.stdout:osd.2 up in weight 1 up_from 9 up_thru 13 down_at 0 last_clean_interval [0,0) v2:172.21.15.98:6804/1340825941 v2:172.21.15.98:6803/1340825941 exists,up 68d5f134-2d34-4808-8747-59a974df8bd4 2024-09-22T03:49:22.836 INFO:teuthology.orchestra.run.smithi037.stdout:osd.3 up in weight 1 up_from 9 up_thru 13 down_at 0 last_clean_interval [0,0) v2:172.21.15.98:6805/3037275240 v2:172.21.15.98:6802/3037275240 exists,up 9f81fabd-2b76-42a1-9e97-fc2087b5d32c 2024-09-22T03:49:22.849 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) v2:172.21.15.37:6800/2258804031 v2:172.21.15.37:6801/2258804031 exists,up 69ea14de-3fb4-408e-a111-1ad6fe1b1c18', 'osd.1 up in weight 1 up_from 10 up_thru 13 down_at 0 last_clean_interval [0,0) v2:172.21.15.37:6808/1511839425 v2:172.21.15.37:6807/1511839425 exists,up 868fe8cf-1915-4ae9-929b-c256a587d2ec', 'osd.2 up in weight 1 up_from 9 up_thru 13 down_at 0 last_clean_interval [0,0) v2:172.21.15.98:6804/1340825941 v2:172.21.15.98:6803/1340825941 exists,up 68d5f134-2d34-4808-8747-59a974df8bd4', 'osd.3 up in weight 1 up_from 9 up_thru 13 down_at 0 last_clean_interval [0,0) v2:172.21.15.98:6805/3037275240 v2:172.21.15.98:6802/3037275240 exists,up 9f81fabd-2b76-42a1-9e97-fc2087b5d32c'] 2024-09-22T03:49:22.849 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config show 2024-09-22T03:49:22.958 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-22T03:49:22.958 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mon.a", 2024-09-22T03:49:22.958 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster": "ceph", 2024-09-22T03:49:22.958 INFO:teuthology.orchestra.run.smithi037.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2024-09-22T03:49:22.958 INFO:teuthology.orchestra.run.smithi037.stdout: "admin_socket_mode": "", 2024-09-22T03:49:22.958 INFO:teuthology.orchestra.run.smithi037.stdout: "auth_allow_insecure_global_id_reclaim": "true", 2024-09-22T03:49:22.958 INFO:teuthology.orchestra.run.smithi037.stdout: "auth_client_required": "cephx, none", 2024-09-22T03:49:22.959 INFO:teuthology.orchestra.run.smithi037.stdout: "auth_cluster_required": "cephx", 2024-09-22T03:49:22.959 INFO:teuthology.orchestra.run.smithi037.stdout: "auth_debug": "true", 2024-09-22T03:49:22.959 INFO:teuthology.orchestra.run.smithi037.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2024-09-22T03:49:22.959 INFO:teuthology.orchestra.run.smithi037.stdout: "auth_mon_ticket_ttl": "660.000000", 2024-09-22T03:49:22.959 INFO:teuthology.orchestra.run.smithi037.stdout: "auth_service_required": "cephx", 2024-09-22T03:49:22.959 INFO:teuthology.orchestra.run.smithi037.stdout: "auth_service_ticket_ttl": "240.000000", 2024-09-22T03:49:22.959 INFO:teuthology.orchestra.run.smithi037.stdout: "auth_supported": "cephx", 2024-09-22T03:49:22.959 INFO:teuthology.orchestra.run.smithi037.stdout: "bdev_aio": "true", 2024-09-22T03:49:22.959 INFO:teuthology.orchestra.run.smithi037.stdout: "bdev_aio_max_queue_depth": "1024", 2024-09-22T03:49:22.959 INFO:teuthology.orchestra.run.smithi037.stdout: "bdev_aio_poll_ms": "250", 2024-09-22T03:49:22.959 INFO:teuthology.orchestra.run.smithi037.stdout: "bdev_aio_reap_max": "16", 2024-09-22T03:49:22.959 INFO:teuthology.orchestra.run.smithi037.stdout: "bdev_async_discard_threads": "0", 2024-09-22T03:49:22.959 INFO:teuthology.orchestra.run.smithi037.stdout: "bdev_block_size": "4096", 2024-09-22T03:49:22.959 INFO:teuthology.orchestra.run.smithi037.stdout: "bdev_debug_aio": "false", 2024-09-22T03:49:22.960 INFO:teuthology.orchestra.run.smithi037.stdout: "bdev_debug_aio_log_age": "5.000000", 2024-09-22T03:49:22.960 INFO:teuthology.orchestra.run.smithi037.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2024-09-22T03:49:22.960 INFO:teuthology.orchestra.run.smithi037.stdout: "bdev_debug_inflight_ios": "false", 2024-09-22T03:49:22.960 INFO:teuthology.orchestra.run.smithi037.stdout: "bdev_enable_discard": "false", 2024-09-22T03:49:22.960 INFO:teuthology.orchestra.run.smithi037.stdout: "bdev_flock_retry": "3", 2024-09-22T03:49:22.960 INFO:teuthology.orchestra.run.smithi037.stdout: "bdev_flock_retry_interval": "0.100000", 2024-09-22T03:49:22.960 INFO:teuthology.orchestra.run.smithi037.stdout: "bdev_inject_crash": "0", 2024-09-22T03:49:22.960 INFO:teuthology.orchestra.run.smithi037.stdout: "bdev_inject_crash_flush_delay": "2", 2024-09-22T03:49:22.960 INFO:teuthology.orchestra.run.smithi037.stdout: "bdev_ioring": "false", 2024-09-22T03:49:22.960 INFO:teuthology.orchestra.run.smithi037.stdout: "bdev_ioring_hipri": "false", 2024-09-22T03:49:22.960 INFO:teuthology.orchestra.run.smithi037.stdout: "bdev_ioring_sqthread_poll": "false", 2024-09-22T03:49:22.960 INFO:teuthology.orchestra.run.smithi037.stdout: "bdev_nvme_unbind_from_kernel": "false", 2024-09-22T03:49:22.960 INFO:teuthology.orchestra.run.smithi037.stdout: "bdev_read_buffer_alignment": "4096", 2024-09-22T03:49:22.960 INFO:teuthology.orchestra.run.smithi037.stdout: "bdev_read_preallocated_huge_buffers": "", 2024-09-22T03:49:22.961 INFO:teuthology.orchestra.run.smithi037.stdout: "bdev_stalled_read_warn_lifetime": "86400", 2024-09-22T03:49:22.961 INFO:teuthology.orchestra.run.smithi037.stdout: "bdev_stalled_read_warn_threshold": "1", 2024-09-22T03:49:22.961 INFO:teuthology.orchestra.run.smithi037.stdout: "bdev_type": "", 2024-09-22T03:49:22.961 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_alloc_size": "1048576", 2024-09-22T03:49:22.961 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_allocator": "hybrid", 2024-09-22T03:49:22.961 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_buffered_io": "true", 2024-09-22T03:49:22.961 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_check_for_zeros": "false", 2024-09-22T03:49:22.961 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_check_volume_selector_often": "false", 2024-09-22T03:49:22.961 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_check_volume_selector_on_umount": "false", 2024-09-22T03:49:22.961 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_compact_log_sync": "false", 2024-09-22T03:49:22.961 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_failed_shared_alloc_cooldown": "600.000000", 2024-09-22T03:49:22.961 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2024-09-22T03:49:22.961 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_log_compact_min_size": "16777216", 2024-09-22T03:49:22.961 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_log_replay_check_allocations": "true", 2024-09-22T03:49:22.962 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_max_log_runway": "4194304", 2024-09-22T03:49:22.962 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_max_prefetch": "1048576", 2024-09-22T03:49:22.962 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_min_flush_size": "524288", 2024-09-22T03:49:22.962 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_min_log_runway": "1048576", 2024-09-22T03:49:22.962 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_replay_recovery": "false", 2024-09-22T03:49:22.962 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_replay_recovery_disable_compact": "false", 2024-09-22T03:49:22.962 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_shared_alloc_size": "65536", 2024-09-22T03:49:22.962 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_sync_write": "false", 2024-09-22T03:49:22.962 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2024-09-22T03:49:22.962 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2024-09-22T03:49:22.962 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2024-09-22T03:49:22.962 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_allocation_from_file": "true", 2024-09-22T03:49:22.962 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_allocator": "hybrid", 2024-09-22T03:49:22.962 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_async_db_compaction": "true", 2024-09-22T03:49:22.962 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2024-09-22T03:49:22.963 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2024-09-22T03:49:22.963 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2024-09-22T03:49:22.963 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2024-09-22T03:49:22.963 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_bdev_label_multi": "true", 2024-09-22T03:49:22.963 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_bdev_label_multi_upgrade": "false", 2024-09-22T03:49:22.963 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_bdev_label_require_all": "true", 2024-09-22T03:49:22.963 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2024-09-22T03:49:22.963 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_bitmapallocator_span_size": "1024", 2024-09-22T03:49:22.963 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_blobid_prealloc": "10240", 2024-09-22T03:49:22.963 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_block_create": "true", 2024-09-22T03:49:22.963 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_block_db_create": "false", 2024-09-22T03:49:22.963 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_block_db_path": "", 2024-09-22T03:49:22.963 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_block_db_size": "0", 2024-09-22T03:49:22.964 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_block_path": "", 2024-09-22T03:49:22.964 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_block_preallocate_file": "false", 2024-09-22T03:49:22.964 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_block_size": "107374182400", 2024-09-22T03:49:22.964 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_block_wal_create": "false", 2024-09-22T03:49:22.964 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_block_wal_path": "", 2024-09-22T03:49:22.964 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_block_wal_size": "100663296", 2024-09-22T03:49:22.964 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_bluefs": "true", 2024-09-22T03:49:22.964 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2024-09-22T03:49:22.964 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_bluefs_env_mirror": "false", 2024-09-22T03:49:22.964 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_bluefs_max_free": "10737418240", 2024-09-22T03:49:22.964 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_btree2_alloc_weight_factor": "2.000000", 2024-09-22T03:49:22.964 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_age_bin_interval": "1.000000", 2024-09-22T03:49:22.964 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_age_bins_data": "1 2 6 24 120 720 0 0 0 0", 2024-09-22T03:49:22.964 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_age_bins_kv": "1 2 6 24 120 720 0 0 0 0", 2024-09-22T03:49:22.964 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_age_bins_kv_onode": "0 0 0 0 0 0 0 0 0 720", 2024-09-22T03:49:22.965 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_age_bins_meta": "1 2 6 24 120 720 0 0 0 0", 2024-09-22T03:49:22.965 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_autotune": "true", 2024-09-22T03:49:22.965 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_autotune_interval": "5.000000", 2024-09-22T03:49:22.965 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2024-09-22T03:49:22.965 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_kv_ratio": "0.450000", 2024-09-22T03:49:22.965 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_meta_ratio": "0.450000", 2024-09-22T03:49:22.965 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_size": "0", 2024-09-22T03:49:22.965 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_size_hdd": "1073741824", 2024-09-22T03:49:22.965 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_size_ssd": "3221225472", 2024-09-22T03:49:22.965 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_trim_interval": "0.050000", 2024-09-22T03:49:22.965 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2024-09-22T03:49:22.965 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_type": "2q", 2024-09-22T03:49:22.965 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cleaner_sleep_interval": "5.000000", 2024-09-22T03:49:22.965 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_clone_cow": "true", 2024-09-22T03:49:22.966 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_compression_algorithm": "snappy", 2024-09-22T03:49:22.966 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_compression_max_blob_size": "0", 2024-09-22T03:49:22.966 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2024-09-22T03:49:22.966 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2024-09-22T03:49:22.966 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_compression_min_blob_size": "0", 2024-09-22T03:49:22.966 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2024-09-22T03:49:22.966 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_compression_min_blob_size_ssd": "65536", 2024-09-22T03:49:22.966 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_compression_mode": "none", 2024-09-22T03:49:22.966 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_compression_required_ratio": "0.875000", 2024-09-22T03:49:22.966 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_csum_type": "crc32c", 2024-09-22T03:49:22.966 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_debug_enforce_min_alloc_size": "0", 2024-09-22T03:49:22.966 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_debug_enforce_settings": "default", 2024-09-22T03:49:22.966 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_debug_freelist": "false", 2024-09-22T03:49:22.967 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_debug_fsck_abort": "false", 2024-09-22T03:49:22.967 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_debug_inject_allocation_from_file_failure": "0.000000", 2024-09-22T03:49:22.967 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2024-09-22T03:49:22.967 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_debug_inject_read_err": "false", 2024-09-22T03:49:22.967 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_debug_legacy_omap": "false", 2024-09-22T03:49:22.967 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_debug_no_reuse_blocks": "false", 2024-09-22T03:49:22.967 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_debug_omit_block_device_write": "false", 2024-09-22T03:49:22.967 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_debug_omit_kv_commit": "false", 2024-09-22T03:49:22.967 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2024-09-22T03:49:22.967 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_debug_prefragment_max": "1048576", 2024-09-22T03:49:22.967 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_debug_random_read_err": "0.000000", 2024-09-22T03:49:22.967 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2024-09-22T03:49:22.967 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_debug_small_allocations": "0", 2024-09-22T03:49:22.967 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2024-09-22T03:49:22.967 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_default_buffered_read": "true", 2024-09-22T03:49:22.968 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_default_buffered_write": "false", 2024-09-22T03:49:22.968 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_deferred_batch_ops": "0", 2024-09-22T03:49:22.968 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2024-09-22T03:49:22.968 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2024-09-22T03:49:22.968 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_elastic_shared_blobs": "true", 2024-09-22T03:49:22.968 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2024-09-22T03:49:22.968 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_extent_map_shard_max_size": "1200", 2024-09-22T03:49:22.968 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_extent_map_shard_min_size": "150", 2024-09-22T03:49:22.968 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_extent_map_shard_target_size": "500", 2024-09-22T03:49:22.968 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2024-09-22T03:49:22.968 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_fail_eio": "false", 2024-09-22T03:49:22.968 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_freelist_blocks_per_key": "128", 2024-09-22T03:49:22.968 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2024-09-22T03:49:22.968 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2024-09-22T03:49:22.969 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2024-09-22T03:49:22.969 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_fsck_on_mkfs": "true", 2024-09-22T03:49:22.969 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2024-09-22T03:49:22.969 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_fsck_on_mount": "false", 2024-09-22T03:49:22.969 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_fsck_on_mount_deep": "false", 2024-09-22T03:49:22.969 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_fsck_on_umount": "false", 2024-09-22T03:49:22.969 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_fsck_on_umount_deep": "false", 2024-09-22T03:49:22.969 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2024-09-22T03:49:22.969 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_fsck_quick_fix_threads": "2", 2024-09-22T03:49:22.969 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2024-09-22T03:49:22.969 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2024-09-22T03:49:22.969 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_gc_enable_blob_threshold": "0", 2024-09-22T03:49:22.969 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_gc_enable_total_threshold": "0", 2024-09-22T03:49:22.969 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2024-09-22T03:49:22.970 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_ignore_data_csum": "false", 2024-09-22T03:49:22.970 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2024-09-22T03:49:22.970 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_kvbackend": "rocksdb", 2024-09-22T03:49:22.970 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_log_collection_list_age": "60.000000", 2024-09-22T03:49:22.970 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2024-09-22T03:49:22.970 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_log_op_age": "5.000000", 2024-09-22T03:49:22.970 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_max_alloc_size": "0", 2024-09-22T03:49:22.970 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_max_blob_size": "0", 2024-09-22T03:49:22.970 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_max_blob_size_hdd": "65536", 2024-09-22T03:49:22.970 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_max_blob_size_ssd": "65536", 2024-09-22T03:49:22.970 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_max_defer_interval": "3.000000", 2024-09-22T03:49:22.970 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_max_deferred_txc": "32", 2024-09-22T03:49:22.970 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_min_alloc_size": "0", 2024-09-22T03:49:22.970 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_min_alloc_size_hdd": "4096", 2024-09-22T03:49:22.971 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_min_alloc_size_ssd": "4096", 2024-09-22T03:49:22.971 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_nid_prealloc": "1024", 2024-09-22T03:49:22.971 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_prefer_deferred_size": "0", 2024-09-22T03:49:22.971 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2024-09-22T03:49:22.971 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2024-09-22T03:49:22.971 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_qfsck_on_mount": "true", 2024-09-22T03:49:22.971 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_retry_disk_reads": "3", 2024-09-22T03:49:22.971 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_rocksdb_cf": "true", 2024-09-22T03:49:22.971 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2024-09-22T03:49:22.971 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_rocksdb_options": "compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0", 2024-09-22T03:49:22.971 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_rocksdb_options_annex": "", 2024-09-22T03:49:22.971 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_slow_ops_warn_lifetime": "86400", 2024-09-22T03:49:22.971 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_slow_ops_warn_threshold": "1", 2024-09-22T03:49:22.971 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_spdk_coremask": "0x1", 2024-09-22T03:49:22.972 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_spdk_io_sleep": "5", 2024-09-22T03:49:22.972 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_spdk_max_io_completion": "0", 2024-09-22T03:49:22.972 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_spdk_mem": "512", 2024-09-22T03:49:22.972 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_sync_submit_transaction": "false", 2024-09-22T03:49:22.972 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_throttle_bytes": "67108864", 2024-09-22T03:49:22.972 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_throttle_cost_per_io": "0", 2024-09-22T03:49:22.972 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2024-09-22T03:49:22.972 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2024-09-22T03:49:22.972 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2024-09-22T03:49:22.972 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_throttle_trace_rate": "0.000000", 2024-09-22T03:49:22.972 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_tracing": "false", 2024-09-22T03:49:22.972 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_use_optimal_io_size_for_min_alloc_size": "false", 2024-09-22T03:49:22.972 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2024-09-22T03:49:22.972 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_volume_selection_reserved": "0", 2024-09-22T03:49:22.972 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2024-09-22T03:49:22.973 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2024-09-22T03:49:22.973 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_warn_on_legacy_statfs": "true", 2024-09-22T03:49:22.973 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2024-09-22T03:49:22.973 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2024-09-22T03:49:22.973 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2024-09-22T03:49:22.973 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_write_v2": "false", 2024-09-22T03:49:22.973 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_write_v2_random": "false", 2024-09-22T03:49:22.973 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_zero_block_detection": "false", 2024-09-22T03:49:22.973 INFO:teuthology.orchestra.run.smithi037.stdout: "cephadm_path": "/usr/sbin/cephadm", 2024-09-22T03:49:22.973 INFO:teuthology.orchestra.run.smithi037.stdout: "cephfs_mirror_action_update_interval": "2", 2024-09-22T03:49:22.973 INFO:teuthology.orchestra.run.smithi037.stdout: "cephfs_mirror_directory_scan_interval": "10", 2024-09-22T03:49:22.973 INFO:teuthology.orchestra.run.smithi037.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2024-09-22T03:49:22.973 INFO:teuthology.orchestra.run.smithi037.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2024-09-22T03:49:22.973 INFO:teuthology.orchestra.run.smithi037.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2024-09-22T03:49:22.974 INFO:teuthology.orchestra.run.smithi037.stdout: "cephfs_mirror_mount_timeout": "10", 2024-09-22T03:49:22.974 INFO:teuthology.orchestra.run.smithi037.stdout: "cephfs_mirror_perf_stats_prio": "5", 2024-09-22T03:49:22.974 INFO:teuthology.orchestra.run.smithi037.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2024-09-22T03:49:22.974 INFO:teuthology.orchestra.run.smithi037.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2024-09-22T03:49:22.974 INFO:teuthology.orchestra.run.smithi037.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2024-09-22T03:49:22.974 INFO:teuthology.orchestra.run.smithi037.stdout: "cephsqlite_blocklist_dead_locker": "true", 2024-09-22T03:49:22.974 INFO:teuthology.orchestra.run.smithi037.stdout: "cephsqlite_lock_renewal_interval": "2000", 2024-09-22T03:49:22.974 INFO:teuthology.orchestra.run.smithi037.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2024-09-22T03:49:22.974 INFO:teuthology.orchestra.run.smithi037.stdout: "cephx_cluster_require_signatures": "false", 2024-09-22T03:49:22.974 INFO:teuthology.orchestra.run.smithi037.stdout: "cephx_cluster_require_version": "2", 2024-09-22T03:49:22.974 INFO:teuthology.orchestra.run.smithi037.stdout: "cephx_require_signatures": "false", 2024-09-22T03:49:22.974 INFO:teuthology.orchestra.run.smithi037.stdout: "cephx_require_version": "2", 2024-09-22T03:49:22.974 INFO:teuthology.orchestra.run.smithi037.stdout: "cephx_service_require_signatures": "false", 2024-09-22T03:49:22.974 INFO:teuthology.orchestra.run.smithi037.stdout: "cephx_service_require_version": "2", 2024-09-22T03:49:22.975 INFO:teuthology.orchestra.run.smithi037.stdout: "cephx_sign_messages": "true", 2024-09-22T03:49:22.975 INFO:teuthology.orchestra.run.smithi037.stdout: "chdir": "", 2024-09-22T03:49:22.975 INFO:teuthology.orchestra.run.smithi037.stdout: "client_acl_type": "", 2024-09-22T03:49:22.975 INFO:teuthology.orchestra.run.smithi037.stdout: "client_asio_thread_count": "2", 2024-09-22T03:49:22.975 INFO:teuthology.orchestra.run.smithi037.stdout: "client_cache_mid": "0.750000", 2024-09-22T03:49:22.975 INFO:teuthology.orchestra.run.smithi037.stdout: "client_cache_size": "16384", 2024-09-22T03:49:22.975 INFO:teuthology.orchestra.run.smithi037.stdout: "client_caps_release_delay": "5", 2024-09-22T03:49:22.975 INFO:teuthology.orchestra.run.smithi037.stdout: "client_check_pool_perm": "true", 2024-09-22T03:49:22.975 INFO:teuthology.orchestra.run.smithi037.stdout: "client_collect_and_send_global_metrics": "false", 2024-09-22T03:49:22.975 INFO:teuthology.orchestra.run.smithi037.stdout: "client_debug_force_sync_read": "false", 2024-09-22T03:49:22.975 INFO:teuthology.orchestra.run.smithi037.stdout: "client_debug_getattr_caps": "false", 2024-09-22T03:49:22.975 INFO:teuthology.orchestra.run.smithi037.stdout: "client_debug_inject_features": "", 2024-09-22T03:49:22.975 INFO:teuthology.orchestra.run.smithi037.stdout: "client_debug_inject_tick_delay": "0", 2024-09-22T03:49:22.976 INFO:teuthology.orchestra.run.smithi037.stdout: "client_die_on_failed_dentry_invalidate": "true", 2024-09-22T03:49:22.976 INFO:teuthology.orchestra.run.smithi037.stdout: "client_die_on_failed_remount": "false", 2024-09-22T03:49:22.976 INFO:teuthology.orchestra.run.smithi037.stdout: "client_dirsize_rbytes": "true", 2024-09-22T03:49:22.976 INFO:teuthology.orchestra.run.smithi037.stdout: "client_force_lazyio": "false", 2024-09-22T03:49:22.976 INFO:teuthology.orchestra.run.smithi037.stdout: "client_fs": "", 2024-09-22T03:49:22.976 INFO:teuthology.orchestra.run.smithi037.stdout: "client_inject_fixed_oldest_tid": "false", 2024-09-22T03:49:22.976 INFO:teuthology.orchestra.run.smithi037.stdout: "client_inject_release_failure": "false", 2024-09-22T03:49:22.976 INFO:teuthology.orchestra.run.smithi037.stdout: "client_max_inline_size": "4096", 2024-09-22T03:49:22.976 INFO:teuthology.orchestra.run.smithi037.stdout: "client_max_retries_on_remount_failure": "5", 2024-09-22T03:49:22.976 INFO:teuthology.orchestra.run.smithi037.stdout: "client_mds_namespace": "", 2024-09-22T03:49:22.976 INFO:teuthology.orchestra.run.smithi037.stdout: "client_metadata": "", 2024-09-22T03:49:22.976 INFO:teuthology.orchestra.run.smithi037.stdout: "client_mount_gid": "-1", 2024-09-22T03:49:22.976 INFO:teuthology.orchestra.run.smithi037.stdout: "client_mount_timeout": "300", 2024-09-22T03:49:22.976 INFO:teuthology.orchestra.run.smithi037.stdout: "client_mount_uid": "-1", 2024-09-22T03:49:22.976 INFO:teuthology.orchestra.run.smithi037.stdout: "client_mountpoint": "/", 2024-09-22T03:49:22.977 INFO:teuthology.orchestra.run.smithi037.stdout: "client_notify_timeout": "10", 2024-09-22T03:49:22.977 INFO:teuthology.orchestra.run.smithi037.stdout: "client_oc": "true", 2024-09-22T03:49:22.977 INFO:teuthology.orchestra.run.smithi037.stdout: "client_oc_max_dirty": "104857600", 2024-09-22T03:49:22.977 INFO:teuthology.orchestra.run.smithi037.stdout: "client_oc_max_dirty_age": "5.000000", 2024-09-22T03:49:22.977 INFO:teuthology.orchestra.run.smithi037.stdout: "client_oc_max_objects": "1000", 2024-09-22T03:49:22.977 INFO:teuthology.orchestra.run.smithi037.stdout: "client_oc_size": "209715200", 2024-09-22T03:49:22.977 INFO:teuthology.orchestra.run.smithi037.stdout: "client_oc_target_dirty": "8388608", 2024-09-22T03:49:22.977 INFO:teuthology.orchestra.run.smithi037.stdout: "client_permissions": "true", 2024-09-22T03:49:22.977 INFO:teuthology.orchestra.run.smithi037.stdout: "client_quota": "true", 2024-09-22T03:49:22.977 INFO:teuthology.orchestra.run.smithi037.stdout: "client_quota_df": "true", 2024-09-22T03:49:22.977 INFO:teuthology.orchestra.run.smithi037.stdout: "client_readahead_max_bytes": "0", 2024-09-22T03:49:22.977 INFO:teuthology.orchestra.run.smithi037.stdout: "client_readahead_max_periods": "4", 2024-09-22T03:49:22.977 INFO:teuthology.orchestra.run.smithi037.stdout: "client_readahead_min": "131072", 2024-09-22T03:49:22.977 INFO:teuthology.orchestra.run.smithi037.stdout: "client_reconnect_stale": "false", 2024-09-22T03:49:22.977 INFO:teuthology.orchestra.run.smithi037.stdout: "client_shutdown_timeout": "30", 2024-09-22T03:49:22.977 INFO:teuthology.orchestra.run.smithi037.stdout: "client_snapdir": ".snap", 2024-09-22T03:49:22.978 INFO:teuthology.orchestra.run.smithi037.stdout: "client_tick_interval": "1", 2024-09-22T03:49:22.978 INFO:teuthology.orchestra.run.smithi037.stdout: "client_trace": "", 2024-09-22T03:49:22.978 INFO:teuthology.orchestra.run.smithi037.stdout: "client_try_dentry_invalidate": "false", 2024-09-22T03:49:22.978 INFO:teuthology.orchestra.run.smithi037.stdout: "client_use_faked_inos": "false", 2024-09-22T03:49:22.978 INFO:teuthology.orchestra.run.smithi037.stdout: "client_use_random_mds": "false", 2024-09-22T03:49:22.978 INFO:teuthology.orchestra.run.smithi037.stdout: "clog_to_graylog": "false", 2024-09-22T03:49:22.978 INFO:teuthology.orchestra.run.smithi037.stdout: "clog_to_graylog_host": "127.0.0.1", 2024-09-22T03:49:22.978 INFO:teuthology.orchestra.run.smithi037.stdout: "clog_to_graylog_port": "12201", 2024-09-22T03:49:22.978 INFO:teuthology.orchestra.run.smithi037.stdout: "clog_to_monitors": "default=true", 2024-09-22T03:49:22.978 INFO:teuthology.orchestra.run.smithi037.stdout: "clog_to_syslog": "false", 2024-09-22T03:49:22.978 INFO:teuthology.orchestra.run.smithi037.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2024-09-22T03:49:22.978 INFO:teuthology.orchestra.run.smithi037.stdout: "clog_to_syslog_level": "info", 2024-09-22T03:49:22.978 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_addr": "-", 2024-09-22T03:49:22.978 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_network": "", 2024-09-22T03:49:22.978 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_network_interface": "", 2024-09-22T03:49:22.979 INFO:teuthology.orchestra.run.smithi037.stdout: "compressor_zlib_isal": "false", 2024-09-22T03:49:22.979 INFO:teuthology.orchestra.run.smithi037.stdout: "compressor_zlib_level": "5", 2024-09-22T03:49:22.979 INFO:teuthology.orchestra.run.smithi037.stdout: "compressor_zlib_winsize": "-15", 2024-09-22T03:49:22.979 INFO:teuthology.orchestra.run.smithi037.stdout: "compressor_zstd_level": "1", 2024-09-22T03:49:22.979 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image": "docker.io/ceph/daemon-base:latest-master-devel", 2024-09-22T03:49:22.979 INFO:teuthology.orchestra.run.smithi037.stdout: "crash_dir": "/var/lib/ceph/crash", 2024-09-22T03:49:22.979 INFO:teuthology.orchestra.run.smithi037.stdout: "crimson_alien_op_num_threads": "6", 2024-09-22T03:49:22.979 INFO:teuthology.orchestra.run.smithi037.stdout: "crimson_alien_thread_cpu_cores": "", 2024-09-22T03:49:22.979 INFO:teuthology.orchestra.run.smithi037.stdout: "crimson_osd_obc_lru_size": "512", 2024-09-22T03:49:22.979 INFO:teuthology.orchestra.run.smithi037.stdout: "crimson_osd_scheduler_concurrency": "0", 2024-09-22T03:49:22.979 INFO:teuthology.orchestra.run.smithi037.stdout: "crimson_osd_stat_interval": "0", 2024-09-22T03:49:22.979 INFO:teuthology.orchestra.run.smithi037.stdout: "crimson_seastar_cpu_cores": "", 2024-09-22T03:49:22.979 INFO:teuthology.orchestra.run.smithi037.stdout: "crimson_seastar_num_threads": "0", 2024-09-22T03:49:22.979 INFO:teuthology.orchestra.run.smithi037.stdout: "crush_location": "", 2024-09-22T03:49:22.980 INFO:teuthology.orchestra.run.smithi037.stdout: "crush_location_hook": "", 2024-09-22T03:49:22.980 INFO:teuthology.orchestra.run.smithi037.stdout: "crush_location_hook_timeout": "10", 2024-09-22T03:49:22.980 INFO:teuthology.orchestra.run.smithi037.stdout: "daemonize": "false", 2024-09-22T03:49:22.980 INFO:teuthology.orchestra.run.smithi037.stdout: "daos_pool": "tank", 2024-09-22T03:49:22.980 INFO:teuthology.orchestra.run.smithi037.stdout: "dbstore_config_uri": "file:/var/lib/ceph/radosgw/dbstore-config.db", 2024-09-22T03:49:22.980 INFO:teuthology.orchestra.run.smithi037.stdout: "dbstore_db_dir": "/var/lib/ceph/radosgw", 2024-09-22T03:49:22.980 INFO:teuthology.orchestra.run.smithi037.stdout: "dbstore_db_name_prefix": "dbstore", 2024-09-22T03:49:22.980 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_alienstore": "0/5", 2024-09-22T03:49:22.980 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_allow_any_pool_priority": "false", 2024-09-22T03:49:22.980 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_asok": "1/5", 2024-09-22T03:49:22.980 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_asok_assert_abort": "false", 2024-09-22T03:49:22.980 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_asserts_on_shutdown": "true", 2024-09-22T03:49:22.980 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_auth": "20/20", 2024-09-22T03:49:22.980 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_bdev": "1/3", 2024-09-22T03:49:22.980 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_bluefs": "1/5", 2024-09-22T03:49:22.981 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_bluestore": "1/5", 2024-09-22T03:49:22.981 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_buffer": "0/1", 2024-09-22T03:49:22.981 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_ceph_dedup": "0/5", 2024-09-22T03:49:22.981 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_ceph_exporter": "1/5", 2024-09-22T03:49:22.981 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_cephfs_mirror": "0/5", 2024-09-22T03:49:22.981 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_cephsqlite": "0/5", 2024-09-22T03:49:22.981 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_client": "0/5", 2024-09-22T03:49:22.981 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_compressor": "1/5", 2024-09-22T03:49:22.981 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_context": "0/1", 2024-09-22T03:49:22.981 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_crimson_interrupt": "0/5", 2024-09-22T03:49:22.981 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_crush": "1/1", 2024-09-22T03:49:22.981 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_crypto": "1/5", 2024-09-22T03:49:22.981 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_cyanstore": "0/5", 2024-09-22T03:49:22.981 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_deliberately_leak_memory": "false", 2024-09-22T03:49:22.982 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_disable_randomized_ping": "false", 2024-09-22T03:49:22.982 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_dpdk": "1/5", 2024-09-22T03:49:22.982 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_eventtrace": "1/5", 2024-09-22T03:49:22.982 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_filer": "0/1", 2024-09-22T03:49:22.982 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_filestore": "1/3", 2024-09-22T03:49:22.982 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_finisher": "1/1", 2024-09-22T03:49:22.982 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_fuse": "1/5", 2024-09-22T03:49:22.982 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_heartbeat_testing_span": "0", 2024-09-22T03:49:22.982 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_heartbeatmap": "1/5", 2024-09-22T03:49:22.982 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_immutable_obj_cache": "0/5", 2024-09-22T03:49:22.982 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_javaclient": "1/5", 2024-09-22T03:49:22.982 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_journal": "1/3", 2024-09-22T03:49:22.982 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_journaler": "0/5", 2024-09-22T03:49:22.982 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_kstore": "1/5", 2024-09-22T03:49:22.983 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_lockdep": "0/1", 2024-09-22T03:49:22.983 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_mclock": "1/5", 2024-09-22T03:49:22.983 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_mds": "1/5", 2024-09-22T03:49:22.983 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_mds_balancer": "1/5", 2024-09-22T03:49:22.983 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_mds_locker": "1/5", 2024-09-22T03:49:22.983 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_mds_log": "1/5", 2024-09-22T03:49:22.983 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_mds_log_expire": "1/5", 2024-09-22T03:49:22.983 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_mds_migrator": "1/5", 2024-09-22T03:49:22.983 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_mds_quiesce": "3/5", 2024-09-22T03:49:22.983 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_memstore": "1/5", 2024-09-22T03:49:22.983 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_mgr": "2/5", 2024-09-22T03:49:22.983 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_mgrc": "1/5", 2024-09-22T03:49:22.983 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_mon": "20/20", 2024-09-22T03:49:22.983 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_monc": "0/10", 2024-09-22T03:49:22.983 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_ms": "1/1", 2024-09-22T03:49:22.984 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_none": "0/5", 2024-09-22T03:49:22.984 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_objclass": "0/5", 2024-09-22T03:49:22.984 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_objectcacher": "0/5", 2024-09-22T03:49:22.984 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_objecter": "0/1", 2024-09-22T03:49:22.984 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_optracker": "0/5", 2024-09-22T03:49:22.984 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_osd": "1/5", 2024-09-22T03:49:22.984 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_paxos": "20/20", 2024-09-22T03:49:22.984 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_perfcounter": "1/5", 2024-09-22T03:49:22.984 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_prioritycache": "1/5", 2024-09-22T03:49:22.984 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_rados": "0/5", 2024-09-22T03:49:22.984 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_rbd": "0/5", 2024-09-22T03:49:22.984 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_rbd_mirror": "0/5", 2024-09-22T03:49:22.984 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_rbd_pwl": "0/5", 2024-09-22T03:49:22.984 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_rbd_replay": "0/5", 2024-09-22T03:49:22.984 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_refs": "0/0", 2024-09-22T03:49:22.984 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_reserver": "1/1", 2024-09-22T03:49:22.985 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_rgw": "1/5", 2024-09-22T03:49:22.985 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_rgw_access": "1/5", 2024-09-22T03:49:22.985 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_rgw_datacache": "1/5", 2024-09-22T03:49:22.985 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_rgw_dbstore": "1/5", 2024-09-22T03:49:22.985 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_rgw_flight": "1/5", 2024-09-22T03:49:22.985 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_rgw_lifecycle": "1/5", 2024-09-22T03:49:22.985 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_rgw_notification": "1/5", 2024-09-22T03:49:22.985 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_rgw_sync": "1/5", 2024-09-22T03:49:22.985 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_rocksdb": "4/5", 2024-09-22T03:49:22.985 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_seastore": "0/5", 2024-09-22T03:49:22.985 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_seastore_backref": "0/5", 2024-09-22T03:49:22.986 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_seastore_cache": "0/5", 2024-09-22T03:49:22.986 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_seastore_cleaner": "0/5", 2024-09-22T03:49:22.986 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_seastore_device": "0/5", 2024-09-22T03:49:22.986 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_seastore_epm": "0/5", 2024-09-22T03:49:22.986 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_seastore_fixedkv_tree": "0/5", 2024-09-22T03:49:22.986 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_seastore_journal": "0/5", 2024-09-22T03:49:22.986 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_seastore_lba": "0/5", 2024-09-22T03:49:22.986 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_seastore_odata": "0/5", 2024-09-22T03:49:22.986 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_seastore_omap": "0/5", 2024-09-22T03:49:22.986 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_seastore_onode": "0/5", 2024-09-22T03:49:22.986 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_seastore_t": "0/5", 2024-09-22T03:49:22.986 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_seastore_tm": "0/5", 2024-09-22T03:49:22.986 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_striper": "0/1", 2024-09-22T03:49:22.986 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_test": "0/5", 2024-09-22T03:49:22.987 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_throttle": "1/1", 2024-09-22T03:49:22.987 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_timer": "0/1", 2024-09-22T03:49:22.987 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_tp": "0/5", 2024-09-22T03:49:22.987 INFO:teuthology.orchestra.run.smithi037.stdout: "debug_trace": "1/5", 2024-09-22T03:49:22.987 INFO:teuthology.orchestra.run.smithi037.stdout: "defer_client_eviction_on_laggy_osds": "false", 2024-09-22T03:49:22.987 INFO:teuthology.orchestra.run.smithi037.stdout: "device_failure_prediction_mode": "none", 2024-09-22T03:49:22.987 INFO:teuthology.orchestra.run.smithi037.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "crimson", 2024-09-22T03:49:22.987 INFO:teuthology.orchestra.run.smithi037.stdout: "erasure_code_dir": "/usr/lib64/ceph/erasure-code", 2024-09-22T03:49:22.987 INFO:teuthology.orchestra.run.smithi037.stdout: "err_to_graylog": "false", 2024-09-22T03:49:22.987 INFO:teuthology.orchestra.run.smithi037.stdout: "err_to_journald": "false", 2024-09-22T03:49:22.987 INFO:teuthology.orchestra.run.smithi037.stdout: "err_to_stderr": "true", 2024-09-22T03:49:22.987 INFO:teuthology.orchestra.run.smithi037.stdout: "err_to_syslog": "false", 2024-09-22T03:49:22.987 INFO:teuthology.orchestra.run.smithi037.stdout: "event_tracing": "false", 2024-09-22T03:49:22.987 INFO:teuthology.orchestra.run.smithi037.stdout: "exporter_addr": "0.0.0.0", 2024-09-22T03:49:22.988 INFO:teuthology.orchestra.run.smithi037.stdout: "exporter_cert_file": "", 2024-09-22T03:49:22.988 INFO:teuthology.orchestra.run.smithi037.stdout: "exporter_http_port": "9926", 2024-09-22T03:49:22.988 INFO:teuthology.orchestra.run.smithi037.stdout: "exporter_key_file": "", 2024-09-22T03:49:22.988 INFO:teuthology.orchestra.run.smithi037.stdout: "exporter_prio_limit": "5", 2024-09-22T03:49:22.988 INFO:teuthology.orchestra.run.smithi037.stdout: "exporter_sock_dir": "/var/run/ceph/", 2024-09-22T03:49:22.988 INFO:teuthology.orchestra.run.smithi037.stdout: "exporter_sort_metrics": "true", 2024-09-22T03:49:22.988 INFO:teuthology.orchestra.run.smithi037.stdout: "exporter_stats_period": "5", 2024-09-22T03:49:22.988 INFO:teuthology.orchestra.run.smithi037.stdout: "fake_statfs_for_testing": "0", 2024-09-22T03:49:22.988 INFO:teuthology.orchestra.run.smithi037.stdout: "fatal_signal_handlers": "true", 2024-09-22T03:49:22.988 INFO:teuthology.orchestra.run.smithi037.stdout: "filer_max_purge_ops": "10", 2024-09-22T03:49:22.988 INFO:teuthology.orchestra.run.smithi037.stdout: "filer_max_truncate_ops": "128", 2024-09-22T03:49:22.988 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_apply_finisher_threads": "1", 2024-09-22T03:49:22.988 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_blackhole": "false", 2024-09-22T03:49:22.988 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_btrfs_clone_range": "true", 2024-09-22T03:49:22.988 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_btrfs_snap": "true", 2024-09-22T03:49:22.989 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_caller_concurrency": "10", 2024-09-22T03:49:22.989 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_collect_device_partition_information": "true", 2024-09-22T03:49:22.989 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_commit_timeout": "600.000000", 2024-09-22T03:49:22.989 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_debug_inject_read_err": "false", 2024-09-22T03:49:22.989 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_debug_omap_check": "false", 2024-09-22T03:49:22.989 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_debug_verify_split": "false", 2024-09-22T03:49:22.989 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_dump_file": "", 2024-09-22T03:49:22.989 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2024-09-22T03:49:22.989 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_expected_throughput_ops": "200.000000", 2024-09-22T03:49:22.989 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_fadvise": "true", 2024-09-22T03:49:22.989 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_fail_eio": "true", 2024-09-22T03:49:22.989 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_fd_cache_shards": "16", 2024-09-22T03:49:22.989 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_fd_cache_size": "128", 2024-09-22T03:49:22.989 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_fiemap": "false", 2024-09-22T03:49:22.989 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_fiemap_threshold": "4096", 2024-09-22T03:49:22.990 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_fsync_flushes_journal_data": "false", 2024-09-22T03:49:22.990 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_index_retry_probability": "0.000000", 2024-09-22T03:49:22.990 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_inject_stall": "0", 2024-09-22T03:49:22.990 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_journal_parallel": "false", 2024-09-22T03:49:22.990 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_journal_trailing": "false", 2024-09-22T03:49:22.990 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_journal_writeahead": "false", 2024-09-22T03:49:22.990 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_kill_at": "0", 2024-09-22T03:49:22.990 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_max_alloc_hint_size": "1048576", 2024-09-22T03:49:22.990 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_max_inline_xattr_size": "0", 2024-09-22T03:49:22.990 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2024-09-22T03:49:22.990 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_max_inline_xattr_size_other": "512", 2024-09-22T03:49:22.990 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2024-09-22T03:49:22.990 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_max_inline_xattrs": "0", 2024-09-22T03:49:22.990 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2024-09-22T03:49:22.991 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_max_inline_xattrs_other": "2", 2024-09-22T03:49:22.991 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_max_inline_xattrs_xfs": "10", 2024-09-22T03:49:22.991 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_max_sync_interval": "5.000000", 2024-09-22T03:49:22.991 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_max_xattr_value_size": "0", 2024-09-22T03:49:22.991 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2024-09-22T03:49:22.991 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_max_xattr_value_size_other": "1024", 2024-09-22T03:49:22.991 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2024-09-22T03:49:22.991 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_merge_threshold": "-10", 2024-09-22T03:49:22.991 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_min_sync_interval": "0.010000", 2024-09-22T03:49:22.991 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_odsync_write": "false", 2024-09-22T03:49:22.991 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_omap_backend": "rocksdb", 2024-09-22T03:49:22.991 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_omap_backend_path": "", 2024-09-22T03:49:22.991 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_omap_header_cache_size": "1024", 2024-09-22T03:49:22.991 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_ondisk_finisher_threads": "1", 2024-09-22T03:49:22.991 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_op_thread_suicide_timeout": "180", 2024-09-22T03:49:22.992 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_op_thread_timeout": "60", 2024-09-22T03:49:22.992 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_op_threads": "2", 2024-09-22T03:49:22.992 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_punch_hole": "false", 2024-09-22T03:49:22.992 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2024-09-22T03:49:22.992 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2024-09-22T03:49:22.992 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2024-09-22T03:49:22.992 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_queue_high_threshhold": "0.900000", 2024-09-22T03:49:22.992 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_queue_low_threshhold": "0.300000", 2024-09-22T03:49:22.992 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_queue_max_bytes": "104857600", 2024-09-22T03:49:22.992 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2024-09-22T03:49:22.992 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2024-09-22T03:49:22.992 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2024-09-22T03:49:22.992 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_queue_max_ops": "50", 2024-09-22T03:49:22.992 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2024-09-22T03:49:22.992 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_seek_data_hole": "false", 2024-09-22T03:49:22.992 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_sloppy_crc": "false", 2024-09-22T03:49:22.993 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_sloppy_crc_block_size": "65536", 2024-09-22T03:49:22.993 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_splice": "false", 2024-09-22T03:49:22.993 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_split_multiple": "2", 2024-09-22T03:49:22.993 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_split_rand_factor": "20", 2024-09-22T03:49:22.993 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_update_to": "1000", 2024-09-22T03:49:22.993 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2024-09-22T03:49:22.993 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2024-09-22T03:49:22.993 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2024-09-22T03:49:22.993 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2024-09-22T03:49:22.993 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2024-09-22T03:49:22.993 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2024-09-22T03:49:22.993 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_wbthrottle_enable": "true", 2024-09-22T03:49:22.993 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2024-09-22T03:49:22.993 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2024-09-22T03:49:22.993 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2024-09-22T03:49:22.993 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2024-09-22T03:49:22.994 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2024-09-22T03:49:22.994 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2024-09-22T03:49:22.994 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_xfs_extsize": "false", 2024-09-22T03:49:22.994 INFO:teuthology.orchestra.run.smithi037.stdout: "filestore_zfs_snap": "false", 2024-09-22T03:49:22.994 INFO:teuthology.orchestra.run.smithi037.stdout: "fio_dir": "/tmp/fio", 2024-09-22T03:49:22.994 INFO:teuthology.orchestra.run.smithi037.stdout: "fsid": "9eda29d9-a2b0-48de-a9bc-7b5579d66932", 2024-09-22T03:49:22.994 INFO:teuthology.orchestra.run.smithi037.stdout: "fuse_allow_other": "true", 2024-09-22T03:49:22.994 INFO:teuthology.orchestra.run.smithi037.stdout: "fuse_atomic_o_trunc": "true", 2024-09-22T03:49:22.994 INFO:teuthology.orchestra.run.smithi037.stdout: "fuse_big_writes": "true", 2024-09-22T03:49:22.994 INFO:teuthology.orchestra.run.smithi037.stdout: "fuse_debug": "false", 2024-09-22T03:49:22.994 INFO:teuthology.orchestra.run.smithi037.stdout: "fuse_default_permissions": "false", 2024-09-22T03:49:22.994 INFO:teuthology.orchestra.run.smithi037.stdout: "fuse_disable_pagecache": "false", 2024-09-22T03:49:22.994 INFO:teuthology.orchestra.run.smithi037.stdout: "fuse_max_write": "0", 2024-09-22T03:49:22.995 INFO:teuthology.orchestra.run.smithi037.stdout: "fuse_multithreaded": "true", 2024-09-22T03:49:22.995 INFO:teuthology.orchestra.run.smithi037.stdout: "fuse_require_active_mds": "true", 2024-09-22T03:49:22.995 INFO:teuthology.orchestra.run.smithi037.stdout: "fuse_set_user_groups": "true", 2024-09-22T03:49:22.995 INFO:teuthology.orchestra.run.smithi037.stdout: "fuse_splice_move": "true", 2024-09-22T03:49:22.995 INFO:teuthology.orchestra.run.smithi037.stdout: "fuse_splice_read": "true", 2024-09-22T03:49:22.995 INFO:teuthology.orchestra.run.smithi037.stdout: "fuse_splice_write": "true", 2024-09-22T03:49:22.995 INFO:teuthology.orchestra.run.smithi037.stdout: "fuse_syncfs_on_mksnap": "true", 2024-09-22T03:49:22.995 INFO:teuthology.orchestra.run.smithi037.stdout: "fuse_use_invalidate_cb": "true", 2024-09-22T03:49:22.995 INFO:teuthology.orchestra.run.smithi037.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2024-09-22T03:49:22.995 INFO:teuthology.orchestra.run.smithi037.stdout: "gss_target_name": "ceph", 2024-09-22T03:49:22.995 INFO:teuthology.orchestra.run.smithi037.stdout: "heartbeat_file": "", 2024-09-22T03:49:22.995 INFO:teuthology.orchestra.run.smithi037.stdout: "heartbeat_inject_failure": "0", 2024-09-22T03:49:22.995 INFO:teuthology.orchestra.run.smithi037.stdout: "heartbeat_interval": "5", 2024-09-22T03:49:22.995 INFO:teuthology.orchestra.run.smithi037.stdout: "host": "smithi037", 2024-09-22T03:49:22.995 INFO:teuthology.orchestra.run.smithi037.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2024-09-22T03:49:22.996 INFO:teuthology.orchestra.run.smithi037.stdout: "immutable_object_cache_max_inflight_ops": "128", 2024-09-22T03:49:22.996 INFO:teuthology.orchestra.run.smithi037.stdout: "immutable_object_cache_max_size": "1073741824", 2024-09-22T03:49:22.996 INFO:teuthology.orchestra.run.smithi037.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2024-09-22T03:49:22.996 INFO:teuthology.orchestra.run.smithi037.stdout: "immutable_object_cache_qos_bps_burst": "0", 2024-09-22T03:49:22.996 INFO:teuthology.orchestra.run.smithi037.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2024-09-22T03:49:22.996 INFO:teuthology.orchestra.run.smithi037.stdout: "immutable_object_cache_qos_bps_limit": "0", 2024-09-22T03:49:22.996 INFO:teuthology.orchestra.run.smithi037.stdout: "immutable_object_cache_qos_iops_burst": "0", 2024-09-22T03:49:22.996 INFO:teuthology.orchestra.run.smithi037.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2024-09-22T03:49:22.996 INFO:teuthology.orchestra.run.smithi037.stdout: "immutable_object_cache_qos_iops_limit": "0", 2024-09-22T03:49:22.996 INFO:teuthology.orchestra.run.smithi037.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2024-09-22T03:49:22.996 INFO:teuthology.orchestra.run.smithi037.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2024-09-22T03:49:22.996 INFO:teuthology.orchestra.run.smithi037.stdout: "immutable_object_cache_watermark": "0.900000", 2024-09-22T03:49:22.996 INFO:teuthology.orchestra.run.smithi037.stdout: "inject_early_sigterm": "false", 2024-09-22T03:49:22.996 INFO:teuthology.orchestra.run.smithi037.stdout: "jaeger_agent_port": "6799", 2024-09-22T03:49:22.997 INFO:teuthology.orchestra.run.smithi037.stdout: "jaeger_tracing_enable": "false", 2024-09-22T03:49:22.997 INFO:teuthology.orchestra.run.smithi037.stdout: "journal_aio": "true", 2024-09-22T03:49:22.997 INFO:teuthology.orchestra.run.smithi037.stdout: "journal_align_min_size": "65536", 2024-09-22T03:49:22.997 INFO:teuthology.orchestra.run.smithi037.stdout: "journal_block_align": "true", 2024-09-22T03:49:22.997 INFO:teuthology.orchestra.run.smithi037.stdout: "journal_block_size": "4096", 2024-09-22T03:49:22.997 INFO:teuthology.orchestra.run.smithi037.stdout: "journal_dio": "true", 2024-09-22T03:49:22.997 INFO:teuthology.orchestra.run.smithi037.stdout: "journal_discard": "false", 2024-09-22T03:49:22.997 INFO:teuthology.orchestra.run.smithi037.stdout: "journal_force_aio": "false", 2024-09-22T03:49:22.997 INFO:teuthology.orchestra.run.smithi037.stdout: "journal_ignore_corruption": "false", 2024-09-22T03:49:22.997 INFO:teuthology.orchestra.run.smithi037.stdout: "journal_max_write_bytes": "10485760", 2024-09-22T03:49:22.997 INFO:teuthology.orchestra.run.smithi037.stdout: "journal_max_write_entries": "100", 2024-09-22T03:49:22.997 INFO:teuthology.orchestra.run.smithi037.stdout: "journal_replay_from": "0", 2024-09-22T03:49:22.997 INFO:teuthology.orchestra.run.smithi037.stdout: "journal_throttle_high_multiple": "0.000000", 2024-09-22T03:49:22.997 INFO:teuthology.orchestra.run.smithi037.stdout: "journal_throttle_high_threshhold": "0.900000", 2024-09-22T03:49:22.997 INFO:teuthology.orchestra.run.smithi037.stdout: "journal_throttle_low_threshhold": "0.600000", 2024-09-22T03:49:22.998 INFO:teuthology.orchestra.run.smithi037.stdout: "journal_throttle_max_multiple": "0.000000", 2024-09-22T03:49:22.998 INFO:teuthology.orchestra.run.smithi037.stdout: "journal_write_header_frequency": "0", 2024-09-22T03:49:22.998 INFO:teuthology.orchestra.run.smithi037.stdout: "journal_zero_on_create": "false", 2024-09-22T03:49:22.998 INFO:teuthology.orchestra.run.smithi037.stdout: "journaler_prefetch_periods": "10", 2024-09-22T03:49:22.998 INFO:teuthology.orchestra.run.smithi037.stdout: "journaler_prezero_periods": "5", 2024-09-22T03:49:22.998 INFO:teuthology.orchestra.run.smithi037.stdout: "journaler_write_head_interval": "15", 2024-09-22T03:49:22.998 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "", 2024-09-22T03:49:22.998 INFO:teuthology.orchestra.run.smithi037.stdout: "keyfile": "", 2024-09-22T03:49:22.998 INFO:teuthology.orchestra.run.smithi037.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2024-09-22T03:49:22.998 INFO:teuthology.orchestra.run.smithi037.stdout: "kstore_backend": "rocksdb", 2024-09-22T03:49:22.998 INFO:teuthology.orchestra.run.smithi037.stdout: "kstore_default_stripe_size": "65536", 2024-09-22T03:49:22.998 INFO:teuthology.orchestra.run.smithi037.stdout: "kstore_fsck_on_mount": "false", 2024-09-22T03:49:22.998 INFO:teuthology.orchestra.run.smithi037.stdout: "kstore_fsck_on_mount_deep": "true", 2024-09-22T03:49:22.998 INFO:teuthology.orchestra.run.smithi037.stdout: "kstore_max_bytes": "67108864", 2024-09-22T03:49:22.998 INFO:teuthology.orchestra.run.smithi037.stdout: "kstore_max_ops": "512", 2024-09-22T03:49:22.999 INFO:teuthology.orchestra.run.smithi037.stdout: "kstore_nid_prealloc": "1024", 2024-09-22T03:49:22.999 INFO:teuthology.orchestra.run.smithi037.stdout: "kstore_onode_map_size": "1024", 2024-09-22T03:49:22.999 INFO:teuthology.orchestra.run.smithi037.stdout: "kstore_rocksdb_options": "compression=kNoCompression", 2024-09-22T03:49:22.999 INFO:teuthology.orchestra.run.smithi037.stdout: "kstore_sync_submit_transaction": "false", 2024-09-22T03:49:22.999 INFO:teuthology.orchestra.run.smithi037.stdout: "kstore_sync_transaction": "false", 2024-09-22T03:49:22.999 INFO:teuthology.orchestra.run.smithi037.stdout: "librados_thread_count": "2", 2024-09-22T03:49:22.999 INFO:teuthology.orchestra.run.smithi037.stdout: "lockdep": "false", 2024-09-22T03:49:22.999 INFO:teuthology.orchestra.run.smithi037.stdout: "lockdep_force_backtrace": "false", 2024-09-22T03:49:22.999 INFO:teuthology.orchestra.run.smithi037.stdout: "log_coarse_timestamps": "true", 2024-09-22T03:49:22.999 INFO:teuthology.orchestra.run.smithi037.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2024-09-22T03:49:22.999 INFO:teuthology.orchestra.run.smithi037.stdout: "log_flush_on_exit": "false", 2024-09-22T03:49:22.999 INFO:teuthology.orchestra.run.smithi037.stdout: "log_graylog_host": "127.0.0.1", 2024-09-22T03:49:22.999 INFO:teuthology.orchestra.run.smithi037.stdout: "log_graylog_port": "12201", 2024-09-22T03:49:22.999 INFO:teuthology.orchestra.run.smithi037.stdout: "log_max_new": "1000", 2024-09-22T03:49:23.000 INFO:teuthology.orchestra.run.smithi037.stdout: "log_max_recent": "10000", 2024-09-22T03:49:23.000 INFO:teuthology.orchestra.run.smithi037.stdout: "log_stderr_prefix": "", 2024-09-22T03:49:23.000 INFO:teuthology.orchestra.run.smithi037.stdout: "log_stop_at_utilization": "0.970000", 2024-09-22T03:49:23.000 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": "true", 2024-09-22T03:49:23.000 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_graylog": "false", 2024-09-22T03:49:23.000 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_journald": "false", 2024-09-22T03:49:23.000 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_stderr": "false", 2024-09-22T03:49:23.000 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_syslog": "false", 2024-09-22T03:49:23.000 INFO:teuthology.orchestra.run.smithi037.stdout: "max_rotating_auth_attempts": "10", 2024-09-22T03:49:23.000 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_abort_on_newly_corrupt_dentry": "true", 2024-09-22T03:49:23.000 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_action_on_write_error": "1", 2024-09-22T03:49:23.000 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_alternate_name_max": "8192", 2024-09-22T03:49:23.000 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_asio_thread_count": "2", 2024-09-22T03:49:23.000 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_bal_export_pin": "true", 2024-09-22T03:49:23.001 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_bal_fragment_dirs": "true", 2024-09-22T03:49:23.001 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2024-09-22T03:49:23.001 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_bal_fragment_interval": "5", 2024-09-22T03:49:23.001 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_bal_fragment_size_max": "100000", 2024-09-22T03:49:23.001 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_bal_idle_threshold": "0.000000", 2024-09-22T03:49:23.001 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_bal_interval": "10", 2024-09-22T03:49:23.001 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_bal_max": "-1", 2024-09-22T03:49:23.001 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_bal_max_until": "-1", 2024-09-22T03:49:23.001 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_bal_merge_size": "50", 2024-09-22T03:49:23.001 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_bal_midchunk": "0.300000", 2024-09-22T03:49:23.001 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_bal_min_rebalance": "0.100000", 2024-09-22T03:49:23.001 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_bal_min_start": "0.200000", 2024-09-22T03:49:23.001 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_bal_minchunk": "0.001000", 2024-09-22T03:49:23.001 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_bal_mode": "0", 2024-09-22T03:49:23.001 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_bal_need_max": "1.200000", 2024-09-22T03:49:23.001 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_bal_need_min": "0.800000", 2024-09-22T03:49:23.002 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_bal_overload_epochs": "2", 2024-09-22T03:49:23.002 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_bal_replicate_threshold": "8000.000000", 2024-09-22T03:49:23.002 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_bal_sample_interval": "3.000000", 2024-09-22T03:49:23.002 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_bal_split_bits": "3", 2024-09-22T03:49:23.002 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_bal_split_rd": "25000.000000", 2024-09-22T03:49:23.002 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_bal_split_size": "10000", 2024-09-22T03:49:23.002 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_bal_split_wr": "10000.000000", 2024-09-22T03:49:23.002 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_bal_target_decay": "10.000000", 2024-09-22T03:49:23.002 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2024-09-22T03:49:23.002 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_beacon_grace": "15.000000", 2024-09-22T03:49:23.002 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_beacon_interval": "4.000000", 2024-09-22T03:49:23.002 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_beacon_mon_down_grace": "60", 2024-09-22T03:49:23.002 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_cache_memory_limit": "4294967296", 2024-09-22T03:49:23.002 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_cache_mid": "0.700000", 2024-09-22T03:49:23.003 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_cache_quiesce_decay_rate": "1.000000", 2024-09-22T03:49:23.003 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_cache_quiesce_delay": "0", 2024-09-22T03:49:23.003 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_cache_quiesce_sleep": "200", 2024-09-22T03:49:23.003 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_cache_quiesce_splitauth": "true", 2024-09-22T03:49:23.003 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_cache_quiesce_threshold": "524288", 2024-09-22T03:49:23.003 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_cache_release_free_interval": "10", 2024-09-22T03:49:23.003 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_cache_reservation": "0.050000", 2024-09-22T03:49:23.003 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_cache_trim_decay_rate": "1.000000", 2024-09-22T03:49:23.003 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_cache_trim_interval": "1", 2024-09-22T03:49:23.003 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_cache_trim_threshold": "262144", 2024-09-22T03:49:23.003 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2024-09-22T03:49:23.003 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2024-09-22T03:49:23.003 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_client_delegate_inos_pct": "50", 2024-09-22T03:49:23.003 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_client_prealloc_inos": "1000", 2024-09-22T03:49:23.003 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2024-09-22T03:49:23.004 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_connect_bootstrapping": "false", 2024-09-22T03:49:23.004 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_damage_table_max_entries": "10000", 2024-09-22T03:49:23.004 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2024-09-22T03:49:23.004 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_debug_auth_pins": "false", 2024-09-22T03:49:23.004 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_debug_frag": "false", 2024-09-22T03:49:23.004 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_debug_scatterstat": "false", 2024-09-22T03:49:23.004 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_debug_subtrees": "false", 2024-09-22T03:49:23.004 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_decay_halflife": "5.000000", 2024-09-22T03:49:23.004 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_default_dir_hash": "2", 2024-09-22T03:49:23.004 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_defer_session_stale": "true", 2024-09-22T03:49:23.004 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_deny_all_reconnect": "false", 2024-09-22T03:49:23.004 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_dir_keys_per_op": "16384", 2024-09-22T03:49:23.004 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_dir_max_commit_size": "10", 2024-09-22T03:49:23.004 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_dir_max_entries": "0", 2024-09-22T03:49:23.005 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_dir_prefetch": "true", 2024-09-22T03:49:23.005 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_dirstat_min_interval": "1.000000", 2024-09-22T03:49:23.005 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_dump_cache_after_rejoin": "false", 2024-09-22T03:49:23.005 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_dump_cache_on_map": "false", 2024-09-22T03:49:23.005 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_dump_cache_threshold_file": "0", 2024-09-22T03:49:23.005 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2024-09-22T03:49:23.005 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_early_reply": "true", 2024-09-22T03:49:23.005 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_enable_op_tracker": "true", 2024-09-22T03:49:23.005 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_enforce_unique_name": "true", 2024-09-22T03:49:23.005 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_export_ephemeral_distributed": "true", 2024-09-22T03:49:23.005 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2024-09-22T03:49:23.005 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_export_ephemeral_random": "true", 2024-09-22T03:49:23.005 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_export_ephemeral_random_max": "0.010000", 2024-09-22T03:49:23.005 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_extraordinary_events_dump_interval": "0", 2024-09-22T03:49:23.006 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_forward_all_requests_to_auth": "false", 2024-09-22T03:49:23.006 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_freeze_tree_timeout": "30.000000", 2024-09-22T03:49:23.006 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_fscrypt_last_block_max_size": "4096", 2024-09-22T03:49:23.006 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_go_bad_corrupt_dentry": "true", 2024-09-22T03:49:23.006 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2024-09-22T03:49:23.006 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_health_cache_threshold": "1.500000", 2024-09-22T03:49:23.006 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_health_summarize_threshold": "10", 2024-09-22T03:49:23.006 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_heartbeat_grace": "15.000000", 2024-09-22T03:49:23.006 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_heartbeat_reset_grace": "1000", 2024-09-22T03:49:23.006 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_inject_health_dummy": "false", 2024-09-22T03:49:23.006 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_inject_journal_corrupt_dentry_first": "0.000000", 2024-09-22T03:49:23.006 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_inject_migrator_session_race": "false", 2024-09-22T03:49:23.006 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_inject_rename_corrupt_dentry_first": "0.000000", 2024-09-22T03:49:23.006 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_inject_skip_replaying_inotable": "false", 2024-09-22T03:49:23.007 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2024-09-22T03:49:23.007 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_join_fs": "", 2024-09-22T03:49:23.007 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_journal_format": "1", 2024-09-22T03:49:23.007 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_kill_after_journal_logs_flushed": "false", 2024-09-22T03:49:23.007 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_kill_create_at": "0", 2024-09-22T03:49:23.007 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_kill_dirfrag_at": "0", 2024-09-22T03:49:23.007 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_kill_export_at": "0", 2024-09-22T03:49:23.007 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_kill_import_at": "0", 2024-09-22T03:49:23.007 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_kill_journal_at": "0", 2024-09-22T03:49:23.007 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_kill_journal_expire_at": "0", 2024-09-22T03:49:23.007 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_kill_journal_replay_at": "0", 2024-09-22T03:49:23.007 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_kill_link_at": "0", 2024-09-22T03:49:23.007 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_kill_mdstable_at": "0", 2024-09-22T03:49:23.007 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_kill_openc_at": "0", 2024-09-22T03:49:23.008 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_kill_rename_at": "0", 2024-09-22T03:49:23.008 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_kill_shutdown_at": "0", 2024-09-22T03:49:23.008 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_log_event_large_threshold": "524288", 2024-09-22T03:49:23.008 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_log_events_per_segment": "1024", 2024-09-22T03:49:23.008 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_log_major_segment_event_ratio": "12", 2024-09-22T03:49:23.008 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_log_max_events": "-1", 2024-09-22T03:49:23.008 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_log_max_segments": "128", 2024-09-22T03:49:23.008 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_log_pause": "false", 2024-09-22T03:49:23.008 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_log_segment_size": "0", 2024-09-22T03:49:23.008 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_log_skip_corrupt_events": "false", 2024-09-22T03:49:23.008 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_log_skip_unbounded_events": "false", 2024-09-22T03:49:23.008 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_log_trim_decay_rate": "1.000000", 2024-09-22T03:49:23.008 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_log_trim_threshold": "128", 2024-09-22T03:49:23.008 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_log_trim_upkeep_interval": "1000", 2024-09-22T03:49:23.008 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_log_warn_factor": "2.000000", 2024-09-22T03:49:23.008 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_max_caps_per_client": "1048576", 2024-09-22T03:49:23.009 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_max_completed_flushes": "100000", 2024-09-22T03:49:23.009 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_max_completed_requests": "100000", 2024-09-22T03:49:23.009 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_max_export_size": "20971520", 2024-09-22T03:49:23.009 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_max_file_recover": "32", 2024-09-22T03:49:23.009 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_max_purge_files": "64", 2024-09-22T03:49:23.009 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_max_purge_ops": "8192", 2024-09-22T03:49:23.009 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2024-09-22T03:49:23.009 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_max_scrub_ops_in_progress": "5", 2024-09-22T03:49:23.009 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_max_snaps_per_dir": "100", 2024-09-22T03:49:23.009 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_metrics_update_interval": "2", 2024-09-22T03:49:23.009 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_min_caps_per_client": "100", 2024-09-22T03:49:23.009 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_min_caps_working_set": "10000", 2024-09-22T03:49:23.009 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_mon_shutdown_timeout": "5.000000", 2024-09-22T03:49:23.009 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_numa_node": "-1", 2024-09-22T03:49:23.009 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_oft_prefetch_dirfrags": "false", 2024-09-22T03:49:23.009 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_op_complaint_time": "30.000000", 2024-09-22T03:49:23.010 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_op_history_duration": "600", 2024-09-22T03:49:23.010 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_op_history_size": "20", 2024-09-22T03:49:23.010 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_op_history_slow_op_size": "20", 2024-09-22T03:49:23.010 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_op_history_slow_op_threshold": "10", 2024-09-22T03:49:23.010 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_op_log_threshold": "5", 2024-09-22T03:49:23.010 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_ping_grace": "15", 2024-09-22T03:49:23.010 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_ping_interval": "5", 2024-09-22T03:49:23.010 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2024-09-22T03:49:23.010 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_recall_global_max_decay_threshold": "131072", 2024-09-22T03:49:23.010 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_recall_max_caps": "30000", 2024-09-22T03:49:23.010 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_recall_max_decay_rate": "1.500000", 2024-09-22T03:49:23.010 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_recall_max_decay_threshold": "131072", 2024-09-22T03:49:23.010 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_recall_warning_decay_rate": "60.000000", 2024-09-22T03:49:23.010 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_recall_warning_threshold": "262144", 2024-09-22T03:49:23.011 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_reconnect_timeout": "45.000000", 2024-09-22T03:49:23.011 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_replay_interval": "1.000000", 2024-09-22T03:49:23.011 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_replay_unsafe_with_closed_session": "false", 2024-09-22T03:49:23.011 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_request_load_average_decay_rate": "60.000000", 2024-09-22T03:49:23.011 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_root_ino_gid": "0", 2024-09-22T03:49:23.011 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_root_ino_uid": "0", 2024-09-22T03:49:23.011 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_scatter_nudge_interval": "5.000000", 2024-09-22T03:49:23.011 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_scrub_stats_review_period": "1", 2024-09-22T03:49:23.011 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_server_dispatch_client_request_delay": "0", 2024-09-22T03:49:23.011 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_server_dispatch_killpoint_random": "0.000000", 2024-09-22T03:49:23.011 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_session_blocklist_on_evict": "true", 2024-09-22T03:49:23.011 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_session_blocklist_on_timeout": "true", 2024-09-22T03:49:23.011 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2024-09-22T03:49:23.011 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_session_cache_liveness_magnitude": "10", 2024-09-22T03:49:23.011 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_session_cap_acquisition_decay_rate": "30.000000", 2024-09-22T03:49:23.012 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_session_cap_acquisition_throttle": "100000", 2024-09-22T03:49:23.012 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2024-09-22T03:49:23.012 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_session_metadata_threshold": "16777216", 2024-09-22T03:49:23.012 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_sessionmap_keys_per_op": "1024", 2024-09-22T03:49:23.012 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_shutdown_check": "0", 2024-09-22T03:49:23.012 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_skip_ino": "0", 2024-09-22T03:49:23.012 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_sleep_rank_change": "0.000000", 2024-09-22T03:49:23.012 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_snap_max_uid": "4294967294", 2024-09-22T03:49:23.012 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_snap_min_uid": "0", 2024-09-22T03:49:23.012 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_snap_rstat": "false", 2024-09-22T03:49:23.012 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_standby_replay_damaged": "false", 2024-09-22T03:49:23.012 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_symlink_recovery": "true", 2024-09-22T03:49:23.012 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_task_status_update_interval": "2.000000", 2024-09-22T03:49:23.012 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_thrash_exports": "0", 2024-09-22T03:49:23.012 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_thrash_fragments": "0", 2024-09-22T03:49:23.013 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_tick_interval": "5.000000", 2024-09-22T03:49:23.013 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_valgrind_exit": "false", 2024-09-22T03:49:23.013 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_verify_backtrace": "1", 2024-09-22T03:49:23.013 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_verify_scatter": "false", 2024-09-22T03:49:23.013 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_wipe_ino_prealloc": "false", 2024-09-22T03:49:23.013 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_wipe_sessions": "false", 2024-09-22T03:49:23.013 INFO:teuthology.orchestra.run.smithi037.stdout: "mempool_debug": "false", 2024-09-22T03:49:23.013 INFO:teuthology.orchestra.run.smithi037.stdout: "memstore_debug_omit_block_device_write": "false", 2024-09-22T03:49:23.013 INFO:teuthology.orchestra.run.smithi037.stdout: "memstore_device_bytes": "1073741824", 2024-09-22T03:49:23.013 INFO:teuthology.orchestra.run.smithi037.stdout: "memstore_page_set": "false", 2024-09-22T03:49:23.013 INFO:teuthology.orchestra.run.smithi037.stdout: "memstore_page_size": "65536", 2024-09-22T03:49:23.013 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr_client_bytes": "134217728", 2024-09-22T03:49:23.013 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr_client_messages": "512", 2024-09-22T03:49:23.013 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2024-09-22T03:49:23.013 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr_connect_retry_interval": "1.000000", 2024-09-22T03:49:23.013 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2024-09-22T03:49:23.014 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2024-09-22T03:49:23.014 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr_disabled_modules": "", 2024-09-22T03:49:23.014 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr_enable_op_tracker": "true", 2024-09-22T03:49:23.014 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr_initial_modules": "restful iostat nfs", 2024-09-22T03:49:23.014 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr_max_pg_creating": "1024", 2024-09-22T03:49:23.014 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr_max_pg_num_change": "128", 2024-09-22T03:49:23.014 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr_mds_bytes": "134217728", 2024-09-22T03:49:23.014 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr_mds_messages": "128", 2024-09-22T03:49:23.014 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2024-09-22T03:49:23.014 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr_mon_bytes": "134217728", 2024-09-22T03:49:23.014 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr_mon_messages": "128", 2024-09-22T03:49:23.014 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr_num_op_tracker_shard": "32", 2024-09-22T03:49:23.014 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr_op_complaint_time": "30.000000", 2024-09-22T03:49:23.014 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr_op_history_duration": "600", 2024-09-22T03:49:23.015 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr_op_history_size": "20", 2024-09-22T03:49:23.015 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr_op_history_slow_op_size": "20", 2024-09-22T03:49:23.015 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr_op_history_slow_op_threshold": "10.000000", 2024-09-22T03:49:23.015 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr_op_log_threshold": "5", 2024-09-22T03:49:23.015 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr_osd_bytes": "536870912", 2024-09-22T03:49:23.015 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr_osd_messages": "8192", 2024-09-22T03:49:23.015 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr_pool": "true", 2024-09-22T03:49:23.015 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr_service_beacon_grace": "60.000000", 2024-09-22T03:49:23.015 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr_standby_modules": "true", 2024-09-22T03:49:23.015 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr_stats_period": "5", 2024-09-22T03:49:23.015 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr_stats_threshold": "5", 2024-09-22T03:49:23.015 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr_tick_period": "2", 2024-09-22T03:49:23.015 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr_ttl_cache_expire_seconds": "0", 2024-09-22T03:49:23.015 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_accept_timeout_factor": "2.000000", 2024-09-22T03:49:23.015 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_allow_pool_delete": "true", 2024-09-22T03:49:23.016 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_allow_pool_size_one": "true", 2024-09-22T03:49:23.016 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_auth_validate_all_caps": "true", 2024-09-22T03:49:23.016 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2024-09-22T03:49:23.016 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2024-09-22T03:49:23.016 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_client_bytes": "104857600", 2024-09-22T03:49:23.016 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_client_directed_command_retry": "2", 2024-09-22T03:49:23.016 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_client_hunt_interval": "3.000000", 2024-09-22T03:49:23.016 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2024-09-22T03:49:23.016 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2024-09-22T03:49:23.016 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2024-09-22T03:49:23.016 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_client_hunt_parallel": "3", 2024-09-22T03:49:23.016 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_client_log_interval": "1.000000", 2024-09-22T03:49:23.016 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_client_max_log_entries_per_message": "1000", 2024-09-22T03:49:23.016 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_client_ping_interval": "10.000000", 2024-09-22T03:49:23.017 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_client_ping_timeout": "30.000000", 2024-09-22T03:49:23.017 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_client_target_rank": "-1", 2024-09-22T03:49:23.017 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_clock_drift_allowed": "1.000000", 2024-09-22T03:49:23.017 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2024-09-22T03:49:23.017 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2024-09-22T03:49:23.017 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_cluster_log_level": "debug", 2024-09-22T03:49:23.017 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_cluster_log_to_file": "true", 2024-09-22T03:49:23.017 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_cluster_log_to_graylog": "false", 2024-09-22T03:49:23.017 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2024-09-22T03:49:23.017 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_cluster_log_to_graylog_port": "12201", 2024-09-22T03:49:23.017 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_cluster_log_to_journald": "false", 2024-09-22T03:49:23.017 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_cluster_log_to_stderr": "false", 2024-09-22T03:49:23.017 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_cluster_log_to_syslog": "default=false", 2024-09-22T03:49:23.017 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2024-09-22T03:49:23.018 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_compact_on_bootstrap": "false", 2024-09-22T03:49:23.018 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_compact_on_start": "false", 2024-09-22T03:49:23.018 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_compact_on_trim": "true", 2024-09-22T03:49:23.018 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_con_tracker_persist_interval": "10", 2024-09-22T03:49:23.018 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_con_tracker_score_halflife": "43200", 2024-09-22T03:49:23.018 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_config_key_max_entry_size": "65536", 2024-09-22T03:49:23.018 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_cpu_threads": "4", 2024-09-22T03:49:23.018 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_crush_min_required_version": "hammer", 2024-09-22T03:49:23.018 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_daemon_bytes": "419430400", 2024-09-22T03:49:23.018 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2024-09-22T03:49:23.018 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_data_avail_crit": "5", 2024-09-22T03:49:23.018 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_data_avail_warn": "5", 2024-09-22T03:49:23.018 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_data_size_warn": "16106127360", 2024-09-22T03:49:23.018 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_debug_block_osdmap_trim": "false", 2024-09-22T03:49:23.019 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_debug_deprecated_as_obsolete": "false", 2024-09-22T03:49:23.019 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_debug_dump_json": "false", 2024-09-22T03:49:23.019 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2024-09-22T03:49:23.019 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_debug_dump_transactions": "false", 2024-09-22T03:49:23.019 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_debug_extra_checks": "false", 2024-09-22T03:49:23.019 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_debug_no_initial_persistent_features": "false", 2024-09-22T03:49:23.019 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2024-09-22T03:49:23.019 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_debug_no_require_reef": "false", 2024-09-22T03:49:23.019 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_debug_no_require_squid": "false", 2024-09-22T03:49:23.019 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2024-09-22T03:49:23.019 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_delta_reset_interval": "10.000000", 2024-09-22T03:49:23.019 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_dns_srv_name": "ceph-mon", 2024-09-22T03:49:23.019 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_down_mkfs_grace": "120", 2024-09-22T03:49:23.020 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_down_uptime_grace": "60", 2024-09-22T03:49:23.020 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_election_default_strategy": "1", 2024-09-22T03:49:23.020 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_election_timeout": "5.000000", 2024-09-22T03:49:23.020 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2024-09-22T03:49:23.020 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_elector_ping_divisor": "2", 2024-09-22T03:49:23.020 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_elector_ping_timeout": "2.000000", 2024-09-22T03:49:23.020 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_enable_op_tracker": "true", 2024-09-22T03:49:23.020 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_fake_pool_delete": "false", 2024-09-22T03:49:23.020 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_force_quorum_join": "false", 2024-09-22T03:49:23.020 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_fsmap_prune_threshold": "300", 2024-09-22T03:49:23.020 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_globalid_prealloc": "10000", 2024-09-22T03:49:23.020 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_health_detail_to_clog": "false", 2024-09-22T03:49:23.020 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_health_log_update_period": "5", 2024-09-22T03:49:23.020 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_health_max_detail": "50", 2024-09-22T03:49:23.020 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_health_to_clog": "true", 2024-09-22T03:49:23.021 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_health_to_clog_interval": "600", 2024-09-22T03:49:23.021 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2024-09-22T03:49:23.021 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_host": "172.21.15.37", 2024-09-22T03:49:23.021 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_host_override": "", 2024-09-22T03:49:23.021 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_initial_members": "", 2024-09-22T03:49:23.021 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2024-09-22T03:49:23.021 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2024-09-22T03:49:23.021 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_inject_transaction_delay_max": "10.000000", 2024-09-22T03:49:23.021 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2024-09-22T03:49:23.021 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_keyvaluedb": "rocksdb", 2024-09-22T03:49:23.021 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_lease": "5.000000", 2024-09-22T03:49:23.021 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2024-09-22T03:49:23.021 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_lease_renew_interval_factor": "0.600000", 2024-09-22T03:49:23.021 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_log_full_interval": "50", 2024-09-22T03:49:23.021 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_log_max": "10000", 2024-09-22T03:49:23.021 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_log_max_summary": "50", 2024-09-22T03:49:23.022 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_max_log_entries_per_event": "4096", 2024-09-22T03:49:23.022 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_max_log_epochs": "500", 2024-09-22T03:49:23.022 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_max_mdsmap_epochs": "500", 2024-09-22T03:49:23.022 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_max_mgrmap_epochs": "500", 2024-09-22T03:49:23.022 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_max_nvmeof_epochs": "500", 2024-09-22T03:49:23.022 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_max_osd": "10000", 2024-09-22T03:49:23.022 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_max_pg_per_osd": "10000", 2024-09-22T03:49:23.022 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_max_pool_pg_num": "65536", 2024-09-22T03:49:23.022 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_max_snap_prune_per_epoch": "100", 2024-09-22T03:49:23.022 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_mds_blocklist_interval": "86400.000000", 2024-09-22T03:49:23.022 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_mds_force_trim_to": "0", 2024-09-22T03:49:23.022 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_mds_skip_sanity": "false", 2024-09-22T03:49:23.022 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_memory_autotune": "true", 2024-09-22T03:49:23.022 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_memory_target": "2147483648", 2024-09-22T03:49:23.022 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_mgr_beacon_grace": "30", 2024-09-22T03:49:23.023 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2024-09-22T03:49:23.023 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_mgr_digest_period": "5", 2024-09-22T03:49:23.023 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_mgr_inactive_grace": "60", 2024-09-22T03:49:23.023 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_mgr_mkfs_grace": "240", 2024-09-22T03:49:23.023 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2024-09-22T03:49:23.023 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_min_osdmap_epochs": "50", 2024-09-22T03:49:23.023 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_nvmeofgw_beacon_grace": "10", 2024-09-22T03:49:23.023 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_nvmeofgw_set_group_id_retry": "1000", 2024-09-22T03:49:23.023 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_op_complaint_time": "30", 2024-09-22T03:49:23.023 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_op_history_duration": "600", 2024-09-22T03:49:23.023 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_op_history_size": "20", 2024-09-22T03:49:23.023 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_op_history_slow_op_size": "20", 2024-09-22T03:49:23.023 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_op_history_slow_op_threshold": "10", 2024-09-22T03:49:23.023 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_op_log_threshold": "5", 2024-09-22T03:49:23.023 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_osd_adjust_down_out_interval": "true", 2024-09-22T03:49:23.023 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2024-09-22T03:49:23.024 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2024-09-22T03:49:23.024 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_osd_auto_mark_in": "false", 2024-09-22T03:49:23.024 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_osd_auto_mark_new_in": "true", 2024-09-22T03:49:23.024 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2024-09-22T03:49:23.024 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2024-09-22T03:49:23.024 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_osd_cache_size": "500", 2024-09-22T03:49:23.024 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_osd_cache_size_min": "134217728", 2024-09-22T03:49:23.024 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_osd_crush_smoke_test": "true", 2024-09-22T03:49:23.024 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_osd_destroyed_out_interval": "600", 2024-09-22T03:49:23.024 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_osd_down_out_interval": "600", 2024-09-22T03:49:23.024 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_osd_down_out_subtree_limit": "rack", 2024-09-22T03:49:23.024 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2024-09-22T03:49:23.024 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_osd_force_trim_to": "0", 2024-09-22T03:49:23.024 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_osd_full_ratio": "0.950000", 2024-09-22T03:49:23.024 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2024-09-22T03:49:23.025 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_osd_laggy_halflife": "3600", 2024-09-22T03:49:23.025 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_osd_laggy_max_interval": "300", 2024-09-22T03:49:23.025 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_osd_laggy_weight": "0.300000", 2024-09-22T03:49:23.025 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2024-09-22T03:49:23.025 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_osd_max_initial_pgs": "1024", 2024-09-22T03:49:23.025 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_osd_min_down_reporters": "2", 2024-09-22T03:49:23.025 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_osd_min_in_ratio": "0.750000", 2024-09-22T03:49:23.025 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_osd_min_up_ratio": "0.300000", 2024-09-22T03:49:23.025 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_osd_nearfull_ratio": "0.850000", 2024-09-22T03:49:23.025 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_osd_prime_pg_temp": "true", 2024-09-22T03:49:23.025 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2024-09-22T03:49:23.025 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2024-09-22T03:49:23.025 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_osd_report_timeout": "900", 2024-09-22T03:49:23.025 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_osd_reporter_subtree_level": "osd", 2024-09-22T03:49:23.025 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2024-09-22T03:49:23.025 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_osd_warn_num_repaired": "10", 2024-09-22T03:49:23.026 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_osd_warn_op_age": "32.000000", 2024-09-22T03:49:23.026 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_osdmap_full_prune_enabled": "true", 2024-09-22T03:49:23.026 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_osdmap_full_prune_interval": "2", 2024-09-22T03:49:23.026 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_osdmap_full_prune_min": "15", 2024-09-22T03:49:23.026 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_osdmap_full_prune_txsize": "2", 2024-09-22T03:49:23.026 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2024-09-22T03:49:23.026 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_pg_stuck_threshold": "60", 2024-09-22T03:49:23.026 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2024-09-22T03:49:23.026 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_pg_warn_min_objects": "10000", 2024-09-22T03:49:23.026 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_pg_warn_min_per_osd": "0", 2024-09-22T03:49:23.026 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_pg_warn_min_pool_objects": "1000", 2024-09-22T03:49:23.026 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_pool_quota_crit_threshold": "0", 2024-09-22T03:49:23.026 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_pool_quota_warn_threshold": "0", 2024-09-22T03:49:23.026 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_probe_timeout": "2.000000", 2024-09-22T03:49:23.027 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_reweight_max_change": "0.050000", 2024-09-22T03:49:23.027 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_reweight_max_osds": "4", 2024-09-22T03:49:23.027 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_reweight_min_bytes_per_osd": "10", 2024-09-22T03:49:23.027 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_reweight_min_pgs_per_osd": "4", 2024-09-22T03:49:23.027 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2024-09-22T03:49:23.027 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2024-09-22T03:49:23.027 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2024-09-22T03:49:23.027 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_scrub_interval": "86400", 2024-09-22T03:49:23.027 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_scrub_max_keys": "100", 2024-09-22T03:49:23.027 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_scrub_timeout": "300", 2024-09-22T03:49:23.027 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_session_timeout": "300", 2024-09-22T03:49:23.027 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_smart_report_timeout": "5", 2024-09-22T03:49:23.027 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_stat_smooth_intervals": "6", 2024-09-22T03:49:23.027 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2024-09-22T03:49:23.027 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_stretch_pool_min_size": "2", 2024-09-22T03:49:23.027 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_stretch_pool_size": "4", 2024-09-22T03:49:23.028 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2024-09-22T03:49:23.028 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_subscribe_interval": "86400.000000", 2024-09-22T03:49:23.028 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_sync_debug": "false", 2024-09-22T03:49:23.028 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_sync_max_payload_keys": "2000", 2024-09-22T03:49:23.028 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_sync_max_payload_size": "1048576", 2024-09-22T03:49:23.028 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_sync_provider_kill_at": "0", 2024-09-22T03:49:23.028 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_sync_requester_kill_at": "0", 2024-09-22T03:49:23.028 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_sync_timeout": "60.000000", 2024-09-22T03:49:23.028 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_target_pg_per_osd": "100", 2024-09-22T03:49:23.028 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_tick_interval": "5", 2024-09-22T03:49:23.028 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_timecheck_interval": "300.000000", 2024-09-22T03:49:23.028 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_timecheck_skew_interval": "30.000000", 2024-09-22T03:49:23.028 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_use_min_delay_socket": "false", 2024-09-22T03:49:23.028 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_warn_older_version_delay": "604800", 2024-09-22T03:49:23.028 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2024-09-22T03:49:23.029 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2024-09-22T03:49:23.029 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2024-09-22T03:49:23.029 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_warn_on_filestore_osds": "false", 2024-09-22T03:49:23.029 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_warn_on_insecure_global_id_reclaim": "false", 2024-09-22T03:49:23.029 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "false", 2024-09-22T03:49:23.029 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2024-09-22T03:49:23.029 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_warn_on_misplaced": "false", 2024-09-22T03:49:23.029 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2024-09-22T03:49:23.029 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_warn_on_older_version": "true", 2024-09-22T03:49:23.029 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2024-09-22T03:49:23.029 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_warn_on_pool_no_app": "true", 2024-09-22T03:49:23.029 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_warn_on_pool_no_redundancy": "false", 2024-09-22T03:49:23.029 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2024-09-22T03:49:23.029 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2024-09-22T03:49:23.029 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2024-09-22T03:49:23.029 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_warn_on_too_few_osds": "false", 2024-09-22T03:49:23.030 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2024-09-22T03:49:23.030 INFO:teuthology.orchestra.run.smithi037.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2024-09-22T03:49:23.030 INFO:teuthology.orchestra.run.smithi037.stdout: "monmap": "", 2024-09-22T03:49:23.030 INFO:teuthology.orchestra.run.smithi037.stdout: "motr_admin_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-09-22T03:49:23.030 INFO:teuthology.orchestra.run.smithi037.stdout: "motr_admin_fid": "0x7200000000000001:0x0", 2024-09-22T03:49:23.030 INFO:teuthology.orchestra.run.smithi037.stdout: "motr_ha_endpoint": "192.168.180.182@tcp:12345:1:1", 2024-09-22T03:49:23.030 INFO:teuthology.orchestra.run.smithi037.stdout: "motr_my_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-09-22T03:49:23.030 INFO:teuthology.orchestra.run.smithi037.stdout: "motr_my_fid": "0x7200000000000001:0x0", 2024-09-22T03:49:23.030 INFO:teuthology.orchestra.run.smithi037.stdout: "motr_profile_fid": "0x7000000000000001:0x0", 2024-09-22T03:49:23.030 INFO:teuthology.orchestra.run.smithi037.stdout: "motr_tracing_enabled": "false", 2024-09-22T03:49:23.030 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_async_op_threads": "3", 2024-09-22T03:49:23.030 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_async_rdma_buffer_size": "131072", 2024-09-22T03:49:23.030 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_async_rdma_cm": "false", 2024-09-22T03:49:23.030 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_async_rdma_device_name": "", 2024-09-22T03:49:23.030 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_async_rdma_dscp": "96", 2024-09-22T03:49:23.031 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_async_rdma_enable_hugepage": "false", 2024-09-22T03:49:23.031 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_async_rdma_gid_idx": "0", 2024-09-22T03:49:23.031 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_async_rdma_local_gid": "", 2024-09-22T03:49:23.031 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_async_rdma_polling_us": "1000", 2024-09-22T03:49:23.031 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_async_rdma_port_num": "1", 2024-09-22T03:49:23.031 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_async_rdma_receive_buffers": "32768", 2024-09-22T03:49:23.031 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_async_rdma_receive_queue_len": "4096", 2024-09-22T03:49:23.031 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_async_rdma_roce_ver": "1", 2024-09-22T03:49:23.031 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_async_rdma_send_buffers": "1024", 2024-09-22T03:49:23.031 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_async_rdma_sl": "3", 2024-09-22T03:49:23.031 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_async_rdma_support_srq": "true", 2024-09-22T03:49:23.031 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_async_rdma_type": "ib", 2024-09-22T03:49:23.031 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_async_reap_threshold": "5", 2024-09-22T03:49:23.031 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_bind_before_connect": "false", 2024-09-22T03:49:23.032 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_bind_ipv4": "true", 2024-09-22T03:49:23.032 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_bind_ipv6": "false", 2024-09-22T03:49:23.032 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_bind_msgr1": "true", 2024-09-22T03:49:23.032 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_bind_msgr2": "true", 2024-09-22T03:49:23.032 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_bind_port_max": "7568", 2024-09-22T03:49:23.032 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_bind_port_min": "6800", 2024-09-22T03:49:23.032 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_bind_prefer_ipv4": "false", 2024-09-22T03:49:23.032 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_bind_retry_count": "3", 2024-09-22T03:49:23.032 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_bind_retry_delay": "5", 2024-09-22T03:49:23.032 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_blackhole_client": "false", 2024-09-22T03:49:23.032 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_blackhole_mds": "false", 2024-09-22T03:49:23.032 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_blackhole_mgr": "false", 2024-09-22T03:49:23.032 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_blackhole_mon": "false", 2024-09-22T03:49:23.032 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_blackhole_osd": "false", 2024-09-22T03:49:23.032 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_client_mode": "crc", 2024-09-22T03:49:23.033 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_client_throttle_retry_time_interval": "5000", 2024-09-22T03:49:23.033 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_cluster_mode": "crc", 2024-09-22T03:49:23.033 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_cluster_type": "", 2024-09-22T03:49:23.033 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_compress_secure": "false", 2024-09-22T03:49:23.033 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_connection_idle_timeout": "900", 2024-09-22T03:49:23.033 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_connection_ready_timeout": "10", 2024-09-22T03:49:23.033 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_crc_data": "true", 2024-09-22T03:49:23.033 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_crc_header": "true", 2024-09-22T03:49:23.033 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_die_on_bad_msg": "false", 2024-09-22T03:49:23.033 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_die_on_bug": "true", 2024-09-22T03:49:23.033 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_die_on_old_message": "true", 2024-09-22T03:49:23.033 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_die_on_skipped_message": "false", 2024-09-22T03:49:23.033 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_die_on_unhandled_msg": "false", 2024-09-22T03:49:23.033 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_dispatch_throttle_bytes": "104857600", 2024-09-22T03:49:23.033 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_dpdk_coremask": "0xF", 2024-09-22T03:49:23.034 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_dpdk_debug_allow_loopback": "false", 2024-09-22T03:49:23.034 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_dpdk_devs_allowlist": "", 2024-09-22T03:49:23.034 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_dpdk_enable_tso": "true", 2024-09-22T03:49:23.034 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2024-09-22T03:49:23.034 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_dpdk_host_ipv4_addr": "", 2024-09-22T03:49:23.034 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_dpdk_hugepages": "", 2024-09-22T03:49:23.034 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_dpdk_hw_flow_control": "true", 2024-09-22T03:49:23.034 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2024-09-22T03:49:23.034 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_dpdk_lro": "true", 2024-09-22T03:49:23.034 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_dpdk_memory_channel": "4", 2024-09-22T03:49:23.034 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2024-09-22T03:49:23.034 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_dpdk_pmd": "", 2024-09-22T03:49:23.034 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_dpdk_port_id": "0", 2024-09-22T03:49:23.034 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2024-09-22T03:49:23.034 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_dump_corrupt_message_level": "1", 2024-09-22T03:49:23.035 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_dump_on_send": "false", 2024-09-22T03:49:23.035 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_initial_backoff": "0.200000", 2024-09-22T03:49:23.035 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_inject_delay_max": "1.000000", 2024-09-22T03:49:23.035 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_inject_delay_probability": "0.000000", 2024-09-22T03:49:23.035 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_inject_delay_type": "", 2024-09-22T03:49:23.035 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_inject_internal_delays": "0.000000", 2024-09-22T03:49:23.035 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_inject_network_congestion": "0", 2024-09-22T03:49:23.035 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_inject_socket_failures": "0", 2024-09-22T03:49:23.035 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_learn_addr_from_peer": "true", 2024-09-22T03:49:23.035 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_max_accept_failures": "4", 2024-09-22T03:49:23.035 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_max_backoff": "15.000000", 2024-09-22T03:49:23.035 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_mon_client_mode": "crc", 2024-09-22T03:49:23.035 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_mon_cluster_mode": "crc", 2024-09-22T03:49:23.035 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_mon_service_mode": "crc", 2024-09-22T03:49:23.035 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_osd_compress_min_size": "1024", 2024-09-22T03:49:23.036 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_osd_compress_mode": "none", 2024-09-22T03:49:23.036 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_osd_compression_algorithm": "snappy", 2024-09-22T03:49:23.036 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2024-09-22T03:49:23.036 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_pq_min_cost": "65536", 2024-09-22T03:49:23.036 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_public_type": "", 2024-09-22T03:49:23.036 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_service_mode": "crc", 2024-09-22T03:49:23.036 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_tcp_listen_backlog": "512", 2024-09-22T03:49:23.036 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_tcp_nodelay": "true", 2024-09-22T03:49:23.036 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_tcp_prefetch_max_size": "4096", 2024-09-22T03:49:23.036 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_tcp_rcvbuf": "0", 2024-09-22T03:49:23.036 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_time_events_min_wait_interval": "1000", 2024-09-22T03:49:23.036 INFO:teuthology.orchestra.run.smithi037.stdout: "ms_type": "async+posix", 2024-09-22T03:49:23.036 INFO:teuthology.orchestra.run.smithi037.stdout: "no_config_file": "false", 2024-09-22T03:49:23.036 INFO:teuthology.orchestra.run.smithi037.stdout: "nvmeof_mon_client_disconnect_panic": "100", 2024-09-22T03:49:23.037 INFO:teuthology.orchestra.run.smithi037.stdout: "nvmeof_mon_client_tick_period": "2", 2024-09-22T03:49:23.037 INFO:teuthology.orchestra.run.smithi037.stdout: "objecter_completion_locks_per_session": "32", 2024-09-22T03:49:23.037 INFO:teuthology.orchestra.run.smithi037.stdout: "objecter_debug_inject_relock_delay": "false", 2024-09-22T03:49:23.037 INFO:teuthology.orchestra.run.smithi037.stdout: "objecter_inflight_op_bytes": "104857600", 2024-09-22T03:49:23.037 INFO:teuthology.orchestra.run.smithi037.stdout: "objecter_inflight_ops": "1024", 2024-09-22T03:49:23.037 INFO:teuthology.orchestra.run.smithi037.stdout: "objecter_inject_no_watch_ping": "false", 2024-09-22T03:49:23.037 INFO:teuthology.orchestra.run.smithi037.stdout: "objecter_retry_writes_after_first_reply": "false", 2024-09-22T03:49:23.037 INFO:teuthology.orchestra.run.smithi037.stdout: "objecter_tick_interval": "5.000000", 2024-09-22T03:49:23.037 INFO:teuthology.orchestra.run.smithi037.stdout: "objecter_timeout": "10.000000", 2024-09-22T03:49:23.037 INFO:teuthology.orchestra.run.smithi037.stdout: "objectstore_blackhole": "false", 2024-09-22T03:49:23.037 INFO:teuthology.orchestra.run.smithi037.stdout: "objectstore_debug_throw_on_failed_txc": "false", 2024-09-22T03:49:23.037 INFO:teuthology.orchestra.run.smithi037.stdout: "openssl_engine_opts": "", 2024-09-22T03:49:23.037 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_agent_delay_time": "5.000000", 2024-09-22T03:49:23.037 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_agent_hist_halflife": "1000", 2024-09-22T03:49:23.037 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_agent_max_low_ops": "2", 2024-09-22T03:49:23.038 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_agent_max_ops": "4", 2024-09-22T03:49:23.038 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_agent_min_evict_effort": "0.100000", 2024-09-22T03:49:23.038 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_agent_quantize_effort": "0.100000", 2024-09-22T03:49:23.038 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_agent_slop": "0.020000", 2024-09-22T03:49:23.038 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_aggregated_slow_ops_logging": "true", 2024-09-22T03:49:23.038 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_allow_recovery_below_min_size": "true", 2024-09-22T03:49:23.038 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_asio_thread_count": "2", 2024-09-22T03:49:23.038 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_async_recovery_min_cost": "100", 2024-09-22T03:49:23.038 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_auto_mark_unfound_lost": "false", 2024-09-22T03:49:23.038 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_backfill_retry_interval": "30.000000", 2024-09-22T03:49:23.038 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_backfill_scan_max": "512", 2024-09-22T03:49:23.038 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_backfill_scan_min": "64", 2024-09-22T03:49:23.038 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_backoff_on_degraded": "false", 2024-09-22T03:49:23.038 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_backoff_on_peering": "false", 2024-09-22T03:49:23.039 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_backoff_on_unfound": "true", 2024-09-22T03:49:23.039 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_beacon_report_interval": "300", 2024-09-22T03:49:23.039 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_bench_duration": "30", 2024-09-22T03:49:23.039 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_bench_large_size_max_throughput": "104857600", 2024-09-22T03:49:23.039 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_bench_max_block_size": "67108864", 2024-09-22T03:49:23.039 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_bench_small_size_max_iops": "100", 2024-09-22T03:49:23.039 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_blkin_trace_all": "false", 2024-09-22T03:49:23.039 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_blocked_scrub_grace_period": "120", 2024-09-22T03:49:23.039 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2024-09-22T03:49:23.039 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_calc_pg_upmaps_aggressively_fast": "true", 2024-09-22T03:49:23.039 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2024-09-22T03:49:23.039 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_check_for_log_corruption": "false", 2024-09-22T03:49:23.039 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_check_max_object_name_len_on_startup": "true", 2024-09-22T03:49:23.039 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-09-22T03:49:23.039 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_class_dir": "/usr/lib64/rados-classes", 2024-09-22T03:49:23.040 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-09-22T03:49:23.040 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_class_update_on_start": "true", 2024-09-22T03:49:23.040 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_client_message_cap": "256", 2024-09-22T03:49:23.040 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_client_message_size_cap": "524288000", 2024-09-22T03:49:23.040 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_client_op_priority": "63", 2024-09-22T03:49:23.040 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_client_watch_timeout": "30", 2024-09-22T03:49:23.040 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_command_max_records": "256", 2024-09-22T03:49:23.040 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_compact_on_start": "false", 2024-09-22T03:49:23.040 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_copyfrom_max_chunk": "8388608", 2024-09-22T03:49:23.040 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_crush_chooseleaf_type": "0", 2024-09-22T03:49:23.040 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_crush_initial_weight": "-1.000000", 2024-09-22T03:49:23.040 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_crush_update_on_start": "true", 2024-09-22T03:49:23.040 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_crush_update_weight_set": "true", 2024-09-22T03:49:23.040 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2024-09-22T03:49:23.041 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2024-09-22T03:49:23.041 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2024-09-22T03:49:23.041 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_debug_drop_ping_duration": "0", 2024-09-22T03:49:23.041 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_debug_drop_ping_probability": "0.000000", 2024-09-22T03:49:23.041 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_debug_feed_pullee": "-1", 2024-09-22T03:49:23.041 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_debug_inject_copyfrom_error": "false", 2024-09-22T03:49:23.041 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2024-09-22T03:49:23.041 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2024-09-22T03:49:23.041 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_debug_misdirected_ops": "false", 2024-09-22T03:49:23.041 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_debug_no_acting_change": "false", 2024-09-22T03:49:23.041 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_debug_no_purge_strays": "false", 2024-09-22T03:49:23.041 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_debug_op_order": "false", 2024-09-22T03:49:23.041 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_debug_pg_log_writeout": "false", 2024-09-22T03:49:23.041 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_debug_pretend_recovery_active": "false", 2024-09-22T03:49:23.042 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_debug_random_push_read_error": "0.000000", 2024-09-22T03:49:23.042 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2024-09-22T03:49:23.042 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_debug_shutdown": "false", 2024-09-22T03:49:23.042 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2024-09-22T03:49:23.042 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2024-09-22T03:49:23.042 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_debug_trim_objects": "false", 2024-09-22T03:49:23.042 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_debug_verify_cached_snaps": "false", 2024-09-22T03:49:23.042 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_debug_verify_missing_on_start": "false", 2024-09-22T03:49:23.042 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_debug_verify_snaps": "false", 2024-09-22T03:49:23.042 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_debug_verify_stray_on_activate": "false", 2024-09-22T03:49:23.042 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_deep_scrub_interval": "604800.000000", 2024-09-22T03:49:23.042 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_deep_scrub_keys": "1024", 2024-09-22T03:49:23.042 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2024-09-22T03:49:23.043 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2024-09-22T03:49:23.043 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2024-09-22T03:49:23.043 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_deep_scrub_stride": "524288", 2024-09-22T03:49:23.043 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2024-09-22T03:49:23.043 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_default_data_pool_replay_window": "5", 2024-09-22T03:49:23.043 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_default_notify_timeout": "30", 2024-09-22T03:49:23.043 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_delete_sleep": "0.000000", 2024-09-22T03:49:23.043 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_delete_sleep_hdd": "5.000000", 2024-09-22T03:49:23.043 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_delete_sleep_hybrid": "1.000000", 2024-09-22T03:49:23.043 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_delete_sleep_ssd": "1.000000", 2024-09-22T03:49:23.043 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_discard_disconnected_ops": "true", 2024-09-22T03:49:23.043 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_ec_partial_reads": "true", 2024-09-22T03:49:23.043 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_enable_op_tracker": "true", 2024-09-22T03:49:23.043 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_erasure_code_plugins": "jerasure lrc", 2024-09-22T03:49:23.043 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_extblkdev_plugins": "vdo", 2024-09-22T03:49:23.043 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_failsafe_full_ratio": "0.970000", 2024-09-22T03:49:23.044 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_fast_fail_on_connection_refused": "true", 2024-09-22T03:49:23.044 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_fast_info": "true", 2024-09-22T03:49:23.044 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_fast_shutdown": "true", 2024-09-22T03:49:23.044 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_fast_shutdown_notify_mon": "true", 2024-09-22T03:49:23.044 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_fast_shutdown_timeout": "15", 2024-09-22T03:49:23.044 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_find_best_info_ignore_history_les": "false", 2024-09-22T03:49:23.044 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_force_auth_primary_missing_objects": "100", 2024-09-22T03:49:23.044 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2024-09-22T03:49:23.044 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_function_tracing": "false", 2024-09-22T03:49:23.044 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_heartbeat_grace": "20", 2024-09-22T03:49:23.044 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_heartbeat_interval": "6", 2024-09-22T03:49:23.044 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2024-09-22T03:49:23.044 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_heartbeat_min_peers": "10", 2024-09-22T03:49:23.044 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_heartbeat_min_size": "2000", 2024-09-22T03:49:23.045 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_heartbeat_stale": "600", 2024-09-22T03:49:23.045 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2024-09-22T03:49:23.045 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_hit_set_max_size": "100000", 2024-09-22T03:49:23.045 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_hit_set_min_size": "1000", 2024-09-22T03:49:23.045 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_hit_set_namespace": ".ceph-internal", 2024-09-22T03:49:23.045 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_ignore_stale_divergent_priors": "false", 2024-09-22T03:49:23.045 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2024-09-22T03:49:23.045 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_inject_failure_on_pg_removal": "false", 2024-09-22T03:49:23.045 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2024-09-22T03:49:23.045 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_journal_flush_on_shutdown": "true", 2024-09-22T03:49:23.045 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_journal_size": "5120", 2024-09-22T03:49:23.045 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_kill_backfill_at": "0", 2024-09-22T03:49:23.045 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_loop_before_reset_tphandle": "64", 2024-09-22T03:49:23.045 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_map_cache_size": "50", 2024-09-22T03:49:23.046 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_map_dedup": "true", 2024-09-22T03:49:23.046 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_map_message_max": "40", 2024-09-22T03:49:23.046 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_map_message_max_bytes": "10485760", 2024-09-22T03:49:23.046 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_map_share_max_epochs": "40", 2024-09-22T03:49:23.046 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_max_attr_name_len": "100", 2024-09-22T03:49:23.046 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_max_attr_size": "0", 2024-09-22T03:49:23.046 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_max_backfills": "1", 2024-09-22T03:49:23.046 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_max_markdown_count": "5", 2024-09-22T03:49:23.046 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_max_markdown_period": "600", 2024-09-22T03:49:23.046 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_max_object_name_len": "2048", 2024-09-22T03:49:23.046 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_max_object_namespace_len": "256", 2024-09-22T03:49:23.046 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_max_object_size": "134217728", 2024-09-22T03:49:23.046 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2024-09-22T03:49:23.047 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_max_omap_entries_per_request": "1024", 2024-09-22T03:49:23.047 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_max_pg_blocked_by": "16", 2024-09-22T03:49:23.047 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_max_pg_log_entries": "10000", 2024-09-22T03:49:23.047 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2024-09-22T03:49:23.047 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_max_pgls": "1024", 2024-09-22T03:49:23.047 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_max_push_cost": "8388608", 2024-09-22T03:49:23.047 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_max_push_objects": "10", 2024-09-22T03:49:23.047 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_max_scrubs": "3", 2024-09-22T03:49:23.047 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2024-09-22T03:49:23.047 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_max_trimming_pgs": "2", 2024-09-22T03:49:23.047 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_max_write_op_reply_len": "64", 2024-09-22T03:49:23.047 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_max_write_size": "90", 2024-09-22T03:49:23.047 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_mclock_force_run_benchmark_on_init": "false", 2024-09-22T03:49:23.047 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_mclock_iops_capacity_threshold_hdd": "500.000000", 2024-09-22T03:49:23.048 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_mclock_iops_capacity_threshold_ssd": "80000.000000", 2024-09-22T03:49:23.048 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_mclock_max_capacity_iops_hdd": "315.000000", 2024-09-22T03:49:23.048 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_mclock_max_capacity_iops_ssd": "21500.000000", 2024-09-22T03:49:23.048 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_mclock_max_sequential_bandwidth_hdd": "157286400", 2024-09-22T03:49:23.048 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_mclock_max_sequential_bandwidth_ssd": "1258291200", 2024-09-22T03:49:23.048 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_mclock_override_recovery_settings": "false", 2024-09-22T03:49:23.048 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_mclock_profile": "balanced", 2024-09-22T03:49:23.048 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2024-09-22T03:49:23.048 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_mclock_scheduler_background_best_effort_lim": "0.000000", 2024-09-22T03:49:23.048 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_mclock_scheduler_background_best_effort_res": "0.000000", 2024-09-22T03:49:23.048 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2024-09-22T03:49:23.048 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_mclock_scheduler_background_recovery_lim": "0.000000", 2024-09-22T03:49:23.048 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_mclock_scheduler_background_recovery_res": "0.000000", 2024-09-22T03:49:23.048 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2024-09-22T03:49:23.048 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_mclock_scheduler_client_lim": "0.000000", 2024-09-22T03:49:23.049 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_mclock_scheduler_client_res": "0.000000", 2024-09-22T03:49:23.049 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_mclock_scheduler_client_wgt": "1", 2024-09-22T03:49:23.049 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_mclock_skip_benchmark": "false", 2024-09-22T03:49:23.049 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_memory_base": "805306368", 2024-09-22T03:49:23.049 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_memory_cache_min": "134217728", 2024-09-22T03:49:23.049 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_memory_cache_resize_interval": "1.000000", 2024-09-22T03:49:23.049 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_memory_expected_fragmentation": "0.150000", 2024-09-22T03:49:23.049 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_memory_target": "4294967296", 2024-09-22T03:49:23.049 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_memory_target_autotune": "false", 2024-09-22T03:49:23.049 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2024-09-22T03:49:23.049 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_min_pg_log_entries": "250", 2024-09-22T03:49:23.049 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_min_recovery_priority": "0", 2024-09-22T03:49:23.049 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_mon_heartbeat_interval": "30", 2024-09-22T03:49:23.049 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2024-09-22T03:49:23.050 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_mon_report_interval": "5", 2024-09-22T03:49:23.050 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_mon_report_max_in_flight": "2", 2024-09-22T03:49:23.050 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_mon_shutdown_timeout": "5.000000", 2024-09-22T03:49:23.050 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_num_cache_shards": "32", 2024-09-22T03:49:23.050 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_num_op_tracker_shard": "32", 2024-09-22T03:49:23.050 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_numa_auto_affinity": "true", 2024-09-22T03:49:23.050 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_numa_node": "-1", 2024-09-22T03:49:23.050 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_numa_prefer_iface": "true", 2024-09-22T03:49:23.050 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_object_clean_region_max_num_intervals": "10", 2024-09-22T03:49:23.050 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_objecter_finishers": "1", 2024-09-22T03:49:23.050 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_objectstore": "bluestore", 2024-09-22T03:49:23.050 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_objectstore_fuse": "false", 2024-09-22T03:49:23.050 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_objectstore_ideal_list_max": "64", 2024-09-22T03:49:23.050 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_objectstore_tracing": "false", 2024-09-22T03:49:23.050 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_op_complaint_time": "30.000000", 2024-09-22T03:49:23.051 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_op_history_duration": "600", 2024-09-22T03:49:23.051 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_op_history_size": "20", 2024-09-22T03:49:23.051 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_op_history_slow_op_size": "20", 2024-09-22T03:49:23.051 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2024-09-22T03:49:23.051 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_op_log_threshold": "5", 2024-09-22T03:49:23.051 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_op_num_shards": "0", 2024-09-22T03:49:23.051 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_op_num_shards_hdd": "5", 2024-09-22T03:49:23.051 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_op_num_shards_ssd": "8", 2024-09-22T03:49:23.051 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_op_num_threads_per_shard": "0", 2024-09-22T03:49:23.051 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_op_num_threads_per_shard_hdd": "1", 2024-09-22T03:49:23.051 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2024-09-22T03:49:23.051 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2024-09-22T03:49:23.051 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_op_pq_min_cost": "65536", 2024-09-22T03:49:23.051 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_op_queue": "mclock_scheduler", 2024-09-22T03:49:23.052 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_op_queue_cut_off": "high", 2024-09-22T03:49:23.052 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_op_thread_suicide_timeout": "150", 2024-09-22T03:49:23.052 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_op_thread_timeout": "15", 2024-09-22T03:49:23.052 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_open_classes_on_start": "true", 2024-09-22T03:49:23.052 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_os_flags": "0", 2024-09-22T03:49:23.052 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_peering_op_priority": "255", 2024-09-22T03:49:23.052 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pg_delete_cost": "1048576", 2024-09-22T03:49:23.052 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pg_delete_priority": "5", 2024-09-22T03:49:23.052 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2024-09-22T03:49:23.052 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2024-09-22T03:49:23.052 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pg_log_dups_tracked": "3000", 2024-09-22T03:49:23.052 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pg_log_trim_max": "10000", 2024-09-22T03:49:23.052 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pg_log_trim_min": "100", 2024-09-22T03:49:23.052 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2024-09-22T03:49:23.053 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pg_object_context_cache_count": "64", 2024-09-22T03:49:23.053 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pg_stat_report_interval_max_epochs": "500", 2024-09-22T03:49:23.053 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pg_stat_report_interval_max_seconds": "5", 2024-09-22T03:49:23.053 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2024-09-22T03:49:23.053 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pool_default_cache_min_evict_age": "0", 2024-09-22T03:49:23.053 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pool_default_cache_min_flush_age": "0", 2024-09-22T03:49:23.053 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2024-09-22T03:49:23.053 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2024-09-22T03:49:23.053 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2024-09-22T03:49:23.053 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pool_default_crimson": "true", 2024-09-22T03:49:23.053 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pool_default_crush_rule": "-1", 2024-09-22T03:49:23.053 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pool_default_ec_fast_read": "false", 2024-09-22T03:49:23.053 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pool_default_erasure_code_profile": "plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd", 2024-09-22T03:49:23.053 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pool_default_flag_bulk": "false", 2024-09-22T03:49:23.053 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pool_default_flag_hashpspool": "true", 2024-09-22T03:49:23.054 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pool_default_flag_nodelete": "false", 2024-09-22T03:49:23.054 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pool_default_flag_nopgchange": "false", 2024-09-22T03:49:23.054 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pool_default_flag_nosizechange": "false", 2024-09-22T03:49:23.054 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pool_default_flags": "0", 2024-09-22T03:49:23.054 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2024-09-22T03:49:23.054 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pool_default_min_size": "2", 2024-09-22T03:49:23.054 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2024-09-22T03:49:23.054 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pool_default_pg_num": "32", 2024-09-22T03:49:23.054 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pool_default_pgp_num": "0", 2024-09-22T03:49:23.054 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2024-09-22T03:49:23.054 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pool_default_read_ratio": "70", 2024-09-22T03:49:23.054 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pool_default_size": "3", 2024-09-22T03:49:23.054 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pool_default_type": "replicated", 2024-09-22T03:49:23.054 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pool_erasure_code_stripe_unit": "4096", 2024-09-22T03:49:23.055 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pool_use_gmt_hitset": "true", 2024-09-22T03:49:23.055 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_push_per_object_cost": "1000", 2024-09-22T03:49:23.055 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_read_ec_check_for_errors": "false", 2024-09-22T03:49:23.055 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_recover_clone_overlap": "true", 2024-09-22T03:49:23.055 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_recover_clone_overlap_limit": "10", 2024-09-22T03:49:23.055 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_recovery_cost": "20971520", 2024-09-22T03:49:23.055 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_recovery_delay_start": "0.000000", 2024-09-22T03:49:23.055 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_recovery_max_active": "0", 2024-09-22T03:49:23.055 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_recovery_max_active_hdd": "3", 2024-09-22T03:49:23.055 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_recovery_max_active_ssd": "10", 2024-09-22T03:49:23.055 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_recovery_max_chunk": "8388608", 2024-09-22T03:49:23.055 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2024-09-22T03:49:23.055 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_recovery_max_single_start": "1", 2024-09-22T03:49:23.055 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_recovery_op_priority": "3", 2024-09-22T03:49:23.056 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_recovery_op_warn_multiple": "16", 2024-09-22T03:49:23.056 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_recovery_priority": "5", 2024-09-22T03:49:23.056 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_recovery_retry_interval": "30.000000", 2024-09-22T03:49:23.056 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_recovery_sleep": "0.000000", 2024-09-22T03:49:23.056 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_recovery_sleep_hdd": "0.100000", 2024-09-22T03:49:23.056 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2024-09-22T03:49:23.056 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_recovery_sleep_ssd": "0.000000", 2024-09-22T03:49:23.056 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_repair_during_recovery": "false", 2024-09-22T03:49:23.056 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_requested_scrub_priority": "5", 2024-09-22T03:49:23.056 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_rocksdb_iterator_bounds_enabled": "true", 2024-09-22T03:49:23.056 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_rollback_to_cluster_snap": "", 2024-09-22T03:49:23.056 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_scrub_auto_repair": "false", 2024-09-22T03:49:23.056 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_scrub_auto_repair_num_errors": "5", 2024-09-22T03:49:23.056 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_scrub_backoff_ratio": "0.660000", 2024-09-22T03:49:23.057 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_scrub_begin_hour": "0", 2024-09-22T03:49:23.057 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_scrub_begin_week_day": "0", 2024-09-22T03:49:23.057 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_scrub_chunk_max": "15", 2024-09-22T03:49:23.057 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_scrub_chunk_min": "5", 2024-09-22T03:49:23.057 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_scrub_cost": "52428800", 2024-09-22T03:49:23.057 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_scrub_disable_reservation_queuing": "false", 2024-09-22T03:49:23.057 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_scrub_during_recovery": "false", 2024-09-22T03:49:23.057 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_scrub_end_hour": "0", 2024-09-22T03:49:23.057 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_scrub_end_week_day": "0", 2024-09-22T03:49:23.057 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_scrub_event_cost": "4096", 2024-09-22T03:49:23.057 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_scrub_extended_sleep": "0.000000", 2024-09-22T03:49:23.057 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2024-09-22T03:49:23.057 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_scrub_invalid_stats": "true", 2024-09-22T03:49:23.057 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_scrub_load_threshold": "0.500000", 2024-09-22T03:49:23.057 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_scrub_max_interval": "604800.000000", 2024-09-22T03:49:23.058 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_scrub_max_preemptions": "5", 2024-09-22T03:49:23.058 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_scrub_min_interval": "86400.000000", 2024-09-22T03:49:23.058 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_scrub_priority": "5", 2024-09-22T03:49:23.058 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_scrub_retry_after_noscrub": "60", 2024-09-22T03:49:23.058 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_scrub_retry_delay": "30", 2024-09-22T03:49:23.058 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_scrub_retry_new_interval": "10", 2024-09-22T03:49:23.058 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_scrub_retry_pg_state": "60", 2024-09-22T03:49:23.058 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_scrub_retry_trimming": "10", 2024-09-22T03:49:23.058 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_scrub_sleep": "0.000000", 2024-09-22T03:49:23.058 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_shallow_scrub_chunk_max": "100", 2024-09-22T03:49:23.058 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_shallow_scrub_chunk_min": "50", 2024-09-22T03:49:23.058 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_shutdown_pgref_assert": "false", 2024-09-22T03:49:23.058 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_skip_check_past_interval_bounds": "false", 2024-09-22T03:49:23.058 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_skip_data_digest": "false", 2024-09-22T03:49:23.058 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_smart_report_timeout": "5", 2024-09-22T03:49:23.058 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_snap_trim_cost": "1048576", 2024-09-22T03:49:23.059 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_snap_trim_priority": "5", 2024-09-22T03:49:23.059 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_snap_trim_sleep": "0.000000", 2024-09-22T03:49:23.059 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2024-09-22T03:49:23.059 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2024-09-22T03:49:23.059 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2024-09-22T03:49:23.059 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_stats_update_period_not_scrubbing": "120", 2024-09-22T03:49:23.059 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_stats_update_period_scrubbing": "15", 2024-09-22T03:49:23.059 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2024-09-22T03:49:23.059 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_target_transaction_size": "30", 2024-09-22T03:49:23.059 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_tier_default_cache_hit_set_count": "4", 2024-09-22T03:49:23.059 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2024-09-22T03:49:23.059 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2024-09-22T03:49:23.059 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2024-09-22T03:49:23.060 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2024-09-22T03:49:23.060 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2024-09-22T03:49:23.060 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2024-09-22T03:49:23.060 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_tier_default_cache_mode": "writeback", 2024-09-22T03:49:23.060 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2024-09-22T03:49:23.060 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_tier_promote_max_objects_sec": "25", 2024-09-22T03:49:23.060 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_tracing": "false", 2024-09-22T03:49:23.060 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_use_stale_snap": "false", 2024-09-22T03:49:23.060 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2024-09-22T03:49:23.060 INFO:teuthology.orchestra.run.smithi037.stdout: "osdc_blkin_trace_all": "false", 2024-09-22T03:49:23.060 INFO:teuthology.orchestra.run.smithi037.stdout: "paxos_kill_at": "0", 2024-09-22T03:49:23.060 INFO:teuthology.orchestra.run.smithi037.stdout: "paxos_max_join_drift": "10", 2024-09-22T03:49:23.060 INFO:teuthology.orchestra.run.smithi037.stdout: "paxos_min": "500", 2024-09-22T03:49:23.060 INFO:teuthology.orchestra.run.smithi037.stdout: "paxos_min_wait": "0.050000", 2024-09-22T03:49:23.061 INFO:teuthology.orchestra.run.smithi037.stdout: "paxos_propose_interval": "1.000000", 2024-09-22T03:49:23.061 INFO:teuthology.orchestra.run.smithi037.stdout: "paxos_service_trim_max": "500", 2024-09-22T03:49:23.061 INFO:teuthology.orchestra.run.smithi037.stdout: "paxos_service_trim_max_multiplier": "20", 2024-09-22T03:49:23.061 INFO:teuthology.orchestra.run.smithi037.stdout: "paxos_service_trim_min": "10", 2024-09-22T03:49:23.061 INFO:teuthology.orchestra.run.smithi037.stdout: "paxos_stash_full_interval": "25", 2024-09-22T03:49:23.061 INFO:teuthology.orchestra.run.smithi037.stdout: "paxos_trim_max": "500", 2024-09-22T03:49:23.061 INFO:teuthology.orchestra.run.smithi037.stdout: "paxos_trim_min": "250", 2024-09-22T03:49:23.061 INFO:teuthology.orchestra.run.smithi037.stdout: "perf": "true", 2024-09-22T03:49:23.061 INFO:teuthology.orchestra.run.smithi037.stdout: "pid_file": "/var/run/ceph/ceph-mon.a.pid", 2024-09-22T03:49:23.061 INFO:teuthology.orchestra.run.smithi037.stdout: "plugin_crypto_accelerator": "crypto_isal", 2024-09-22T03:49:23.061 INFO:teuthology.orchestra.run.smithi037.stdout: "plugin_dir": "/usr/lib64/ceph", 2024-09-22T03:49:23.061 INFO:teuthology.orchestra.run.smithi037.stdout: "public_addr": "-", 2024-09-22T03:49:23.061 INFO:teuthology.orchestra.run.smithi037.stdout: "public_addrv": "", 2024-09-22T03:49:23.061 INFO:teuthology.orchestra.run.smithi037.stdout: "public_bind_addr": "-", 2024-09-22T03:49:23.062 INFO:teuthology.orchestra.run.smithi037.stdout: "public_network": "", 2024-09-22T03:49:23.062 INFO:teuthology.orchestra.run.smithi037.stdout: "public_network_interface": "", 2024-09-22T03:49:23.062 INFO:teuthology.orchestra.run.smithi037.stdout: "qat_compressor_busy_polling": "false", 2024-09-22T03:49:23.062 INFO:teuthology.orchestra.run.smithi037.stdout: "qat_compressor_enabled": "false", 2024-09-22T03:49:23.062 INFO:teuthology.orchestra.run.smithi037.stdout: "qat_compressor_session_max_number": "256", 2024-09-22T03:49:23.062 INFO:teuthology.orchestra.run.smithi037.stdout: "rados_mon_op_timeout": "0", 2024-09-22T03:49:23.062 INFO:teuthology.orchestra.run.smithi037.stdout: "rados_osd_op_timeout": "0", 2024-09-22T03:49:23.062 INFO:teuthology.orchestra.run.smithi037.stdout: "rados_tracing": "false", 2024-09-22T03:49:23.062 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_atime_update_interval": "60", 2024-09-22T03:49:23.062 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2024-09-22T03:49:23.062 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_balance_parent_reads": "false", 2024-09-22T03:49:23.062 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_balance_snap_reads": "false", 2024-09-22T03:49:23.062 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_blkin_trace_all": "false", 2024-09-22T03:49:23.062 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_blocklist_expire_seconds": "0", 2024-09-22T03:49:23.063 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_blocklist_on_break_lock": "true", 2024-09-22T03:49:23.063 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_cache": "true", 2024-09-22T03:49:23.063 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_cache_block_writes_upfront": "false", 2024-09-22T03:49:23.063 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_cache_max_dirty": "25165824", 2024-09-22T03:49:23.063 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_cache_max_dirty_age": "1.000000", 2024-09-22T03:49:23.063 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_cache_max_dirty_object": "0", 2024-09-22T03:49:23.063 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_cache_policy": "writearound", 2024-09-22T03:49:23.063 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_cache_size": "33554432", 2024-09-22T03:49:23.063 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_cache_target_dirty": "16777216", 2024-09-22T03:49:23.063 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_cache_writethrough_until_flush": "true", 2024-09-22T03:49:23.063 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_clone_copy_on_read": "false", 2024-09-22T03:49:23.063 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_compression_hint": "none", 2024-09-22T03:49:23.063 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_concurrent_management_ops": "10", 2024-09-22T03:49:23.063 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_config_pool_override_update_timestamp": "0", 2024-09-22T03:49:23.063 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_default_clone_format": "auto", 2024-09-22T03:49:23.063 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_default_data_pool": "", 2024-09-22T03:49:23.064 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_default_features": "61", 2024-09-22T03:49:23.064 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_default_format": "2", 2024-09-22T03:49:23.064 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_default_map_options": "", 2024-09-22T03:49:23.064 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_default_order": "22", 2024-09-22T03:49:23.064 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_default_pool": "rbd", 2024-09-22T03:49:23.064 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_default_snapshot_quiesce_mode": "required", 2024-09-22T03:49:23.064 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_default_stripe_count": "0", 2024-09-22T03:49:23.064 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_default_stripe_unit": "0", 2024-09-22T03:49:23.064 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_disable_zero_copy_writes": "true", 2024-09-22T03:49:23.064 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_discard_granularity_bytes": "65536", 2024-09-22T03:49:23.064 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_discard_on_zeroed_write_same": "true", 2024-09-22T03:49:23.064 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_enable_alloc_hint": "true", 2024-09-22T03:49:23.064 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_invalidate_object_map_on_timeout": "true", 2024-09-22T03:49:23.064 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_io_scheduler": "simple", 2024-09-22T03:49:23.064 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2024-09-22T03:49:23.065 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_journal_commit_age": "5.000000", 2024-09-22T03:49:23.065 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2024-09-22T03:49:23.065 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_journal_max_payload_bytes": "16384", 2024-09-22T03:49:23.065 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_journal_object_flush_age": "0.000000", 2024-09-22T03:49:23.065 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_journal_object_flush_bytes": "1048576", 2024-09-22T03:49:23.065 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_journal_object_flush_interval": "0", 2024-09-22T03:49:23.065 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2024-09-22T03:49:23.065 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2024-09-22T03:49:23.065 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_journal_order": "24", 2024-09-22T03:49:23.065 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_journal_pool": "", 2024-09-22T03:49:23.065 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_journal_splay_width": "4", 2024-09-22T03:49:23.065 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_localize_parent_reads": "false", 2024-09-22T03:49:23.065 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_localize_snap_reads": "false", 2024-09-22T03:49:23.065 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2024-09-22T03:49:23.065 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2024-09-22T03:49:23.066 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2024-09-22T03:49:23.066 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2024-09-22T03:49:23.066 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2024-09-22T03:49:23.066 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2024-09-22T03:49:23.066 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_mirror_image_policy_type": "simple", 2024-09-22T03:49:23.066 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2024-09-22T03:49:23.066 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_mirror_image_state_check_interval": "30", 2024-09-22T03:49:23.066 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2024-09-22T03:49:23.066 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2024-09-22T03:49:23.066 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2024-09-22T03:49:23.066 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2024-09-22T03:49:23.066 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2024-09-22T03:49:23.066 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_mirror_memory_autotune": "true", 2024-09-22T03:49:23.066 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_mirror_memory_base": "805306368", 2024-09-22T03:49:23.067 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2024-09-22T03:49:23.067 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_mirror_memory_cache_min": "134217728", 2024-09-22T03:49:23.067 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2024-09-22T03:49:23.067 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2024-09-22T03:49:23.067 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_mirror_memory_target": "4294967296", 2024-09-22T03:49:23.067 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_mirror_perf_stats_prio": "5", 2024-09-22T03:49:23.067 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2024-09-22T03:49:23.067 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2024-09-22T03:49:23.067 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_mirroring_delete_delay": "0", 2024-09-22T03:49:23.067 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_mirroring_max_mirroring_snapshots": "5", 2024-09-22T03:49:23.067 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_mirroring_replay_delay": "0", 2024-09-22T03:49:23.067 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2024-09-22T03:49:23.067 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2024-09-22T03:49:23.067 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_move_to_trash_on_remove": "false", 2024-09-22T03:49:23.067 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2024-09-22T03:49:23.068 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_mtime_update_interval": "60", 2024-09-22T03:49:23.068 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_non_blocking_aio": "true", 2024-09-22T03:49:23.068 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_op_thread_timeout": "60", 2024-09-22T03:49:23.068 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_op_threads": "1", 2024-09-22T03:49:23.068 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_parent_cache_enabled": "false", 2024-09-22T03:49:23.068 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_persistent_cache_mode": "disabled", 2024-09-22T03:49:23.068 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_persistent_cache_path": "/tmp", 2024-09-22T03:49:23.068 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_persistent_cache_size": "1073741824", 2024-09-22T03:49:23.068 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_plugins": "", 2024-09-22T03:49:23.068 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_qos_bps_burst": "0", 2024-09-22T03:49:23.068 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_qos_bps_burst_seconds": "1", 2024-09-22T03:49:23.068 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_qos_bps_limit": "0", 2024-09-22T03:49:23.068 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_qos_exclude_ops": "0", 2024-09-22T03:49:23.068 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_qos_iops_burst": "0", 2024-09-22T03:49:23.068 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_qos_iops_burst_seconds": "1", 2024-09-22T03:49:23.069 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_qos_iops_limit": "0", 2024-09-22T03:49:23.069 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_qos_read_bps_burst": "0", 2024-09-22T03:49:23.069 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_qos_read_bps_burst_seconds": "1", 2024-09-22T03:49:23.069 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_qos_read_bps_limit": "0", 2024-09-22T03:49:23.069 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_qos_read_iops_burst": "0", 2024-09-22T03:49:23.069 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_qos_read_iops_burst_seconds": "1", 2024-09-22T03:49:23.069 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_qos_read_iops_limit": "0", 2024-09-22T03:49:23.069 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_qos_schedule_tick_min": "50", 2024-09-22T03:49:23.069 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_qos_write_bps_burst": "0", 2024-09-22T03:49:23.069 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_qos_write_bps_burst_seconds": "1", 2024-09-22T03:49:23.069 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_qos_write_bps_limit": "0", 2024-09-22T03:49:23.069 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_qos_write_iops_burst": "0", 2024-09-22T03:49:23.069 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_qos_write_iops_burst_seconds": "1", 2024-09-22T03:49:23.069 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_qos_write_iops_limit": "0", 2024-09-22T03:49:23.069 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_quiesce_notification_attempts": "10", 2024-09-22T03:49:23.070 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_read_from_replica_policy": "default", 2024-09-22T03:49:23.070 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2024-09-22T03:49:23.070 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_readahead_max_bytes": "524288", 2024-09-22T03:49:23.070 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_readahead_trigger_requests": "10", 2024-09-22T03:49:23.070 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_request_timed_out_seconds": "30", 2024-09-22T03:49:23.070 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_skip_partial_discard": "true", 2024-09-22T03:49:23.070 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2024-09-22T03:49:23.070 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_tracing": "false", 2024-09-22T03:49:23.070 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_validate_names": "true", 2024-09-22T03:49:23.070 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_validate_pool": "true", 2024-09-22T03:49:23.070 INFO:teuthology.orchestra.run.smithi037.stdout: "restapi_base_url": "", 2024-09-22T03:49:23.070 INFO:teuthology.orchestra.run.smithi037.stdout: "restapi_log_level": "", 2024-09-22T03:49:23.070 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_account_default_quota_max_objects": "-1", 2024-09-22T03:49:23.070 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_account_default_quota_max_size": "-1", 2024-09-22T03:49:23.071 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_acl_grants_max_num": "100", 2024-09-22T03:49:23.071 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_admin_entry": "admin", 2024-09-22T03:49:23.071 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_allow_notification_secrets_in_cleartext": "false", 2024-09-22T03:49:23.071 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_asio_assert_yielding": "false", 2024-09-22T03:49:23.071 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_backend_store": "rados", 2024-09-22T03:49:23.071 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_barbican_url": "", 2024-09-22T03:49:23.071 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_beast_enable_async": "true", 2024-09-22T03:49:23.071 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_bucket_counters_cache": "false", 2024-09-22T03:49:23.071 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_bucket_counters_cache_size": "10000", 2024-09-22T03:49:23.071 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2024-09-22T03:49:23.071 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_bucket_default_quota_max_size": "-1", 2024-09-22T03:49:23.071 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_bucket_index_max_aio": "128", 2024-09-22T03:49:23.071 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_bucket_index_transaction_instrumentation": "false", 2024-09-22T03:49:23.071 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_bucket_quota_cache_size": "10000", 2024-09-22T03:49:23.071 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_bucket_quota_ttl": "600", 2024-09-22T03:49:23.072 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_bucket_sync_spawn_window": "20", 2024-09-22T03:49:23.072 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_cache_enabled": "true", 2024-09-22T03:49:23.072 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_cache_expiry_interval": "900", 2024-09-22T03:49:23.072 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_cache_lru_size": "25000", 2024-09-22T03:49:23.072 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_config_store": "rados", 2024-09-22T03:49:23.072 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_content_length_compat": "false", 2024-09-22T03:49:23.072 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_copy_obj_progress": "true", 2024-09-22T03:49:23.072 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2024-09-22T03:49:23.072 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_cors_rules_max_num": "100", 2024-09-22T03:49:23.072 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_cross_domain_policy": "", 2024-09-22T03:49:23.072 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_crypt_default_encryption_key": "", 2024-09-22T03:49:23.072 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_crypt_kmip_addr": "", 2024-09-22T03:49:23.072 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_crypt_kmip_ca_path": "", 2024-09-22T03:49:23.072 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_crypt_kmip_client_cert": "", 2024-09-22T03:49:23.072 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_crypt_kmip_client_key": "", 2024-09-22T03:49:23.072 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_crypt_kmip_kms_key_template": "", 2024-09-22T03:49:23.073 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_crypt_kmip_password": "", 2024-09-22T03:49:23.073 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_crypt_kmip_s3_key_template": "$keyid", 2024-09-22T03:49:23.073 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_crypt_kmip_username": "", 2024-09-22T03:49:23.073 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_crypt_require_ssl": "true", 2024-09-22T03:49:23.073 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2024-09-22T03:49:23.073 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2024-09-22T03:49:23.073 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_crypt_sse_s3_backend": "vault", 2024-09-22T03:49:23.073 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_crypt_sse_s3_key_template": "%bucket_id", 2024-09-22T03:49:23.073 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_crypt_sse_s3_vault_addr": "", 2024-09-22T03:49:23.073 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_crypt_sse_s3_vault_auth": "token", 2024-09-22T03:49:23.073 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_crypt_sse_s3_vault_namespace": "", 2024-09-22T03:49:23.073 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_crypt_sse_s3_vault_prefix": "", 2024-09-22T03:49:23.073 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_crypt_sse_s3_vault_secret_engine": "transit", 2024-09-22T03:49:23.073 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_crypt_sse_s3_vault_ssl_cacert": "", 2024-09-22T03:49:23.073 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_crypt_sse_s3_vault_ssl_clientcert": "", 2024-09-22T03:49:23.074 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_crypt_sse_s3_vault_ssl_clientkey": "", 2024-09-22T03:49:23.074 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_crypt_sse_s3_vault_token_file": "", 2024-09-22T03:49:23.074 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_crypt_sse_s3_vault_verify_ssl": "true", 2024-09-22T03:49:23.074 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_crypt_suppress_logs": "true", 2024-09-22T03:49:23.074 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_crypt_vault_addr": "", 2024-09-22T03:49:23.074 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_crypt_vault_auth": "token", 2024-09-22T03:49:23.074 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_crypt_vault_namespace": "", 2024-09-22T03:49:23.074 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_crypt_vault_prefix": "", 2024-09-22T03:49:23.074 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_crypt_vault_secret_engine": "transit", 2024-09-22T03:49:23.074 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_crypt_vault_ssl_cacert": "", 2024-09-22T03:49:23.074 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_crypt_vault_ssl_clientcert": "", 2024-09-22T03:49:23.074 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_crypt_vault_ssl_clientkey": "", 2024-09-22T03:49:23.074 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_crypt_vault_token_file": "", 2024-09-22T03:49:23.074 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_crypt_vault_verify_ssl": "true", 2024-09-22T03:49:23.074 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_curl_buffersize": "524288", 2024-09-22T03:49:23.075 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_curl_low_speed_limit": "1024", 2024-09-22T03:49:23.075 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_curl_low_speed_time": "300", 2024-09-22T03:49:23.075 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_curl_tcp_keepalive": "0", 2024-09-22T03:49:23.075 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_curl_wait_timeout_ms": "1000", 2024-09-22T03:49:23.075 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_d3n_l1_datacache_persistent_path": "/tmp/rgw_datacache/", 2024-09-22T03:49:23.075 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_d3n_l1_datacache_size": "1073741824", 2024-09-22T03:49:23.075 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_d3n_l1_evict_cache_on_start": "true", 2024-09-22T03:49:23.075 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_d3n_l1_eviction_policy": "lru", 2024-09-22T03:49:23.075 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_d3n_l1_fadvise": "4", 2024-09-22T03:49:23.075 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_d3n_l1_local_datacache_enabled": "false", 2024-09-22T03:49:23.075 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_d3n_libaio_aio_num": "64", 2024-09-22T03:49:23.075 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_d3n_libaio_aio_threads": "20", 2024-09-22T03:49:23.075 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_d4n_address": "127.0.0.1:6379", 2024-09-22T03:49:23.075 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_d4n_l1_datacache_address": "127.0.0.1:6379", 2024-09-22T03:49:23.076 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_d4n_l1_datacache_persistent_path": "/tmp/rgw_d4n_datacache/", 2024-09-22T03:49:23.076 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_d4n_l1_datacache_size": "1073741824", 2024-09-22T03:49:23.076 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_d4n_l1_evict_cache_on_start": "true", 2024-09-22T03:49:23.076 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_d4n_l1_fadvise": "4", 2024-09-22T03:49:23.076 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_d4n_libaio_aio_num": "64", 2024-09-22T03:49:23.076 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_d4n_libaio_aio_threads": "20", 2024-09-22T03:49:23.076 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-a", 2024-09-22T03:49:23.076 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_data_log_changes_size": "1000", 2024-09-22T03:49:23.076 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_data_log_num_shards": "128", 2024-09-22T03:49:23.076 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_data_log_obj_prefix": "data_log", 2024-09-22T03:49:23.076 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_data_log_window": "30", 2024-09-22T03:49:23.076 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_data_notify_interval_msec": "0", 2024-09-22T03:49:23.076 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_data_sync_poll_interval": "20", 2024-09-22T03:49:23.076 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_data_sync_spawn_window": "20", 2024-09-22T03:49:23.077 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_debug_inject_latency_bi_unlink": "0", 2024-09-22T03:49:23.077 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_debug_inject_olh_cancel_modification_err": "false", 2024-09-22T03:49:23.077 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_debug_inject_set_olh_err": "0", 2024-09-22T03:49:23.077 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_default_data_log_backing": "fifo", 2024-09-22T03:49:23.077 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_default_realm_info_oid": "default.realm", 2024-09-22T03:49:23.077 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_default_region_info_oid": "default.region", 2024-09-22T03:49:23.077 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_default_zone_info_oid": "default.zone", 2024-09-22T03:49:23.077 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2024-09-22T03:49:23.077 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_defer_to_bucket_acls": "", 2024-09-22T03:49:23.077 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_delete_multi_obj_max_num": "1000", 2024-09-22T03:49:23.077 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_disable_s3select": "false", 2024-09-22T03:49:23.077 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_dmclock_admin_lim": "0.000000", 2024-09-22T03:49:23.077 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_dmclock_admin_res": "100.000000", 2024-09-22T03:49:23.077 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2024-09-22T03:49:23.077 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_dmclock_auth_lim": "0.000000", 2024-09-22T03:49:23.077 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_dmclock_auth_res": "200.000000", 2024-09-22T03:49:23.078 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2024-09-22T03:49:23.078 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_dmclock_data_lim": "0.000000", 2024-09-22T03:49:23.078 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_dmclock_data_res": "500.000000", 2024-09-22T03:49:23.078 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_dmclock_data_wgt": "500.000000", 2024-09-22T03:49:23.078 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2024-09-22T03:49:23.078 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_dmclock_metadata_res": "500.000000", 2024-09-22T03:49:23.078 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2024-09-22T03:49:23.078 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_dns_name": "", 2024-09-22T03:49:23.078 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_dns_s3website_name": "", 2024-09-22T03:49:23.078 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_dynamic_resharding": "true", 2024-09-22T03:49:23.078 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_dynamic_resharding_may_reduce": "true", 2024-09-22T03:49:23.078 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_dynamic_resharding_reduction_wait": "120", 2024-09-22T03:49:23.078 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, notifications", 2024-09-22T03:49:23.078 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_enable_gc_threads": "true", 2024-09-22T03:49:23.078 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_enable_lc_threads": "true", 2024-09-22T03:49:23.079 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_enable_mdsearch": "true", 2024-09-22T03:49:23.079 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_enable_ops_log": "false", 2024-09-22T03:49:23.079 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_enable_quota_threads": "true", 2024-09-22T03:49:23.079 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_enable_static_website": "false", 2024-09-22T03:49:23.079 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_enable_usage_log": "false", 2024-09-22T03:49:23.079 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_enforce_swift_acls": "true", 2024-09-22T03:49:23.079 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_exit_timeout_secs": "120", 2024-09-22T03:49:23.079 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_expose_bucket": "false", 2024-09-22T03:49:23.079 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_extended_http_attrs": "", 2024-09-22T03:49:23.079 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_filter": "none", 2024-09-22T03:49:23.079 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_frontend_defaults": "beast ssl_certificate=config://rgw/cert/$realm/$zone.crt ssl_private_key=config://rgw/cert/$realm/$zone.key", 2024-09-22T03:49:23.079 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_frontends": "beast port=7480", 2024-09-22T03:49:23.079 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_gc_max_concurrent_io": "10", 2024-09-22T03:49:23.079 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_gc_max_deferred": "50", 2024-09-22T03:49:23.080 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2024-09-22T03:49:23.080 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_gc_max_objs": "32", 2024-09-22T03:49:23.080 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_gc_max_queue_size": "134213632", 2024-09-22T03:49:23.080 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_gc_max_trim_chunk": "16", 2024-09-22T03:49:23.080 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_gc_obj_min_wait": "7200", 2024-09-22T03:49:23.080 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_gc_processor_max_time": "3600", 2024-09-22T03:49:23.080 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_gc_processor_period": "3600", 2024-09-22T03:49:23.080 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_get_obj_max_req_size": "4194304", 2024-09-22T03:49:23.080 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_get_obj_window_size": "16777216", 2024-09-22T03:49:23.080 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_healthcheck_disabling_path": "", 2024-09-22T03:49:23.080 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_ignore_get_invalid_range": "false", 2024-09-22T03:49:23.080 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_init_timeout": "300", 2024-09-22T03:49:23.080 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2024-09-22T03:49:23.080 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_json_config": "/var/lib/ceph/radosgw/config.json", 2024-09-22T03:49:23.080 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_kafka_connection_idle": "300", 2024-09-22T03:49:23.081 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_kafka_message_timeout": "5000", 2024-09-22T03:49:23.081 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_kafka_sleep_timeout": "10", 2024-09-22T03:49:23.081 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_keystone_accepted_admin_roles": "", 2024-09-22T03:49:23.081 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_keystone_accepted_reader_roles": "", 2024-09-22T03:49:23.081 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2024-09-22T03:49:23.081 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_keystone_admin_domain": "", 2024-09-22T03:49:23.081 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_keystone_admin_password": "", 2024-09-22T03:49:23.081 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_keystone_admin_password_path": "", 2024-09-22T03:49:23.081 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_keystone_admin_project": "", 2024-09-22T03:49:23.081 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_keystone_admin_tenant": "", 2024-09-22T03:49:23.081 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_keystone_admin_token": "", 2024-09-22T03:49:23.081 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_keystone_admin_token_path": "", 2024-09-22T03:49:23.081 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_keystone_admin_user": "", 2024-09-22T03:49:23.081 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_keystone_barbican_domain": "", 2024-09-22T03:49:23.082 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_keystone_barbican_password": "", 2024-09-22T03:49:23.082 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_keystone_barbican_project": "", 2024-09-22T03:49:23.082 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_keystone_barbican_tenant": "", 2024-09-22T03:49:23.082 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_keystone_barbican_user": "", 2024-09-22T03:49:23.082 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_keystone_expired_token_cache_expiration": "3600", 2024-09-22T03:49:23.082 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_keystone_implicit_tenants": "false", 2024-09-22T03:49:23.082 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_keystone_service_token_accepted_roles": "admin", 2024-09-22T03:49:23.082 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_keystone_service_token_enabled": "false", 2024-09-22T03:49:23.082 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_keystone_token_cache_size": "10000", 2024-09-22T03:49:23.082 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_keystone_url": "", 2024-09-22T03:49:23.082 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_keystone_verify_ssl": "true", 2024-09-22T03:49:23.082 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_lc_debug_interval": "-1", 2024-09-22T03:49:23.082 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_lc_lock_max_time": "90", 2024-09-22T03:49:23.082 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_lc_max_objs": "32", 2024-09-22T03:49:23.082 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_lc_max_rules": "1000", 2024-09-22T03:49:23.083 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_lc_max_worker": "3", 2024-09-22T03:49:23.083 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_lc_max_wp_worker": "3", 2024-09-22T03:49:23.083 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_lc_thread_delay": "0", 2024-09-22T03:49:23.083 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2024-09-22T03:49:23.083 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_ldap_dnattr": "uid", 2024-09-22T03:49:23.083 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2024-09-22T03:49:23.083 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_ldap_searchfilter": "", 2024-09-22T03:49:23.083 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2024-09-22T03:49:23.083 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_ldap_uri": "", 2024-09-22T03:49:23.083 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_lfuda_sync_frequency": "60", 2024-09-22T03:49:23.083 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2024-09-22T03:49:23.083 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_list_bucket_min_readahead": "1000", 2024-09-22T03:49:23.083 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_list_buckets_max_chunk": "1000", 2024-09-22T03:49:23.083 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_log_http_headers": "", 2024-09-22T03:49:23.083 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_log_nonexistent_bucket": "false", 2024-09-22T03:49:23.084 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2024-09-22T03:49:23.084 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_log_object_name_utc": "false", 2024-09-22T03:49:23.084 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_lua_max_memory_per_state": "128000", 2024-09-22T03:49:23.084 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_luarocks_location": "/tmp/rgw_luarocks/mon.a", 2024-09-22T03:49:23.085 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_max_attr_name_len": "0", 2024-09-22T03:49:23.085 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_max_attr_size": "0", 2024-09-22T03:49:23.085 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_max_attrs_num_in_req": "0", 2024-09-22T03:49:23.085 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_max_chunk_size": "4194304", 2024-09-22T03:49:23.085 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_max_concurrent_requests": "1024", 2024-09-22T03:49:23.086 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_max_copy_obj_concurrent_io": "10", 2024-09-22T03:49:23.086 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_max_dynamic_shards": "1999", 2024-09-22T03:49:23.086 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_max_listing_results": "5000", 2024-09-22T03:49:23.086 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_max_notify_retries": "10", 2024-09-22T03:49:23.086 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_max_objs_per_shard": "100000", 2024-09-22T03:49:23.086 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_max_put_param_size": "1048576", 2024-09-22T03:49:23.086 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_max_put_size": "5368709120", 2024-09-22T03:49:23.086 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_max_slo_entries": "1000", 2024-09-22T03:49:23.086 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_md_log_max_shards": "64", 2024-09-22T03:49:23.086 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_md_notify_interval_msec": "200", 2024-09-22T03:49:23.086 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_meta_sync_poll_interval": "20", 2024-09-22T03:49:23.086 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_meta_sync_spawn_window": "20", 2024-09-22T03:49:23.086 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_mime_types_file": "/etc/mime.types", 2024-09-22T03:49:23.086 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_mp_lock_max_time": "600", 2024-09-22T03:49:23.086 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_multi_obj_del_max_aio": "16", 2024-09-22T03:49:23.087 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_multipart_min_part_size": "5242880", 2024-09-22T03:49:23.087 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_multipart_part_upload_limit": "10000", 2024-09-22T03:49:23.087 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_nfs_fhcache_partitions": "3", 2024-09-22T03:49:23.087 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_nfs_fhcache_size": "2017", 2024-09-22T03:49:23.087 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_nfs_frontends": "rgw-nfs", 2024-09-22T03:49:23.087 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2024-09-22T03:49:23.087 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_nfs_lru_lanes": "5", 2024-09-22T03:49:23.087 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_nfs_max_gc": "300", 2024-09-22T03:49:23.087 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_nfs_namespace_expire_secs": "300", 2024-09-22T03:49:23.087 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_nfs_run_gc_threads": "false", 2024-09-22T03:49:23.087 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_nfs_run_lc_threads": "false", 2024-09-22T03:49:23.087 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_nfs_run_quota_threads": "false", 2024-09-22T03:49:23.087 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_nfs_run_sync_thread": "false", 2024-09-22T03:49:23.087 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_nfs_s3_fast_attrs": "false", 2024-09-22T03:49:23.087 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_nfs_write_completion_interval_s": "10", 2024-09-22T03:49:23.088 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_num_async_rados_threads": "32", 2024-09-22T03:49:23.088 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_num_control_oids": "8", 2024-09-22T03:49:23.088 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_numa_node": "-1", 2024-09-22T03:49:23.088 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_obj_stripe_size": "4194304", 2024-09-22T03:49:23.088 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_obj_tombstone_cache_size": "1000", 2024-09-22T03:49:23.088 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_objexp_chunk_size": "100", 2024-09-22T03:49:23.088 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_objexp_gc_interval": "600", 2024-09-22T03:49:23.088 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_objexp_hints_num_shards": "127", 2024-09-22T03:49:23.088 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_olh_pending_timeout_sec": "3600", 2024-09-22T03:49:23.088 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_op_thread_suicide_timeout": "0", 2024-09-22T03:49:23.088 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_op_thread_timeout": "600", 2024-09-22T03:49:23.088 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_op_tracing": "false", 2024-09-22T03:49:23.088 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_opa_token": "", 2024-09-22T03:49:23.088 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_opa_url": "", 2024-09-22T03:49:23.089 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_opa_verify_ssl": "true", 2024-09-22T03:49:23.089 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_ops_log_data_backlog": "5242880", 2024-09-22T03:49:23.089 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_ops_log_file_path": "/var/log/ceph/ops-log-ceph-mon.a.log", 2024-09-22T03:49:23.089 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_ops_log_rados": "false", 2024-09-22T03:49:23.089 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_ops_log_socket_path": "", 2024-09-22T03:49:23.089 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_override_bucket_index_max_shards": "0", 2024-09-22T03:49:23.089 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_pending_bucket_index_op_expiration": "120", 2024-09-22T03:49:23.089 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2024-09-22T03:49:23.089 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_period_push_interval": "2.000000", 2024-09-22T03:49:23.089 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_period_push_interval_max": "30.000000", 2024-09-22T03:49:23.089 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_period_root_pool": ".rgw.root", 2024-09-22T03:49:23.089 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_policy_reject_invalid_principals": "true", 2024-09-22T03:49:23.089 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_posix_base_path": "/tmp/rgw_posix_driver", 2024-09-22T03:49:23.089 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_posix_cache_lanes": "3", 2024-09-22T03:49:23.089 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_posix_cache_lmdb_count": "3", 2024-09-22T03:49:23.090 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_posix_cache_max_buckets": "100", 2024-09-22T03:49:23.090 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_posix_cache_partitions": "3", 2024-09-22T03:49:23.090 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_posix_database_root": "/var/lib/ceph/radosgw", 2024-09-22T03:49:23.090 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_print_continue": "true", 2024-09-22T03:49:23.090 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_print_prohibited_content_length": "false", 2024-09-22T03:49:23.090 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_put_obj_max_window_size": "67108864", 2024-09-22T03:49:23.090 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_put_obj_min_window_size": "16777216", 2024-09-22T03:49:23.090 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2024-09-22T03:49:23.090 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_rados_pool_recovery_priority": "5", 2024-09-22T03:49:23.090 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_rados_tracing": "false", 2024-09-22T03:49:23.090 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_realm": "", 2024-09-22T03:49:23.090 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_realm_id": "", 2024-09-22T03:49:23.090 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_realm_root_pool": ".rgw.root", 2024-09-22T03:49:23.090 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_region": "", 2024-09-22T03:49:23.090 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_region_root_pool": ".rgw.root", 2024-09-22T03:49:23.091 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_relaxed_region_enforcement": "false", 2024-09-22T03:49:23.091 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_relaxed_s3_bucket_names": "false", 2024-09-22T03:49:23.091 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2024-09-22T03:49:23.091 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_request_uri": "", 2024-09-22T03:49:23.091 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_reshard_batch_size": "64", 2024-09-22T03:49:23.091 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_reshard_bucket_lock_duration": "360", 2024-09-22T03:49:23.091 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_reshard_debug_interval": "-1", 2024-09-22T03:49:23.091 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_reshard_max_aio": "128", 2024-09-22T03:49:23.091 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_reshard_num_logs": "16", 2024-09-22T03:49:23.091 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_reshard_progress_judge_interval": "120", 2024-09-22T03:49:23.091 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_reshard_progress_judge_ratio": "0.500000", 2024-09-22T03:49:23.091 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_reshard_thread_interval": "600", 2024-09-22T03:49:23.091 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_reshardlog_threshold": "30000", 2024-09-22T03:49:23.091 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_resolve_cname": "false", 2024-09-22T03:49:23.092 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_rest_getusage_op_compat": "false", 2024-09-22T03:49:23.092 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_run_sync_thread": "true", 2024-09-22T03:49:23.092 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_s3_auth_disable_signature_url": "false", 2024-09-22T03:49:23.092 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_s3_auth_order": "sts, external, local", 2024-09-22T03:49:23.092 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_s3_auth_use_keystone": "false", 2024-09-22T03:49:23.092 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_s3_auth_use_ldap": "false", 2024-09-22T03:49:23.092 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_s3_auth_use_rados": "true", 2024-09-22T03:49:23.092 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_s3_auth_use_sts": "false", 2024-09-22T03:49:23.092 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_s3_client_max_sig_ver": "-1", 2024-09-22T03:49:23.092 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_s3_success_create_obj_status": "0", 2024-09-22T03:49:23.092 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_safe_max_objects_per_shard": "102400", 2024-09-22T03:49:23.092 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_scheduler_type": "throttler", 2024-09-22T03:49:23.092 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_script_uri": "", 2024-09-22T03:49:23.092 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_service_provider_name": "", 2024-09-22T03:49:23.092 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_shard_warning_threshold": "90.000000", 2024-09-22T03:49:23.093 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_sts_client_id": "", 2024-09-22T03:49:23.093 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_sts_client_secret": "", 2024-09-22T03:49:23.093 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_sts_entry": "sts", 2024-09-22T03:49:23.093 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_sts_key": "sts", 2024-09-22T03:49:23.093 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_sts_max_session_duration": "43200", 2024-09-22T03:49:23.093 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_sts_min_session_duration": "900", 2024-09-22T03:49:23.093 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_sts_token_introspection_url": "", 2024-09-22T03:49:23.093 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_swift_account_in_url": "false", 2024-09-22T03:49:23.093 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_swift_auth_entry": "auth", 2024-09-22T03:49:23.093 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_swift_auth_url": "", 2024-09-22T03:49:23.093 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_swift_custom_header": "", 2024-09-22T03:49:23.093 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_swift_enforce_content_length": "false", 2024-09-22T03:49:23.093 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_swift_need_stats": "true", 2024-09-22T03:49:23.093 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_swift_tenant_name": "", 2024-09-22T03:49:23.093 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_swift_token_expiration": "86400", 2024-09-22T03:49:23.093 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_swift_url": "", 2024-09-22T03:49:23.094 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_swift_url_prefix": "swift", 2024-09-22T03:49:23.094 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_swift_versioning_enabled": "false", 2024-09-22T03:49:23.094 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_sync_data_full_inject_err_probability": "0.000000", 2024-09-22T03:49:23.094 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2024-09-22T03:49:23.094 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_sync_lease_period": "120", 2024-09-22T03:49:23.094 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2024-09-22T03:49:23.094 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_sync_log_trim_interval": "1200", 2024-09-22T03:49:23.094 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_sync_log_trim_max_buckets": "16", 2024-09-22T03:49:23.094 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2024-09-22T03:49:23.094 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2024-09-22T03:49:23.094 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_sync_obj_etag_verify": "false", 2024-09-22T03:49:23.094 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_sync_trace_history_size": "4096", 2024-09-22T03:49:23.094 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_sync_trace_per_node_log_size": "32", 2024-09-22T03:49:23.094 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2024-09-22T03:49:23.095 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_thread_pool_size": "512", 2024-09-22T03:49:23.095 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_topic_persistency_max_retries": "0", 2024-09-22T03:49:23.095 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_topic_persistency_sleep_duration": "0", 2024-09-22T03:49:23.095 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_topic_persistency_time_to_live": "0", 2024-09-22T03:49:23.095 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_topic_require_publish_policy": "false", 2024-09-22T03:49:23.095 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_torrent_comment": "", 2024-09-22T03:49:23.095 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_torrent_createby": "", 2024-09-22T03:49:23.095 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_torrent_encoding": "", 2024-09-22T03:49:23.095 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_torrent_flag": "false", 2024-09-22T03:49:23.095 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_torrent_max_size": "5368709120", 2024-09-22T03:49:23.095 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_torrent_origin": "", 2024-09-22T03:49:23.095 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_torrent_sha_unit": "524288", 2024-09-22T03:49:23.095 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_torrent_tracker": "", 2024-09-22T03:49:23.095 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_trust_forwarded_https": "false", 2024-09-22T03:49:23.095 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_usage_log_flush_threshold": "1024", 2024-09-22T03:49:23.096 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_usage_log_tick_interval": "30", 2024-09-22T03:49:23.096 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_usage_max_shards": "32", 2024-09-22T03:49:23.096 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_usage_max_user_shards": "1", 2024-09-22T03:49:23.096 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_use_opa_authz": "false", 2024-09-22T03:49:23.096 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_user_counters_cache": "false", 2024-09-22T03:49:23.096 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_user_counters_cache_size": "10000", 2024-09-22T03:49:23.096 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_user_default_quota_max_objects": "-1", 2024-09-22T03:49:23.096 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_user_default_quota_max_size": "-1", 2024-09-22T03:49:23.096 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_user_max_buckets": "1000", 2024-09-22T03:49:23.096 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_user_policies_max_num": "100", 2024-09-22T03:49:23.096 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2024-09-22T03:49:23.096 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_user_quota_sync_idle_users": "false", 2024-09-22T03:49:23.096 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_user_quota_sync_interval": "86400", 2024-09-22T03:49:23.096 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_user_quota_sync_wait_time": "86400", 2024-09-22T03:49:23.097 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_user_unique_email": "true", 2024-09-22T03:49:23.097 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_verify_ssl": "true", 2024-09-22T03:49:23.097 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_website_routing_rules_max_num": "50", 2024-09-22T03:49:23.097 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_zone": "", 2024-09-22T03:49:23.097 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_zone_id": "", 2024-09-22T03:49:23.097 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_zone_root_pool": ".rgw.root", 2024-09-22T03:49:23.097 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_zonegroup": "", 2024-09-22T03:49:23.097 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_zonegroup_id": "", 2024-09-22T03:49:23.097 INFO:teuthology.orchestra.run.smithi037.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2024-09-22T03:49:23.097 INFO:teuthology.orchestra.run.smithi037.stdout: "rgwlc_auto_session_clear": "true", 2024-09-22T03:49:23.097 INFO:teuthology.orchestra.run.smithi037.stdout: "rgwlc_skip_bucket_step": "false", 2024-09-22T03:49:23.097 INFO:teuthology.orchestra.run.smithi037.stdout: "rocksdb_block_size": "4096", 2024-09-22T03:49:23.097 INFO:teuthology.orchestra.run.smithi037.stdout: "rocksdb_bloom_bits_per_key": "20", 2024-09-22T03:49:23.097 INFO:teuthology.orchestra.run.smithi037.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2024-09-22T03:49:23.098 INFO:teuthology.orchestra.run.smithi037.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "false", 2024-09-22T03:49:23.098 INFO:teuthology.orchestra.run.smithi037.stdout: "rocksdb_cache_row_ratio": "0.000000", 2024-09-22T03:49:23.098 INFO:teuthology.orchestra.run.smithi037.stdout: "rocksdb_cache_shard_bits": "4", 2024-09-22T03:49:23.098 INFO:teuthology.orchestra.run.smithi037.stdout: "rocksdb_cache_size": "536870912", 2024-09-22T03:49:23.098 INFO:teuthology.orchestra.run.smithi037.stdout: "rocksdb_cache_type": "binned_lru", 2024-09-22T03:49:23.098 INFO:teuthology.orchestra.run.smithi037.stdout: "rocksdb_cf_compact_on_deletion": "true", 2024-09-22T03:49:23.098 INFO:teuthology.orchestra.run.smithi037.stdout: "rocksdb_cf_compact_on_deletion_sliding_window": "32768", 2024-09-22T03:49:23.098 INFO:teuthology.orchestra.run.smithi037.stdout: "rocksdb_cf_compact_on_deletion_trigger": "16384", 2024-09-22T03:49:23.098 INFO:teuthology.orchestra.run.smithi037.stdout: "rocksdb_collect_compaction_stats": "false", 2024-09-22T03:49:23.098 INFO:teuthology.orchestra.run.smithi037.stdout: "rocksdb_collect_extended_stats": "false", 2024-09-22T03:49:23.098 INFO:teuthology.orchestra.run.smithi037.stdout: "rocksdb_collect_memory_stats": "false", 2024-09-22T03:49:23.098 INFO:teuthology.orchestra.run.smithi037.stdout: "rocksdb_delete_range_threshold": "1048576", 2024-09-22T03:49:23.098 INFO:teuthology.orchestra.run.smithi037.stdout: "rocksdb_index_type": "binary_search", 2024-09-22T03:49:23.098 INFO:teuthology.orchestra.run.smithi037.stdout: "rocksdb_log_to_ceph_log": "true", 2024-09-22T03:49:23.098 INFO:teuthology.orchestra.run.smithi037.stdout: "rocksdb_metadata_block_size": "4096", 2024-09-22T03:49:23.099 INFO:teuthology.orchestra.run.smithi037.stdout: "rocksdb_partition_filters": "false", 2024-09-22T03:49:23.099 INFO:teuthology.orchestra.run.smithi037.stdout: "rocksdb_perf": "false", 2024-09-22T03:49:23.099 INFO:teuthology.orchestra.run.smithi037.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2024-09-22T03:49:23.099 INFO:teuthology.orchestra.run.smithi037.stdout: "rotating_keys_bootstrap_timeout": "30", 2024-09-22T03:49:23.099 INFO:teuthology.orchestra.run.smithi037.stdout: "rotating_keys_renewal_timeout": "10", 2024-09-22T03:49:23.099 INFO:teuthology.orchestra.run.smithi037.stdout: "run_dir": "/var/run/ceph", 2024-09-22T03:49:23.099 INFO:teuthology.orchestra.run.smithi037.stdout: "seastore_block_create": "true", 2024-09-22T03:49:23.099 INFO:teuthology.orchestra.run.smithi037.stdout: "seastore_cache_lru_size": "67108864", 2024-09-22T03:49:23.099 INFO:teuthology.orchestra.run.smithi037.stdout: "seastore_cbjournal_size": "5368709120", 2024-09-22T03:49:23.099 INFO:teuthology.orchestra.run.smithi037.stdout: "seastore_data_delta_based_overwrite": "0", 2024-09-22T03:49:23.099 INFO:teuthology.orchestra.run.smithi037.stdout: "seastore_default_max_object_size": "16777216", 2024-09-22T03:49:23.099 INFO:teuthology.orchestra.run.smithi037.stdout: "seastore_default_object_metadata_reservation": "16777216", 2024-09-22T03:49:23.099 INFO:teuthology.orchestra.run.smithi037.stdout: "seastore_device_size": "53687091200", 2024-09-22T03:49:23.099 INFO:teuthology.orchestra.run.smithi037.stdout: "seastore_disable_end_to_end_data_protection": "true", 2024-09-22T03:49:23.099 INFO:teuthology.orchestra.run.smithi037.stdout: "seastore_full_integrity_check": "false", 2024-09-22T03:49:23.100 INFO:teuthology.orchestra.run.smithi037.stdout: "seastore_journal_batch_capacity": "16", 2024-09-22T03:49:23.100 INFO:teuthology.orchestra.run.smithi037.stdout: "seastore_journal_batch_flush_size": "16777216", 2024-09-22T03:49:23.100 INFO:teuthology.orchestra.run.smithi037.stdout: "seastore_journal_batch_preferred_fullness": "0.950000", 2024-09-22T03:49:23.100 INFO:teuthology.orchestra.run.smithi037.stdout: "seastore_journal_iodepth_limit": "5", 2024-09-22T03:49:23.100 INFO:teuthology.orchestra.run.smithi037.stdout: "seastore_main_device_type": "SSD", 2024-09-22T03:49:23.100 INFO:teuthology.orchestra.run.smithi037.stdout: "seastore_max_concurrent_transactions": "8", 2024-09-22T03:49:23.100 INFO:teuthology.orchestra.run.smithi037.stdout: "seastore_max_data_allocation_size": "32768", 2024-09-22T03:49:23.100 INFO:teuthology.orchestra.run.smithi037.stdout: "seastore_multiple_tiers_default_evict_ratio": "0.600000", 2024-09-22T03:49:23.100 INFO:teuthology.orchestra.run.smithi037.stdout: "seastore_multiple_tiers_fast_evict_ratio": "0.700000", 2024-09-22T03:49:23.100 INFO:teuthology.orchestra.run.smithi037.stdout: "seastore_multiple_tiers_stop_evict_ratio": "0.500000", 2024-09-22T03:49:23.100 INFO:teuthology.orchestra.run.smithi037.stdout: "seastore_obj_data_write_amplification": "1.250000", 2024-09-22T03:49:23.100 INFO:teuthology.orchestra.run.smithi037.stdout: "seastore_segment_size": "67108864", 2024-09-22T03:49:23.100 INFO:teuthology.orchestra.run.smithi037.stdout: "set_keepcaps": "false", 2024-09-22T03:49:23.100 INFO:teuthology.orchestra.run.smithi037.stdout: "setgroup": "", 2024-09-22T03:49:23.100 INFO:teuthology.orchestra.run.smithi037.stdout: "setuser": "", 2024-09-22T03:49:23.101 INFO:teuthology.orchestra.run.smithi037.stdout: "setuser_match_path": "", 2024-09-22T03:49:23.101 INFO:teuthology.orchestra.run.smithi037.stdout: "target_max_misplaced_ratio": "0.050000", 2024-09-22T03:49:23.101 INFO:teuthology.orchestra.run.smithi037.stdout: "thp": "false", 2024-09-22T03:49:23.101 INFO:teuthology.orchestra.run.smithi037.stdout: "threadpool_default_timeout": "60", 2024-09-22T03:49:23.101 INFO:teuthology.orchestra.run.smithi037.stdout: "threadpool_empty_queue_max_wait": "2", 2024-09-22T03:49:23.101 INFO:teuthology.orchestra.run.smithi037.stdout: "throttler_perf_counter": "true", 2024-09-22T03:49:23.101 INFO:teuthology.orchestra.run.smithi037.stdout: "tmp_dir": "/tmp", 2024-09-22T03:49:23.101 INFO:teuthology.orchestra.run.smithi037.stdout: "tmp_file_template": "/tmp/ceph-mon.a.XXXXXX", 2024-09-22T03:49:23.101 INFO:teuthology.orchestra.run.smithi037.stdout: "uadk_compressor_enabled": "false", 2024-09-22T03:49:23.101 INFO:teuthology.orchestra.run.smithi037.stdout: "uadk_wd_sync_ctx_num": "2" 2024-09-22T03:49:23.101 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-22T03:49:23.103 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0 2024-09-22T03:49:23.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:49:23.214+0000 7fe02b791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:23.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:49:23.220+0000 7fe02b791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:23.237 INFO:teuthology.orchestra.run.smithi037.stdout:{} 2024-09-22T03:49:23.237 INFO:teuthology.orchestra.run.smithi037.stderr:mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-22T03:49:23.248 DEBUG:teuthology.orchestra.run.smithi037:> type ceph-objectstore-tool 2024-09-22T03:49:23.263 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-22T03:49:23.263 DEBUG:teuthology.orchestra.run.smithi098:> type ceph-objectstore-tool 2024-09-22T03:49:23.280 INFO:teuthology.orchestra.run.smithi098.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-22T03:49:23.280 INFO:teuthology.run_tasks:Running task full_sequential... 2024-09-22T03:49:23.289 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2024-09-22T03:49:23.290 INFO:tasks.radosbench:Beginning radosbench... 2024-09-22T03:49:23.290 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_0 2024-09-22T03:49:23.291 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_0 16 2024-09-22T03:49:23.291 INFO:tasks.thrashosds.thrasher:starting do_thrash 2024-09-22T03:49:23.291 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:49:23.291 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:49:23.291 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:49:23.292 INFO:tasks.thrashosds.thrasher:starting do_optrack_toggle with a delay of 2.0 2024-09-22T03:49:23.292 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:49:23.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:49:23.416+0000 7f4f83d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:23.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:49:23.416+0000 7f2cebf91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:23.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:49:23.423+0000 7f4f83d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:23.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:49:23.416+0000 7f1958ad1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:23.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:49:23.426+0000 7f2cebf91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:23.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:49:23.430+0000 7f1958ad1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:23.629 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:49:23.629 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-22T03:49:23.642 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":16,"stamp":"2024-09-22T03:49:22.965185+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":108048,"kb_used_data":720,"kb_used_omap":0,"kb_used_meta":107264,"kb_avail":377379312,"statfs":{"total":386547056640,"available":386436415488,"internally_reserved":0,"allocated":737280,"data_stored":1917593,"data_compressed":90168,"data_compressed_allocated":122880,"data_compressed_original":1720320,"omap_allocated":0,"internal_metadata":109838336},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.905240"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-22T03:49:17.024731+0000","last_change":"2024-09-22T03:49:17.029128+0000","last_active":"2024-09-22T03:49:17.024731+0000","last_peered":"2024-09-22T03:49:17.024731+0000","last_clean":"2024-09-22T03:49:17.024731+0000","last_became_active":"2024-09-22T03:49:15.113396+0000","last_became_peered":"2024-09-22T03:49:15.113396+0000","last_unstale":"2024-09-22T03:49:17.024731+0000","last_undegraded":"2024-09-22T03:49:17.024731+0000","last_fullsized":"2024-09-22T03:49:17.024731+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-22T03:49:17.034122+0000","last_change":"2024-09-22T03:49:17.036402+0000","last_active":"2024-09-22T03:49:17.034122+0000","last_peered":"2024-09-22T03:49:17.034122+0000","last_clean":"2024-09-22T03:49:17.034122+0000","last_became_active":"2024-09-22T03:49:15.108430+0000","last_became_peered":"2024-09-22T03:49:15.108430+0000","last_unstale":"2024-09-22T03:49:17.034122+0000","last_undegraded":"2024-09-22T03:49:17.034122+0000","last_fullsized":"2024-09-22T03:49:17.034122+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-22T03:49:17.028396+0000","last_change":"2024-09-22T03:49:17.032989+0000","last_active":"2024-09-22T03:49:17.028396+0000","last_peered":"2024-09-22T03:49:17.028396+0000","last_clean":"2024-09-22T03:49:17.028396+0000","last_became_active":"2024-09-22T03:49:15.079260+0000","last_became_peered":"2024-09-22T03:49:15.079260+0000","last_unstale":"2024-09-22T03:49:17.028396+0000","last_undegraded":"2024-09-22T03:49:17.028396+0000","last_fullsized":"2024-09-22T03:49:17.028396+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-22T03:49:17.034237+0000","last_change":"2024-09-22T03:49:17.036954+0000","last_active":"2024-09-22T03:49:17.034237+0000","last_peered":"2024-09-22T03:49:17.034237+0000","last_clean":"2024-09-22T03:49:17.034237+0000","last_became_active":"2024-09-22T03:49:15.110506+0000","last_became_peered":"2024-09-22T03:49:15.110506+0000","last_unstale":"2024-09-22T03:49:17.034237+0000","last_undegraded":"2024-09-22T03:49:17.034237+0000","last_fullsized":"2024-09-22T03:49:17.034237+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":18,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-22T03:49:17.031466+0000","last_change":"2024-09-22T03:49:17.031466+0000","last_active":"2024-09-22T03:49:17.031466+0000","last_peered":"2024-09-22T03:49:17.031466+0000","last_clean":"2024-09-22T03:49:17.031466+0000","last_became_active":"2024-09-22T03:49:15.098420+0000","last_became_peered":"2024-09-22T03:49:15.098420+0000","last_unstale":"2024-09-22T03:49:17.031466+0000","last_undegraded":"2024-09-22T03:49:17.031466+0000","last_fullsized":"2024-09-22T03:49:17.031466+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-22T03:49:17.026432+0000","last_change":"2024-09-22T03:49:17.029349+0000","last_active":"2024-09-22T03:49:17.026432+0000","last_peered":"2024-09-22T03:49:17.026432+0000","last_clean":"2024-09-22T03:49:17.026432+0000","last_became_active":"2024-09-22T03:49:15.094890+0000","last_became_peered":"2024-09-22T03:49:15.094890+0000","last_unstale":"2024-09-22T03:49:17.026432+0000","last_undegraded":"2024-09-22T03:49:17.026432+0000","last_fullsized":"2024-09-22T03:49:17.026432+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-22T03:49:17.023982+0000","last_change":"2024-09-22T03:49:17.029339+0000","last_active":"2024-09-22T03:49:17.023982+0000","last_peered":"2024-09-22T03:49:17.023982+0000","last_clean":"2024-09-22T03:49:17.023982+0000","last_became_active":"2024-09-22T03:49:15.097304+0000","last_became_peered":"2024-09-22T03:49:15.097304+0000","last_unstale":"2024-09-22T03:49:17.023982+0000","last_undegraded":"2024-09-22T03:49:17.023982+0000","last_fullsized":"2024-09-22T03:49:17.023982+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":17,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-22T03:49:17.029301+0000","last_change":"2024-09-22T03:49:17.031458+0000","last_active":"2024-09-22T03:49:17.029301+0000","last_peered":"2024-09-22T03:49:17.029301+0000","last_clean":"2024-09-22T03:49:17.029301+0000","last_became_active":"2024-09-22T03:49:15.125490+0000","last_became_peered":"2024-09-22T03:49:15.125490+0000","last_unstale":"2024-09-22T03:49:17.029301+0000","last_undegraded":"2024-09-22T03:49:17.029301+0000","last_fullsized":"2024-09-22T03:49:17.029301+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":91,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-22T03:49:17.030686+0000","last_change":"2024-09-22T03:49:12.034704+0000","last_active":"2024-09-22T03:49:17.030686+0000","last_peered":"2024-09-22T03:49:17.030686+0000","last_clean":"2024-09-22T03:49:17.030686+0000","last_became_active":"2024-09-22T03:49:12.027470+0000","last_became_peered":"2024-09-22T03:49:12.027470+0000","last_unstale":"2024-09-22T03:49:17.030686+0000","last_undegraded":"2024-09-22T03:49:17.030686+0000","last_fullsized":"2024-09-22T03:49:17.030686+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_clean_scrub_stamp":"2024-09-22T03:49:10.979949+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949672970,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27028,"kb_used_data":196,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344812,"statfs":{"total":96636764160,"available":96609087488,"internally_reserved":0,"allocated":200704,"data_stored":626995,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654705674,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":26968,"kb_used_data":136,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344872,"statfs":{"total":96636764160,"available":96609148928,"internally_reserved":0,"allocated":139264,"data_stored":36627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705674,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27028,"kb_used_data":196,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344812,"statfs":{"total":96636764160,"available":96609087488,"internally_reserved":0,"allocated":200704,"data_stored":626995,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705674,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27024,"kb_used_data":192,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344816,"statfs":{"total":96636764160,"available":96609091584,"internally_reserved":0,"allocated":196608,"data_stored":626976,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:49:24.034 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'unique_pool_0' created 2024-09-22T03:49:24.058 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_0 rados --yes-i-really-mean-it || true 2024-09-22T03:49:24.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:49:24.183+0000 7f1e6b991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:24.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:49:24.198+0000 7f1e6b991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:25.041 INFO:teuthology.orchestra.run.smithi037.stderr:enabled application 'rados' on pool 'unique_pool_0' 2024-09-22T03:49:25.540 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:49:25.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:49:25.649+0000 7fb1f9f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:25.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:49:25.655+0000 7fb1f9f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:26.068 DEBUG:teuthology.orchestra.run.smithi037:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -b 65536 --object-size 65536 -p unique_pool_0 bench 90 write' 2024-09-22T03:49:26.071 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2024-09-22T03:49:26.071 INFO:teuthology.orchestra.run:waiting for 3000 2024-09-22T03:49:26.136 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:hints = 1 2024-09-22T03:49:26.136 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Maintaining 16 concurrent writes of 65536 bytes to objects of size 65536 for up to 90 seconds or 0 objects 2024-09-22T03:49:26.137 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Object prefix: benchmark_data_smithi037_30421 2024-09-22T03:49:26.137 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-22T03:49:26.137 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 0 0 0 0 0 0 - 0 2024-09-22T03:49:27.137 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 1 16 218 202 12.6243 12.625 0.105734 0.0755577 2024-09-22T03:49:27.759 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:49:27.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:49:27.902+0000 7f132e311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:27.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:49:27.911+0000 7f132e311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:28.137 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 2 16 419 403 12.5928 12.5625 0.111507 0.0774854 2024-09-22T03:49:28.643 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:49:28.644 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:49:28.644 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:49:28.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:49:28.793+0000 7fbf44111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:28.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:49:28.805+0000 7fbf44111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:29.137 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 3 16 621 605 12.6032 12.625 0.024122 0.0775839 2024-09-22T03:49:29.144 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:49:29.145 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-22T03:49:29.166 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-09-22T03:49:28.966527+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":108088,"kb_used_data":760,"kb_used_omap":0,"kb_used_meta":107264,"kb_avail":377379272,"statfs":{"total":386547056640,"available":386436374528,"internally_reserved":0,"allocated":778240,"data_stored":1935646,"data_compressed":90168,"data_compressed_allocated":122880,"data_compressed_original":1720320,"omap_allocated":0,"internal_metadata":109838336},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001342"},"pg_stats":[{"pgid":"3.f","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-22T03:49:24.072382+0000","last_change":"2024-09-22T03:49:24.072382+0000","last_active":"2024-09-22T03:49:24.029614+0000","last_peered":"2024-09-22T03:49:24.029614+0000","last_clean":"2024-09-22T03:49:24.029614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:49:24.072382+0000","last_undegraded":"2024-09-22T03:49:24.072382+0000","last_fullsized":"2024-09-22T03:49:24.072382+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:25.236658+0000","last_change":"2024-09-22T03:49:25.238720+0000","last_active":"2024-09-22T03:49:25.236658+0000","last_peered":"2024-09-22T03:49:25.236658+0000","last_clean":"2024-09-22T03:49:24.029614+0000","last_became_active":"2024-09-22T03:49:25.229005+0000","last_became_peered":"2024-09-22T03:49:25.229005+0000","last_unstale":"2024-09-22T03:49:25.236658+0000","last_undegraded":"2024-09-22T03:49:25.236658+0000","last_fullsized":"2024-09-22T03:49:25.236658+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-22T03:49:24.129452+0000","last_change":"2024-09-22T03:49:24.129452+0000","last_active":"2024-09-22T03:49:24.029614+0000","last_peered":"2024-09-22T03:49:24.029614+0000","last_clean":"2024-09-22T03:49:24.029614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:49:24.129452+0000","last_undegraded":"2024-09-22T03:49:24.129452+0000","last_fullsized":"2024-09-22T03:49:24.129452+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-22T03:49:24.117487+0000","last_change":"2024-09-22T03:49:24.117487+0000","last_active":"2024-09-22T03:49:24.029614+0000","last_peered":"2024-09-22T03:49:24.029614+0000","last_clean":"2024-09-22T03:49:24.029614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:49:24.117487+0000","last_undegraded":"2024-09-22T03:49:24.117487+0000","last_fullsized":"2024-09-22T03:49:24.117487+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:25.279221+0000","last_change":"2024-09-22T03:49:25.280543+0000","last_active":"2024-09-22T03:49:25.279221+0000","last_peered":"2024-09-22T03:49:25.279221+0000","last_clean":"2024-09-22T03:49:24.029614+0000","last_became_active":"2024-09-22T03:49:25.268731+0000","last_became_peered":"2024-09-22T03:49:25.268731+0000","last_unstale":"2024-09-22T03:49:25.279221+0000","last_undegraded":"2024-09-22T03:49:25.279221+0000","last_fullsized":"2024-09-22T03:49:25.279221+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-22T03:49:24.102156+0000","last_change":"2024-09-22T03:49:24.102156+0000","last_active":"2024-09-22T03:49:24.029614+0000","last_peered":"2024-09-22T03:49:24.029614+0000","last_clean":"2024-09-22T03:49:24.029614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:49:24.102156+0000","last_undegraded":"2024-09-22T03:49:24.102156+0000","last_fullsized":"2024-09-22T03:49:24.102156+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-22T03:49:24.087286+0000","last_change":"2024-09-22T03:49:24.087286+0000","last_active":"2024-09-22T03:49:24.029614+0000","last_peered":"2024-09-22T03:49:24.029614+0000","last_clean":"2024-09-22T03:49:24.029614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:49:24.087286+0000","last_undegraded":"2024-09-22T03:49:24.087286+0000","last_fullsized":"2024-09-22T03:49:24.087286+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-22T03:49:24.070900+0000","last_change":"2024-09-22T03:49:24.070900+0000","last_active":"2024-09-22T03:49:24.029614+0000","last_peered":"2024-09-22T03:49:24.029614+0000","last_clean":"2024-09-22T03:49:24.029614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:49:24.070900+0000","last_undegraded":"2024-09-22T03:49:24.070900+0000","last_fullsized":"2024-09-22T03:49:24.070900+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":100,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:26.053552+0000","last_change":"2024-09-22T03:49:12.034704+0000","last_active":"2024-09-22T03:49:26.053552+0000","last_peered":"2024-09-22T03:49:26.053552+0000","last_clean":"2024-09-22T03:49:26.053552+0000","last_became_active":"2024-09-22T03:49:12.027470+0000","last_became_peered":"2024-09-22T03:49:12.027470+0000","last_unstale":"2024-09-22T03:49:26.053552+0000","last_undegraded":"2024-09-22T03:49:26.053552+0000","last_fullsized":"2024-09-22T03:49:26.053552+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_clean_scrub_stamp":"2024-09-22T03:49:10.979949+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:49:24.049716+0000","last_change":"2024-09-22T03:49:17.031458+0000","last_active":"2024-09-22T03:49:24.049716+0000","last_peered":"2024-09-22T03:49:24.049716+0000","last_clean":"2024-09-22T03:49:24.049716+0000","last_became_active":"2024-09-22T03:49:15.125490+0000","last_became_peered":"2024-09-22T03:49:15.125490+0000","last_unstale":"2024-09-22T03:49:24.049716+0000","last_undegraded":"2024-09-22T03:49:24.049716+0000","last_fullsized":"2024-09-22T03:49:24.049716+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-22T03:49:24.056915+0000","last_change":"2024-09-22T03:49:24.056915+0000","last_active":"2024-09-22T03:49:24.029614+0000","last_peered":"2024-09-22T03:49:24.029614+0000","last_clean":"2024-09-22T03:49:24.029614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:49:24.056915+0000","last_undegraded":"2024-09-22T03:49:24.056915+0000","last_fullsized":"2024-09-22T03:49:24.056915+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:49:24.047338+0000","last_change":"2024-09-22T03:49:17.029339+0000","last_active":"2024-09-22T03:49:24.047338+0000","last_peered":"2024-09-22T03:49:24.047338+0000","last_clean":"2024-09-22T03:49:24.047338+0000","last_became_active":"2024-09-22T03:49:15.097304+0000","last_became_peered":"2024-09-22T03:49:15.097304+0000","last_unstale":"2024-09-22T03:49:24.047338+0000","last_undegraded":"2024-09-22T03:49:24.047338+0000","last_fullsized":"2024-09-22T03:49:24.047338+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-22T03:49:24.054551+0000","last_change":"2024-09-22T03:49:24.054551+0000","last_active":"2024-09-22T03:49:24.029614+0000","last_peered":"2024-09-22T03:49:24.029614+0000","last_clean":"2024-09-22T03:49:24.029614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:49:24.054551+0000","last_undegraded":"2024-09-22T03:49:24.054551+0000","last_fullsized":"2024-09-22T03:49:24.054551+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2,3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:49:24.048779+0000","last_change":"2024-09-22T03:49:17.029349+0000","last_active":"2024-09-22T03:49:24.048779+0000","last_peered":"2024-09-22T03:49:24.048779+0000","last_clean":"2024-09-22T03:49:24.048779+0000","last_became_active":"2024-09-22T03:49:15.094890+0000","last_became_peered":"2024-09-22T03:49:15.094890+0000","last_unstale":"2024-09-22T03:49:24.048779+0000","last_undegraded":"2024-09-22T03:49:24.048779+0000","last_fullsized":"2024-09-22T03:49:24.048779+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:26.055465+0000","last_change":"2024-09-22T03:49:25.226551+0000","last_active":"2024-09-22T03:49:26.055465+0000","last_peered":"2024-09-22T03:49:26.055465+0000","last_clean":"2024-09-22T03:49:26.055465+0000","last_became_active":"2024-09-22T03:49:25.213989+0000","last_became_peered":"2024-09-22T03:49:25.213989+0000","last_unstale":"2024-09-22T03:49:26.055465+0000","last_undegraded":"2024-09-22T03:49:26.055465+0000","last_fullsized":"2024-09-22T03:49:26.055465+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":21,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:49:24.049474+0000","last_change":"2024-09-22T03:49:17.031466+0000","last_active":"2024-09-22T03:49:24.049474+0000","last_peered":"2024-09-22T03:49:24.049474+0000","last_clean":"2024-09-22T03:49:24.049474+0000","last_became_active":"2024-09-22T03:49:15.098420+0000","last_became_peered":"2024-09-22T03:49:15.098420+0000","last_unstale":"2024-09-22T03:49:24.049474+0000","last_undegraded":"2024-09-22T03:49:24.049474+0000","last_fullsized":"2024-09-22T03:49:24.049474+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-22T03:49:24.068792+0000","last_change":"2024-09-22T03:49:24.068792+0000","last_active":"2024-09-22T03:49:24.029614+0000","last_peered":"2024-09-22T03:49:24.029614+0000","last_clean":"2024-09-22T03:49:24.029614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:49:24.068792+0000","last_undegraded":"2024-09-22T03:49:24.068792+0000","last_fullsized":"2024-09-22T03:49:24.068792+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-22T03:49:24.056914+0000","last_change":"2024-09-22T03:49:24.056914+0000","last_active":"2024-09-22T03:49:24.029614+0000","last_peered":"2024-09-22T03:49:24.029614+0000","last_clean":"2024-09-22T03:49:24.029614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:49:24.056914+0000","last_undegraded":"2024-09-22T03:49:24.056914+0000","last_fullsized":"2024-09-22T03:49:24.056914+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:25.079692+0000","last_change":"2024-09-22T03:49:17.036954+0000","last_active":"2024-09-22T03:49:25.079692+0000","last_peered":"2024-09-22T03:49:25.079692+0000","last_clean":"2024-09-22T03:49:25.079692+0000","last_became_active":"2024-09-22T03:49:15.110506+0000","last_became_peered":"2024-09-22T03:49:15.110506+0000","last_unstale":"2024-09-22T03:49:25.079692+0000","last_undegraded":"2024-09-22T03:49:25.079692+0000","last_fullsized":"2024-09-22T03:49:25.079692+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:26.057593+0000","last_change":"2024-09-22T03:49:25.218967+0000","last_active":"2024-09-22T03:49:26.057593+0000","last_peered":"2024-09-22T03:49:26.057593+0000","last_clean":"2024-09-22T03:49:26.057593+0000","last_became_active":"2024-09-22T03:49:25.203726+0000","last_became_peered":"2024-09-22T03:49:25.203726+0000","last_unstale":"2024-09-22T03:49:26.057593+0000","last_undegraded":"2024-09-22T03:49:26.057593+0000","last_fullsized":"2024-09-22T03:49:26.057593+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":25,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:26.054492+0000","last_change":"2024-09-22T03:49:17.032989+0000","last_active":"2024-09-22T03:49:26.054492+0000","last_peered":"2024-09-22T03:49:26.054492+0000","last_clean":"2024-09-22T03:49:26.054492+0000","last_became_active":"2024-09-22T03:49:15.079260+0000","last_became_peered":"2024-09-22T03:49:15.079260+0000","last_unstale":"2024-09-22T03:49:26.054492+0000","last_undegraded":"2024-09-22T03:49:26.054492+0000","last_fullsized":"2024-09-22T03:49:26.054492+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:26.059143+0000","last_change":"2024-09-22T03:49:25.275215+0000","last_active":"2024-09-22T03:49:26.059143+0000","last_peered":"2024-09-22T03:49:26.059143+0000","last_clean":"2024-09-22T03:49:26.059143+0000","last_became_active":"2024-09-22T03:49:25.260843+0000","last_became_peered":"2024-09-22T03:49:25.260843+0000","last_unstale":"2024-09-22T03:49:26.059143+0000","last_undegraded":"2024-09-22T03:49:26.059143+0000","last_fullsized":"2024-09-22T03:49:26.059143+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:25.072627+0000","last_change":"2024-09-22T03:49:17.036402+0000","last_active":"2024-09-22T03:49:25.072627+0000","last_peered":"2024-09-22T03:49:25.072627+0000","last_clean":"2024-09-22T03:49:25.072627+0000","last_became_active":"2024-09-22T03:49:15.108430+0000","last_became_peered":"2024-09-22T03:49:15.108430+0000","last_unstale":"2024-09-22T03:49:25.072627+0000","last_undegraded":"2024-09-22T03:49:25.072627+0000","last_fullsized":"2024-09-22T03:49:25.072627+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-22T03:49:24.083379+0000","last_change":"2024-09-22T03:49:24.083379+0000","last_active":"2024-09-22T03:49:24.029614+0000","last_peered":"2024-09-22T03:49:24.029614+0000","last_clean":"2024-09-22T03:49:24.029614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:49:24.083379+0000","last_undegraded":"2024-09-22T03:49:24.083379+0000","last_fullsized":"2024-09-22T03:49:24.083379+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:49:24.046878+0000","last_change":"2024-09-22T03:49:17.029128+0000","last_active":"2024-09-22T03:49:24.046878+0000","last_peered":"2024-09-22T03:49:24.046878+0000","last_clean":"2024-09-22T03:49:24.046878+0000","last_became_active":"2024-09-22T03:49:15.113396+0000","last_became_peered":"2024-09-22T03:49:15.113396+0000","last_unstale":"2024-09-22T03:49:24.046878+0000","last_undegraded":"2024-09-22T03:49:24.046878+0000","last_fullsized":"2024-09-22T03:49:24.046878+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949672975,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27044,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344796,"statfs":{"total":96636764160,"available":96609071104,"internally_reserved":0,"allocated":217088,"data_stored":634236,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654705679,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":26976,"kb_used_data":144,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344864,"statfs":{"total":96636764160,"available":96609140736,"internally_reserved":0,"allocated":147456,"data_stored":40231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705679,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27036,"kb_used_data":204,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344804,"statfs":{"total":96636764160,"available":96609079296,"internally_reserved":0,"allocated":208896,"data_stored":630599,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705679,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27032,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344808,"statfs":{"total":96636764160,"available":96609083392,"internally_reserved":0,"allocated":204800,"data_stored":630580,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:49:30.137 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 4 16 825 809 12.6396 12.75 0.0960178 0.0784387 2024-09-22T03:49:30.355 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:49:30.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:49:30.512+0000 7f14856ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:30.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:49:30.520+0000 7f14856ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:31.137 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 5 16 1009 993 12.4114 11.5 0.0213165 0.0796323 2024-09-22T03:49:32.137 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 6 16 1219 1203 12.5301 13.125 0.0747642 0.0792867 2024-09-22T03:49:32.834 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:49:32.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:49:32.987+0000 7fdc052c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:32.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:49:32.998+0000 7fdc052c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:33.137 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 7 16 1422 1406 12.5525 12.6875 0.0701476 0.0791058 2024-09-22T03:49:34.137 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 8 16 1629 1613 12.6004 12.9375 0.0669499 0.0789077 2024-09-22T03:49:34.169 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:49:34.170 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:49:34.170 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:49:34.170 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:49:34.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:49:34.312+0000 7f83e8d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:34.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:49:34.329+0000 7f83e8d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:34.405 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:49:34.405 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:49:34.405 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:49:34.405 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:49:34.406 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:49:34.406 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:49:34.406 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:49:34.406 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:49:34.406 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:49:34.406 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:49:34.406 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:49:34.406 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:49:34.410 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:49:34.410 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:49:34.411 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:49:34.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:49:34.574+0000 7f8ab4274640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:34.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:49:34.586+0000 7f8ab4274640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:34.718 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:49:34.719 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:49:34.719 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:49:34.719 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:49:34.719 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:49:34.719 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:49:34.719 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:49:34.719 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:49:34.719 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:49:34.719 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:49:34.719 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:49:34.719 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:49:34.723 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:49:34.723 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:49:34.723 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:49:34.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:49:34.883+0000 7f6314111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:34.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:49:34.898+0000 7f6314111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:34.929 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:49:34.929 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:49:34.929 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:49:34.929 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:49:34.929 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:49:34.929 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:49:34.929 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:49:34.929 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:49:34.930 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:49:34.930 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:49:34.930 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:49:34.930 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:49:34.933 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:49:34.933 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:49:34.933 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:49:35.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:49:35.103+0000 7fb86c708640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:35.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:49:35.118+0000 7fb86c708640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:35.137 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 9 16 1813 1797 12.478 11.5 0.0330981 0.0795911 2024-09-22T03:49:35.346 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:49:35.347 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:49:35.347 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:49:35.347 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:49:35.347 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:49:35.347 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:49:35.347 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:49:35.347 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:49:35.347 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:49:35.347 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:49:35.347 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:49:35.347 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:49:35.351 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:49:35.352 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:49:35.375 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:49:35.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:49:35.541+0000 7f86e0a74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:35.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:49:35.552+0000 7f86e0a74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:36.141 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 10 16 2016 2000 12.4989 12.6875 0.0200405 0.0796844 2024-09-22T03:49:37.138 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 11 16 2224 2208 12.5443 13 0.0771116 0.0793529 2024-09-22T03:49:38.042 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:49:38.138 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 12 16 2428 2412 12.5614 12.75 0.0843721 0.0793158 2024-09-22T03:49:38.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:49:38.204+0000 7f668b791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:38.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:49:38.214+0000 7f668b791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:39.138 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 13 16 2624 2608 12.5373 12.25 0.124449 0.079349 2024-09-22T03:49:40.138 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 14 16 2836 2820 12.5881 13.25 0.0700035 0.0792116 2024-09-22T03:49:40.353 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:49:40.353 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:49:40.353 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:49:40.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:49:40.509+0000 7fa444751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:40.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:49:40.523+0000 7fa444751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:40.604 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:49:40.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:49:40.776+0000 7feddcc9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:40.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:49:40.790+0000 7feddcc9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:40.872 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:49:40.872 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-22T03:49:40.890 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2024-09-22T03:49:38.968781+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":121963059,"num_objects":1856,"num_object_clones":0,"num_object_copies":5568,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":1933,"num_write_kb":119636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1907,"ondisk_log_size":1907,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":145712,"kb_used_data":21744,"kb_used_omap":0,"kb_used_meta":123904,"kb_avail":377341648,"statfs":{"total":386547056640,"available":386397847552,"internally_reserved":0,"allocated":22265856,"data_stored":344845329,"data_compressed":16368822,"data_compressed_allocated":21553152,"data_compressed_original":344604672,"omap_allocated":0,"internal_metadata":126877696},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":121372672,"num_objects":1852,"num_object_clones":0,"num_object_copies":5556,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1852,"num_write_kb":118528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002641"},"pg_stats":[{"pgid":"3.f","version":"19'109","reported_seq":121,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:34.780387+0000","last_change":"2024-09-22T03:49:25.167073+0000","last_active":"2024-09-22T03:49:34.780387+0000","last_peered":"2024-09-22T03:49:34.780387+0000","last_clean":"2024-09-22T03:49:34.780387+0000","last_became_active":"2024-09-22T03:49:25.159818+0000","last_became_peered":"2024-09-22T03:49:25.159818+0000","last_unstale":"2024-09-22T03:49:34.780387+0000","last_undegraded":"2024-09-22T03:49:34.780387+0000","last_fullsized":"2024-09-22T03:49:34.780387+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7143424,"num_objects":109,"num_object_clones":0,"num_object_copies":327,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":109,"num_write_kb":6976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"19'110","reported_seq":122,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:35.975048+0000","last_change":"2024-09-22T03:49:25.238720+0000","last_active":"2024-09-22T03:49:35.975048+0000","last_peered":"2024-09-22T03:49:35.975048+0000","last_clean":"2024-09-22T03:49:35.975048+0000","last_became_active":"2024-09-22T03:49:25.229005+0000","last_became_peered":"2024-09-22T03:49:25.229005+0000","last_unstale":"2024-09-22T03:49:35.975048+0000","last_undegraded":"2024-09-22T03:49:35.975048+0000","last_fullsized":"2024-09-22T03:49:35.975048+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7208960,"num_objects":110,"num_object_clones":0,"num_object_copies":330,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":110,"num_write_kb":7040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"19'107","reported_seq":119,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:34.733937+0000","last_change":"2024-09-22T03:49:25.173605+0000","last_active":"2024-09-22T03:49:34.733937+0000","last_peered":"2024-09-22T03:49:34.733937+0000","last_clean":"2024-09-22T03:49:34.733937+0000","last_became_active":"2024-09-22T03:49:25.165491+0000","last_became_peered":"2024-09-22T03:49:25.165491+0000","last_unstale":"2024-09-22T03:49:34.733937+0000","last_undegraded":"2024-09-22T03:49:34.733937+0000","last_fullsized":"2024-09-22T03:49:34.733937+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7012352,"num_objects":107,"num_object_clones":0,"num_object_copies":321,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":107,"num_write_kb":6848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"19'103","reported_seq":115,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:34.928422+0000","last_change":"2024-09-22T03:49:25.207920+0000","last_active":"2024-09-22T03:49:34.928422+0000","last_peered":"2024-09-22T03:49:34.928422+0000","last_clean":"2024-09-22T03:49:34.928422+0000","last_became_active":"2024-09-22T03:49:25.198168+0000","last_became_peered":"2024-09-22T03:49:25.198168+0000","last_unstale":"2024-09-22T03:49:34.928422+0000","last_undegraded":"2024-09-22T03:49:34.928422+0000","last_fullsized":"2024-09-22T03:49:34.928422+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6750208,"num_objects":103,"num_object_clones":0,"num_object_copies":309,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103,"num_write_kb":6592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"19'120","reported_seq":132,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:35.926695+0000","last_change":"2024-09-22T03:49:25.280543+0000","last_active":"2024-09-22T03:49:35.926695+0000","last_peered":"2024-09-22T03:49:35.926695+0000","last_clean":"2024-09-22T03:49:35.926695+0000","last_became_active":"2024-09-22T03:49:25.268731+0000","last_became_peered":"2024-09-22T03:49:25.268731+0000","last_unstale":"2024-09-22T03:49:35.926695+0000","last_undegraded":"2024-09-22T03:49:35.926695+0000","last_fullsized":"2024-09-22T03:49:35.926695+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7864320,"num_objects":120,"num_object_clones":0,"num_object_copies":360,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":7680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"19'120","reported_seq":132,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:34.931956+0000","last_change":"2024-09-22T03:49:25.206225+0000","last_active":"2024-09-22T03:49:34.931956+0000","last_peered":"2024-09-22T03:49:34.931956+0000","last_clean":"2024-09-22T03:49:34.931956+0000","last_became_active":"2024-09-22T03:49:25.201227+0000","last_became_peered":"2024-09-22T03:49:25.201227+0000","last_unstale":"2024-09-22T03:49:34.931956+0000","last_undegraded":"2024-09-22T03:49:34.931956+0000","last_fullsized":"2024-09-22T03:49:34.931956+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7864320,"num_objects":120,"num_object_clones":0,"num_object_copies":360,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":7680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"19'118","reported_seq":130,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:34.918867+0000","last_change":"2024-09-22T03:49:25.212585+0000","last_active":"2024-09-22T03:49:34.918867+0000","last_peered":"2024-09-22T03:49:34.918867+0000","last_clean":"2024-09-22T03:49:34.918867+0000","last_became_active":"2024-09-22T03:49:25.203356+0000","last_became_peered":"2024-09-22T03:49:25.203356+0000","last_unstale":"2024-09-22T03:49:34.918867+0000","last_undegraded":"2024-09-22T03:49:34.918867+0000","last_fullsized":"2024-09-22T03:49:34.918867+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7733248,"num_objects":118,"num_object_clones":0,"num_object_copies":354,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":118,"num_write_kb":7552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"19'116","reported_seq":128,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:34.714271+0000","last_change":"2024-09-22T03:49:25.177465+0000","last_active":"2024-09-22T03:49:34.714271+0000","last_peered":"2024-09-22T03:49:34.714271+0000","last_clean":"2024-09-22T03:49:34.714271+0000","last_became_active":"2024-09-22T03:49:25.170026+0000","last_became_peered":"2024-09-22T03:49:25.170026+0000","last_unstale":"2024-09-22T03:49:34.714271+0000","last_undegraded":"2024-09-22T03:49:34.714271+0000","last_fullsized":"2024-09-22T03:49:34.714271+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7602176,"num_objects":116,"num_object_clones":0,"num_object_copies":348,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":116,"num_write_kb":7424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":100,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:26.053552+0000","last_change":"2024-09-22T03:49:12.034704+0000","last_active":"2024-09-22T03:49:26.053552+0000","last_peered":"2024-09-22T03:49:26.053552+0000","last_clean":"2024-09-22T03:49:26.053552+0000","last_became_active":"2024-09-22T03:49:12.027470+0000","last_became_peered":"2024-09-22T03:49:12.027470+0000","last_unstale":"2024-09-22T03:49:26.053552+0000","last_undegraded":"2024-09-22T03:49:26.053552+0000","last_fullsized":"2024-09-22T03:49:26.053552+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_clean_scrub_stamp":"2024-09-22T03:49:10.979949+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":26,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:26.060600+0000","last_change":"2024-09-22T03:49:17.031458+0000","last_active":"2024-09-22T03:49:26.060600+0000","last_peered":"2024-09-22T03:49:26.060600+0000","last_clean":"2024-09-22T03:49:26.060600+0000","last_became_active":"2024-09-22T03:49:15.125490+0000","last_became_peered":"2024-09-22T03:49:15.125490+0000","last_unstale":"2024-09-22T03:49:26.060600+0000","last_undegraded":"2024-09-22T03:49:26.060600+0000","last_fullsized":"2024-09-22T03:49:26.060600+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"19'119","reported_seq":131,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:34.907402+0000","last_change":"2024-09-22T03:49:25.226827+0000","last_active":"2024-09-22T03:49:34.907402+0000","last_peered":"2024-09-22T03:49:34.907402+0000","last_clean":"2024-09-22T03:49:34.907402+0000","last_became_active":"2024-09-22T03:49:25.218579+0000","last_became_peered":"2024-09-22T03:49:25.218579+0000","last_unstale":"2024-09-22T03:49:34.907402+0000","last_undegraded":"2024-09-22T03:49:34.907402+0000","last_fullsized":"2024-09-22T03:49:34.907402+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7798784,"num_objects":119,"num_object_clones":0,"num_object_copies":357,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":119,"num_write_kb":7616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":25,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:26.053667+0000","last_change":"2024-09-22T03:49:17.029339+0000","last_active":"2024-09-22T03:49:26.053667+0000","last_peered":"2024-09-22T03:49:26.053667+0000","last_clean":"2024-09-22T03:49:26.053667+0000","last_became_active":"2024-09-22T03:49:15.097304+0000","last_became_peered":"2024-09-22T03:49:15.097304+0000","last_unstale":"2024-09-22T03:49:26.053667+0000","last_undegraded":"2024-09-22T03:49:26.053667+0000","last_fullsized":"2024-09-22T03:49:26.053667+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"19'97","reported_seq":109,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:34.975552+0000","last_change":"2024-09-22T03:49:25.208298+0000","last_active":"2024-09-22T03:49:34.975552+0000","last_peered":"2024-09-22T03:49:34.975552+0000","last_clean":"2024-09-22T03:49:34.975552+0000","last_became_active":"2024-09-22T03:49:25.193750+0000","last_became_peered":"2024-09-22T03:49:25.193750+0000","last_unstale":"2024-09-22T03:49:34.975552+0000","last_undegraded":"2024-09-22T03:49:34.975552+0000","last_fullsized":"2024-09-22T03:49:34.975552+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6356992,"num_objects":97,"num_object_clones":0,"num_object_copies":291,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":97,"num_write_kb":6208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":25,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:26.056439+0000","last_change":"2024-09-22T03:49:17.029349+0000","last_active":"2024-09-22T03:49:26.056439+0000","last_peered":"2024-09-22T03:49:26.056439+0000","last_clean":"2024-09-22T03:49:26.056439+0000","last_became_active":"2024-09-22T03:49:15.094890+0000","last_became_peered":"2024-09-22T03:49:15.094890+0000","last_unstale":"2024-09-22T03:49:26.056439+0000","last_undegraded":"2024-09-22T03:49:26.056439+0000","last_fullsized":"2024-09-22T03:49:26.056439+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"19'129","reported_seq":141,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:35.978240+0000","last_change":"2024-09-22T03:49:25.226551+0000","last_active":"2024-09-22T03:49:35.978240+0000","last_peered":"2024-09-22T03:49:35.978240+0000","last_clean":"2024-09-22T03:49:35.978240+0000","last_became_active":"2024-09-22T03:49:25.213989+0000","last_became_peered":"2024-09-22T03:49:25.213989+0000","last_unstale":"2024-09-22T03:49:35.978240+0000","last_undegraded":"2024-09-22T03:49:35.978240+0000","last_fullsized":"2024-09-22T03:49:35.978240+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8454144,"num_objects":129,"num_object_clones":0,"num_object_copies":387,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":8256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":27,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:26.057565+0000","last_change":"2024-09-22T03:49:17.031466+0000","last_active":"2024-09-22T03:49:26.057565+0000","last_peered":"2024-09-22T03:49:26.057565+0000","last_clean":"2024-09-22T03:49:26.057565+0000","last_became_active":"2024-09-22T03:49:15.098420+0000","last_became_peered":"2024-09-22T03:49:15.098420+0000","last_unstale":"2024-09-22T03:49:26.057565+0000","last_undegraded":"2024-09-22T03:49:26.057565+0000","last_fullsized":"2024-09-22T03:49:26.057565+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"19'120","reported_seq":132,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:34.773265+0000","last_change":"2024-09-22T03:49:25.163198+0000","last_active":"2024-09-22T03:49:34.773265+0000","last_peered":"2024-09-22T03:49:34.773265+0000","last_clean":"2024-09-22T03:49:34.773265+0000","last_became_active":"2024-09-22T03:49:25.145723+0000","last_became_peered":"2024-09-22T03:49:25.145723+0000","last_unstale":"2024-09-22T03:49:34.773265+0000","last_undegraded":"2024-09-22T03:49:34.773265+0000","last_fullsized":"2024-09-22T03:49:34.773265+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7864320,"num_objects":120,"num_object_clones":0,"num_object_copies":360,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":7680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"19'117","reported_seq":129,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:34.977735+0000","last_change":"2024-09-22T03:49:25.168751+0000","last_active":"2024-09-22T03:49:34.977735+0000","last_peered":"2024-09-22T03:49:34.977735+0000","last_clean":"2024-09-22T03:49:34.977735+0000","last_became_active":"2024-09-22T03:49:25.160072+0000","last_became_peered":"2024-09-22T03:49:25.160072+0000","last_unstale":"2024-09-22T03:49:34.977735+0000","last_undegraded":"2024-09-22T03:49:34.977735+0000","last_fullsized":"2024-09-22T03:49:34.977735+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7667712,"num_objects":117,"num_object_clones":0,"num_object_copies":351,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":117,"num_write_kb":7488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":25,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:26.061328+0000","last_change":"2024-09-22T03:49:17.036954+0000","last_active":"2024-09-22T03:49:26.061328+0000","last_peered":"2024-09-22T03:49:26.061328+0000","last_clean":"2024-09-22T03:49:26.061328+0000","last_became_active":"2024-09-22T03:49:15.110506+0000","last_became_peered":"2024-09-22T03:49:15.110506+0000","last_unstale":"2024-09-22T03:49:26.061328+0000","last_undegraded":"2024-09-22T03:49:26.061328+0000","last_fullsized":"2024-09-22T03:49:26.061328+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"19'129","reported_seq":141,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:35.933896+0000","last_change":"2024-09-22T03:49:25.218967+0000","last_active":"2024-09-22T03:49:35.933896+0000","last_peered":"2024-09-22T03:49:35.933896+0000","last_clean":"2024-09-22T03:49:35.933896+0000","last_became_active":"2024-09-22T03:49:25.203726+0000","last_became_peered":"2024-09-22T03:49:25.203726+0000","last_unstale":"2024-09-22T03:49:35.933896+0000","last_undegraded":"2024-09-22T03:49:35.933896+0000","last_fullsized":"2024-09-22T03:49:35.933896+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8454144,"num_objects":129,"num_object_clones":0,"num_object_copies":387,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":8256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":25,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:26.054492+0000","last_change":"2024-09-22T03:49:17.032989+0000","last_active":"2024-09-22T03:49:26.054492+0000","last_peered":"2024-09-22T03:49:26.054492+0000","last_clean":"2024-09-22T03:49:26.054492+0000","last_became_active":"2024-09-22T03:49:15.079260+0000","last_became_peered":"2024-09-22T03:49:15.079260+0000","last_unstale":"2024-09-22T03:49:26.054492+0000","last_undegraded":"2024-09-22T03:49:26.054492+0000","last_fullsized":"2024-09-22T03:49:26.054492+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"19'118","reported_seq":130,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:35.897182+0000","last_change":"2024-09-22T03:49:25.275215+0000","last_active":"2024-09-22T03:49:35.897182+0000","last_peered":"2024-09-22T03:49:35.897182+0000","last_clean":"2024-09-22T03:49:35.897182+0000","last_became_active":"2024-09-22T03:49:25.260843+0000","last_became_peered":"2024-09-22T03:49:25.260843+0000","last_unstale":"2024-09-22T03:49:35.897182+0000","last_undegraded":"2024-09-22T03:49:35.897182+0000","last_fullsized":"2024-09-22T03:49:35.897182+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7733248,"num_objects":118,"num_object_clones":0,"num_object_copies":354,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":118,"num_write_kb":7552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":25,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:26.064309+0000","last_change":"2024-09-22T03:49:17.036402+0000","last_active":"2024-09-22T03:49:26.064309+0000","last_peered":"2024-09-22T03:49:26.064309+0000","last_clean":"2024-09-22T03:49:26.064309+0000","last_became_active":"2024-09-22T03:49:15.108430+0000","last_became_peered":"2024-09-22T03:49:15.108430+0000","last_unstale":"2024-09-22T03:49:26.064309+0000","last_undegraded":"2024-09-22T03:49:26.064309+0000","last_fullsized":"2024-09-22T03:49:26.064309+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"19'120","reported_seq":132,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:34.949604+0000","last_change":"2024-09-22T03:49:25.211493+0000","last_active":"2024-09-22T03:49:34.949604+0000","last_peered":"2024-09-22T03:49:34.949604+0000","last_clean":"2024-09-22T03:49:34.949604+0000","last_became_active":"2024-09-22T03:49:25.194855+0000","last_became_peered":"2024-09-22T03:49:25.194855+0000","last_unstale":"2024-09-22T03:49:34.949604+0000","last_undegraded":"2024-09-22T03:49:34.949604+0000","last_fullsized":"2024-09-22T03:49:34.949604+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7864320,"num_objects":120,"num_object_clones":0,"num_object_copies":360,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":7680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":25,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:26.050967+0000","last_change":"2024-09-22T03:49:17.029128+0000","last_active":"2024-09-22T03:49:26.050967+0000","last_peered":"2024-09-22T03:49:26.050967+0000","last_clean":"2024-09-22T03:49:26.050967+0000","last_became_active":"2024-09-22T03:49:15.113396+0000","last_became_peered":"2024-09-22T03:49:15.113396+0000","last_unstale":"2024-09-22T03:49:26.050967+0000","last_undegraded":"2024-09-22T03:49:26.050967+0000","last_fullsized":"2024-09-22T03:49:26.050967+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":121372672,"num_objects":1852,"num_object_clones":0,"num_object_copies":5556,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1852,"num_write_kb":118528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":22654976,"data_stored":362479616,"data_compressed":17209142,"data_compressed_allocated":22654976,"data_compressed_original":362479616,"omap_allocated":0,"internal_metadata":0},"log_size":1852,"ondisk_log_size":1852,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949672985,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":37724,"kb_used_data":6732,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94334116,"statfs":{"total":96636764160,"available":96598134784,"internally_reserved":0,"allocated":6893568,"data_stored":107330449,"data_compressed":5095475,"data_compressed_allocated":6709248,"data_compressed_original":107266048,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654705689,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36496,"kb_used_data":5504,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94335344,"statfs":{"total":96636764160,"available":96599392256,"internally_reserved":0,"allocated":5636096,"data_stored":87603569,"data_compressed":4156802,"data_compressed_allocated":5472256,"data_compressed_original":87556096,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705688,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35204,"kb_used_data":4212,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94336636,"statfs":{"total":96636764160,"available":96600715264,"internally_reserved":0,"allocated":4313088,"data_stored":66042769,"data_compressed":3135108,"data_compressed_allocated":4128768,"data_compressed_original":65978368,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705688,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36288,"kb_used_data":5296,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94335552,"statfs":{"total":96636764160,"available":96599605248,"internally_reserved":0,"allocated":5423104,"data_stored":83868542,"data_compressed":3981437,"data_compressed_allocated":5242880,"data_compressed_original":83804160,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5865472,"data_stored":93847552,"data_compressed":4455525,"data_compressed_allocated":5865472,"data_compressed_original":93847552,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":6688768,"data_stored":107020288,"data_compressed":5080979,"data_compressed_allocated":6688768,"data_compressed_original":107020288,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4616192,"data_stored":73859072,"data_compressed":3506500,"data_compressed_allocated":4616192,"data_compressed_original":73859072,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":5484544,"data_stored":87752704,"data_compressed":4166138,"data_compressed_allocated":5484544,"data_compressed_original":87752704,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:49:41.138 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 15 16 3015 2999 12.4947 11.1875 0.134887 0.0796128 2024-09-22T03:49:42.138 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 16 16 3197 3181 12.4246 11.375 0.130802 0.0802424 2024-09-22T03:49:43.138 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 17 16 3410 3394 12.4768 13.3125 0.0959315 0.0798633 2024-09-22T03:49:43.193 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:49:43.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:49:43.345+0000 7f43b1111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:43.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:49:43.356+0000 7f43b1111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:44.138 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 18 16 3603 3587 12.4537 12.0625 0.0889516 0.0800732 2024-09-22T03:49:45.139 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 19 16 3806 3790 12.466 12.6875 0.134164 0.0799998 2024-09-22T03:49:45.716 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:49:45.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:49:45.868+0000 7f4b28991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:45.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:49:45.878+0000 7f4b28991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:45.892 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:49:45.892 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:49:45.893 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:49:46.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:49:46.056+0000 7ff89de63640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:46.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:49:46.081+0000 7ff89de63640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:46.139 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:2024-09-22T03:49:46.138828+0000 min lat: 0.0165006 max lat: 0.193822 avg lat: 0.0800311 2024-09-22T03:49:46.139 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-22T03:49:46.139 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 20 16 4001 3985 12.452 12.1875 0.0638177 0.0800311 2024-09-22T03:49:46.458 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:49:46.459 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-22T03:49:46.481 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":30,"stamp":"2024-09-22T03:49:44.969890+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":188285491,"num_objects":2868,"num_object_clones":0,"num_object_copies":8604,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":2945,"num_write_kb":184404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2919,"ondisk_log_size":2919,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":169712,"kb_used_data":33260,"kb_used_omap":0,"kb_used_meta":136384,"kb_avail":377317648,"statfs":{"total":386547056640,"available":386373271552,"internally_reserved":0,"allocated":34058240,"data_stored":533523473,"data_compressed":25328270,"data_compressed_allocated":33345536,"data_compressed_original":533282816,"omap_allocated":0,"internal_metadata":139657216},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":132055040,"num_objects":2015,"num_object_clones":0,"num_object_copies":6045,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2015,"num_write_kb":128960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002520"},"pg_stats":[{"pgid":"3.f","version":"19'176","reported_seq":188,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:39.645644+0000","last_change":"2024-09-22T03:49:25.167073+0000","last_active":"2024-09-22T03:49:39.645644+0000","last_peered":"2024-09-22T03:49:39.645644+0000","last_clean":"2024-09-22T03:49:39.645644+0000","last_became_active":"2024-09-22T03:49:25.159818+0000","last_became_peered":"2024-09-22T03:49:25.159818+0000","last_unstale":"2024-09-22T03:49:39.645644+0000","last_undegraded":"2024-09-22T03:49:39.645644+0000","last_fullsized":"2024-09-22T03:49:39.645644+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11534336,"num_objects":176,"num_object_clones":0,"num_object_copies":528,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"19'180","reported_seq":192,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:40.827720+0000","last_change":"2024-09-22T03:49:25.238720+0000","last_active":"2024-09-22T03:49:40.827720+0000","last_peered":"2024-09-22T03:49:40.827720+0000","last_clean":"2024-09-22T03:49:40.827720+0000","last_became_active":"2024-09-22T03:49:25.229005+0000","last_became_peered":"2024-09-22T03:49:25.229005+0000","last_unstale":"2024-09-22T03:49:40.827720+0000","last_undegraded":"2024-09-22T03:49:40.827720+0000","last_fullsized":"2024-09-22T03:49:40.827720+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11796480,"num_objects":180,"num_object_clones":0,"num_object_copies":540,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":180,"num_write_kb":11520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"19'177","reported_seq":189,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:39.902359+0000","last_change":"2024-09-22T03:49:25.173605+0000","last_active":"2024-09-22T03:49:39.902359+0000","last_peered":"2024-09-22T03:49:39.902359+0000","last_clean":"2024-09-22T03:49:39.902359+0000","last_became_active":"2024-09-22T03:49:25.165491+0000","last_became_peered":"2024-09-22T03:49:25.165491+0000","last_unstale":"2024-09-22T03:49:39.902359+0000","last_undegraded":"2024-09-22T03:49:39.902359+0000","last_fullsized":"2024-09-22T03:49:39.902359+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11599872,"num_objects":177,"num_object_clones":0,"num_object_copies":531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":177,"num_write_kb":11328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"19'169","reported_seq":181,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:39.769942+0000","last_change":"2024-09-22T03:49:25.207920+0000","last_active":"2024-09-22T03:49:39.769942+0000","last_peered":"2024-09-22T03:49:39.769942+0000","last_clean":"2024-09-22T03:49:39.769942+0000","last_became_active":"2024-09-22T03:49:25.198168+0000","last_became_peered":"2024-09-22T03:49:25.198168+0000","last_unstale":"2024-09-22T03:49:39.769942+0000","last_undegraded":"2024-09-22T03:49:39.769942+0000","last_fullsized":"2024-09-22T03:49:39.769942+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11075584,"num_objects":169,"num_object_clones":0,"num_object_copies":507,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":169,"num_write_kb":10816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"19'175","reported_seq":187,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:40.927282+0000","last_change":"2024-09-22T03:49:25.280543+0000","last_active":"2024-09-22T03:49:40.927282+0000","last_peered":"2024-09-22T03:49:40.927282+0000","last_clean":"2024-09-22T03:49:40.927282+0000","last_became_active":"2024-09-22T03:49:25.268731+0000","last_became_peered":"2024-09-22T03:49:25.268731+0000","last_unstale":"2024-09-22T03:49:40.927282+0000","last_undegraded":"2024-09-22T03:49:40.927282+0000","last_fullsized":"2024-09-22T03:49:40.927282+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11468800,"num_objects":175,"num_object_clones":0,"num_object_copies":525,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":175,"num_write_kb":11200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"19'186","reported_seq":198,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:39.937737+0000","last_change":"2024-09-22T03:49:25.206225+0000","last_active":"2024-09-22T03:49:39.937737+0000","last_peered":"2024-09-22T03:49:39.937737+0000","last_clean":"2024-09-22T03:49:39.937737+0000","last_became_active":"2024-09-22T03:49:25.201227+0000","last_became_peered":"2024-09-22T03:49:25.201227+0000","last_unstale":"2024-09-22T03:49:39.937737+0000","last_undegraded":"2024-09-22T03:49:39.937737+0000","last_fullsized":"2024-09-22T03:49:39.937737+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12189696,"num_objects":186,"num_object_clones":0,"num_object_copies":558,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":186,"num_write_kb":11904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"19'182","reported_seq":194,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:39.934952+0000","last_change":"2024-09-22T03:49:25.212585+0000","last_active":"2024-09-22T03:49:39.934952+0000","last_peered":"2024-09-22T03:49:39.934952+0000","last_clean":"2024-09-22T03:49:39.934952+0000","last_became_active":"2024-09-22T03:49:25.203356+0000","last_became_peered":"2024-09-22T03:49:25.203356+0000","last_unstale":"2024-09-22T03:49:39.934952+0000","last_undegraded":"2024-09-22T03:49:39.934952+0000","last_fullsized":"2024-09-22T03:49:39.934952+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11927552,"num_objects":182,"num_object_clones":0,"num_object_copies":546,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":182,"num_write_kb":11648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"19'168","reported_seq":180,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:39.772818+0000","last_change":"2024-09-22T03:49:25.177465+0000","last_active":"2024-09-22T03:49:39.772818+0000","last_peered":"2024-09-22T03:49:39.772818+0000","last_clean":"2024-09-22T03:49:39.772818+0000","last_became_active":"2024-09-22T03:49:25.170026+0000","last_became_peered":"2024-09-22T03:49:25.170026+0000","last_unstale":"2024-09-22T03:49:39.772818+0000","last_undegraded":"2024-09-22T03:49:39.772818+0000","last_fullsized":"2024-09-22T03:49:39.772818+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11010048,"num_objects":168,"num_object_clones":0,"num_object_copies":504,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":10752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":100,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:26.053552+0000","last_change":"2024-09-22T03:49:12.034704+0000","last_active":"2024-09-22T03:49:26.053552+0000","last_peered":"2024-09-22T03:49:26.053552+0000","last_clean":"2024-09-22T03:49:26.053552+0000","last_became_active":"2024-09-22T03:49:12.027470+0000","last_became_peered":"2024-09-22T03:49:12.027470+0000","last_unstale":"2024-09-22T03:49:26.053552+0000","last_undegraded":"2024-09-22T03:49:26.053552+0000","last_fullsized":"2024-09-22T03:49:26.053552+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_clean_scrub_stamp":"2024-09-22T03:49:10.979949+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":26,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:26.060600+0000","last_change":"2024-09-22T03:49:17.031458+0000","last_active":"2024-09-22T03:49:26.060600+0000","last_peered":"2024-09-22T03:49:26.060600+0000","last_clean":"2024-09-22T03:49:26.060600+0000","last_became_active":"2024-09-22T03:49:15.125490+0000","last_became_peered":"2024-09-22T03:49:15.125490+0000","last_unstale":"2024-09-22T03:49:26.060600+0000","last_undegraded":"2024-09-22T03:49:26.060600+0000","last_fullsized":"2024-09-22T03:49:26.060600+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"19'181","reported_seq":193,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:39.680730+0000","last_change":"2024-09-22T03:49:25.226827+0000","last_active":"2024-09-22T03:49:39.680730+0000","last_peered":"2024-09-22T03:49:39.680730+0000","last_clean":"2024-09-22T03:49:39.680730+0000","last_became_active":"2024-09-22T03:49:25.218579+0000","last_became_peered":"2024-09-22T03:49:25.218579+0000","last_unstale":"2024-09-22T03:49:39.680730+0000","last_undegraded":"2024-09-22T03:49:39.680730+0000","last_fullsized":"2024-09-22T03:49:39.680730+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11862016,"num_objects":181,"num_object_clones":0,"num_object_copies":543,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":181,"num_write_kb":11584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":25,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:26.053667+0000","last_change":"2024-09-22T03:49:17.029339+0000","last_active":"2024-09-22T03:49:26.053667+0000","last_peered":"2024-09-22T03:49:26.053667+0000","last_clean":"2024-09-22T03:49:26.053667+0000","last_became_active":"2024-09-22T03:49:15.097304+0000","last_became_peered":"2024-09-22T03:49:15.097304+0000","last_unstale":"2024-09-22T03:49:26.053667+0000","last_undegraded":"2024-09-22T03:49:26.053667+0000","last_fullsized":"2024-09-22T03:49:26.053667+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"19'157","reported_seq":169,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:39.917253+0000","last_change":"2024-09-22T03:49:25.208298+0000","last_active":"2024-09-22T03:49:39.917253+0000","last_peered":"2024-09-22T03:49:39.917253+0000","last_clean":"2024-09-22T03:49:39.917253+0000","last_became_active":"2024-09-22T03:49:25.193750+0000","last_became_peered":"2024-09-22T03:49:25.193750+0000","last_unstale":"2024-09-22T03:49:39.917253+0000","last_undegraded":"2024-09-22T03:49:39.917253+0000","last_fullsized":"2024-09-22T03:49:39.917253+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10289152,"num_objects":157,"num_object_clones":0,"num_object_copies":471,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":157,"num_write_kb":10048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":25,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:26.056439+0000","last_change":"2024-09-22T03:49:17.029349+0000","last_active":"2024-09-22T03:49:26.056439+0000","last_peered":"2024-09-22T03:49:26.056439+0000","last_clean":"2024-09-22T03:49:26.056439+0000","last_became_active":"2024-09-22T03:49:15.094890+0000","last_became_peered":"2024-09-22T03:49:15.094890+0000","last_unstale":"2024-09-22T03:49:26.056439+0000","last_undegraded":"2024-09-22T03:49:26.056439+0000","last_fullsized":"2024-09-22T03:49:26.056439+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"19'190","reported_seq":202,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:40.935507+0000","last_change":"2024-09-22T03:49:25.226551+0000","last_active":"2024-09-22T03:49:40.935507+0000","last_peered":"2024-09-22T03:49:40.935507+0000","last_clean":"2024-09-22T03:49:40.935507+0000","last_became_active":"2024-09-22T03:49:25.213989+0000","last_became_peered":"2024-09-22T03:49:25.213989+0000","last_unstale":"2024-09-22T03:49:40.935507+0000","last_undegraded":"2024-09-22T03:49:40.935507+0000","last_fullsized":"2024-09-22T03:49:40.935507+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12451840,"num_objects":190,"num_object_clones":0,"num_object_copies":570,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":190,"num_write_kb":12160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":27,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:26.057565+0000","last_change":"2024-09-22T03:49:17.031466+0000","last_active":"2024-09-22T03:49:26.057565+0000","last_peered":"2024-09-22T03:49:26.057565+0000","last_clean":"2024-09-22T03:49:26.057565+0000","last_became_active":"2024-09-22T03:49:15.098420+0000","last_became_peered":"2024-09-22T03:49:15.098420+0000","last_unstale":"2024-09-22T03:49:26.057565+0000","last_undegraded":"2024-09-22T03:49:26.057565+0000","last_fullsized":"2024-09-22T03:49:26.057565+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"19'179","reported_seq":191,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:39.906785+0000","last_change":"2024-09-22T03:49:25.163198+0000","last_active":"2024-09-22T03:49:39.906785+0000","last_peered":"2024-09-22T03:49:39.906785+0000","last_clean":"2024-09-22T03:49:39.906785+0000","last_became_active":"2024-09-22T03:49:25.145723+0000","last_became_peered":"2024-09-22T03:49:25.145723+0000","last_unstale":"2024-09-22T03:49:39.906785+0000","last_undegraded":"2024-09-22T03:49:39.906785+0000","last_fullsized":"2024-09-22T03:49:39.906785+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11730944,"num_objects":179,"num_object_clones":0,"num_object_copies":537,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":11456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"19'184","reported_seq":196,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:39.719247+0000","last_change":"2024-09-22T03:49:25.168751+0000","last_active":"2024-09-22T03:49:39.719247+0000","last_peered":"2024-09-22T03:49:39.719247+0000","last_clean":"2024-09-22T03:49:39.719247+0000","last_became_active":"2024-09-22T03:49:25.160072+0000","last_became_peered":"2024-09-22T03:49:25.160072+0000","last_unstale":"2024-09-22T03:49:39.719247+0000","last_undegraded":"2024-09-22T03:49:39.719247+0000","last_fullsized":"2024-09-22T03:49:39.719247+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12058624,"num_objects":184,"num_object_clones":0,"num_object_copies":552,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":11776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":25,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:26.061328+0000","last_change":"2024-09-22T03:49:17.036954+0000","last_active":"2024-09-22T03:49:26.061328+0000","last_peered":"2024-09-22T03:49:26.061328+0000","last_clean":"2024-09-22T03:49:26.061328+0000","last_became_active":"2024-09-22T03:49:15.110506+0000","last_became_peered":"2024-09-22T03:49:15.110506+0000","last_unstale":"2024-09-22T03:49:26.061328+0000","last_undegraded":"2024-09-22T03:49:26.061328+0000","last_fullsized":"2024-09-22T03:49:26.061328+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"19'197","reported_seq":209,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:41.032710+0000","last_change":"2024-09-22T03:49:25.218967+0000","last_active":"2024-09-22T03:49:41.032710+0000","last_peered":"2024-09-22T03:49:41.032710+0000","last_clean":"2024-09-22T03:49:41.032710+0000","last_became_active":"2024-09-22T03:49:25.203726+0000","last_became_peered":"2024-09-22T03:49:25.203726+0000","last_unstale":"2024-09-22T03:49:41.032710+0000","last_undegraded":"2024-09-22T03:49:41.032710+0000","last_fullsized":"2024-09-22T03:49:41.032710+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12910592,"num_objects":197,"num_object_clones":0,"num_object_copies":591,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":197,"num_write_kb":12608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":25,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:26.054492+0000","last_change":"2024-09-22T03:49:17.032989+0000","last_active":"2024-09-22T03:49:26.054492+0000","last_peered":"2024-09-22T03:49:26.054492+0000","last_clean":"2024-09-22T03:49:26.054492+0000","last_became_active":"2024-09-22T03:49:15.079260+0000","last_became_peered":"2024-09-22T03:49:15.079260+0000","last_unstale":"2024-09-22T03:49:26.054492+0000","last_undegraded":"2024-09-22T03:49:26.054492+0000","last_fullsized":"2024-09-22T03:49:26.054492+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"19'175","reported_seq":187,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:40.969152+0000","last_change":"2024-09-22T03:49:25.275215+0000","last_active":"2024-09-22T03:49:40.969152+0000","last_peered":"2024-09-22T03:49:40.969152+0000","last_clean":"2024-09-22T03:49:40.969152+0000","last_became_active":"2024-09-22T03:49:25.260843+0000","last_became_peered":"2024-09-22T03:49:25.260843+0000","last_unstale":"2024-09-22T03:49:40.969152+0000","last_undegraded":"2024-09-22T03:49:40.969152+0000","last_fullsized":"2024-09-22T03:49:40.969152+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11468800,"num_objects":175,"num_object_clones":0,"num_object_copies":525,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":175,"num_write_kb":11200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":25,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:26.064309+0000","last_change":"2024-09-22T03:49:17.036402+0000","last_active":"2024-09-22T03:49:26.064309+0000","last_peered":"2024-09-22T03:49:26.064309+0000","last_clean":"2024-09-22T03:49:26.064309+0000","last_became_active":"2024-09-22T03:49:15.108430+0000","last_became_peered":"2024-09-22T03:49:15.108430+0000","last_unstale":"2024-09-22T03:49:26.064309+0000","last_undegraded":"2024-09-22T03:49:26.064309+0000","last_fullsized":"2024-09-22T03:49:26.064309+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"19'188","reported_seq":200,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:39.972964+0000","last_change":"2024-09-22T03:49:25.211493+0000","last_active":"2024-09-22T03:49:39.972964+0000","last_peered":"2024-09-22T03:49:39.972964+0000","last_clean":"2024-09-22T03:49:39.972964+0000","last_became_active":"2024-09-22T03:49:25.194855+0000","last_became_peered":"2024-09-22T03:49:25.194855+0000","last_unstale":"2024-09-22T03:49:39.972964+0000","last_undegraded":"2024-09-22T03:49:39.972964+0000","last_fullsized":"2024-09-22T03:49:39.972964+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12320768,"num_objects":188,"num_object_clones":0,"num_object_copies":564,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":188,"num_write_kb":12032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":25,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:26.050967+0000","last_change":"2024-09-22T03:49:17.029128+0000","last_active":"2024-09-22T03:49:26.050967+0000","last_peered":"2024-09-22T03:49:26.050967+0000","last_clean":"2024-09-22T03:49:26.050967+0000","last_became_active":"2024-09-22T03:49:15.113396+0000","last_became_peered":"2024-09-22T03:49:15.113396+0000","last_unstale":"2024-09-22T03:49:26.050967+0000","last_undegraded":"2024-09-22T03:49:26.050967+0000","last_fullsized":"2024-09-22T03:49:26.050967+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":187695104,"num_objects":2864,"num_object_clones":0,"num_object_copies":8592,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2864,"num_write_kb":183296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":35110912,"data_stored":561774592,"data_compressed":26672734,"data_compressed_allocated":35110912,"data_compressed_original":561774592,"omap_allocated":0,"internal_metadata":0},"log_size":2864,"ondisk_log_size":2864,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949672990,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":45140,"kb_used_data":9988,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94326700,"statfs":{"total":96636764160,"available":96590540800,"internally_reserved":0,"allocated":10227712,"data_stored":160676753,"data_compressed":7628643,"data_compressed_allocated":10043392,"data_compressed_original":160612352,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654705694,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":43076,"kb_used_data":7924,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94328764,"statfs":{"total":96636764160,"available":96592654336,"internally_reserved":0,"allocated":8114176,"data_stored":127252849,"data_compressed":6039562,"data_compressed_allocated":7950336,"data_compressed_original":127205376,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705693,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":37792,"kb_used_data":6796,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94334048,"statfs":{"total":96636764160,"available":96598065152,"internally_reserved":0,"allocated":6959104,"data_stored":108379025,"data_compressed":5145460,"data_compressed_allocated":6774784,"data_compressed_original":108314624,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705693,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":43704,"kb_used_data":8552,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94328136,"statfs":{"total":96636764160,"available":96592011264,"internally_reserved":0,"allocated":8757248,"data_stored":137214846,"data_compressed":6514605,"data_compressed_allocated":8577024,"data_compressed_original":137150464,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":9240576,"data_stored":147849216,"data_compressed":7019813,"data_compressed_allocated":9240576,"data_compressed_original":147849216,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":10018816,"data_stored":160301056,"data_compressed":7611035,"data_compressed_allocated":10018816,"data_compressed_original":160301056,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":7274496,"data_stored":116391936,"data_compressed":5526188,"data_compressed_allocated":7274496,"data_compressed_original":116391936,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8577024,"data_stored":137232384,"data_compressed":6515698,"data_compressed_allocated":8577024,"data_compressed_original":137232384,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:49:47.139 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 21 16 4184 4168 12.4036 11.4375 0.110059 0.0803404 2024-09-22T03:49:48.139 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 22 16 4388 4372 12.4193 12.75 0.0807109 0.0803434 2024-09-22T03:49:48.336 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:49:48.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:49:48.496+0000 7fa717d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:48.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:49:48.507+0000 7fa717d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:49.139 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 23 16 4579 4563 12.3983 11.9375 0.102486 0.0805211 2024-09-22T03:49:50.139 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 24 16 4773 4757 12.3869 12.125 0.0970482 0.0805417 2024-09-22T03:49:50.896 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:49:51.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:49:51.057+0000 7f18d64bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:51.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:49:51.067+0000 7f18d64bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:51.139 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 25 16 4965 4949 12.3714 12 0.087226 0.0806048 2024-09-22T03:49:51.483 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:49:51.483 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:49:51.483 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:49:51.483 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:49:51.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:49:51.628+0000 7ff347b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:51.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:49:51.643+0000 7ff347b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:51.778 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:49:51.779 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:49:51.779 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:49:51.779 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:49:51.779 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:49:51.779 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:49:51.779 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:49:51.779 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:49:51.779 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:49:51.779 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:49:51.779 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:49:51.779 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:49:51.782 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:49:51.782 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:49:51.782 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:49:51.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:49:51.943+0000 7f0970e57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:51.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:49:51.962+0000 7f0970e57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:52.098 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:49:52.098 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:49:52.098 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:49:52.099 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:49:52.099 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:49:52.099 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:49:52.099 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:49:52.099 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:49:52.099 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:49:52.099 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:49:52.099 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:49:52.099 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:49:52.102 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:49:52.103 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:49:52.103 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:49:52.139 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 26 15 5148 5133 12.3378 11.5 0.101309 0.0809008 2024-09-22T03:49:52.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:49:52.274+0000 7f40f9911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:52.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:49:52.291+0000 7f40f9911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:52.331 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:49:52.331 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:49:52.331 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:49:52.332 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:49:52.332 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:49:52.332 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:49:52.332 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:49:52.332 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:49:52.332 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:49:52.332 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:49:52.332 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:49:52.332 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:49:52.336 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:49:52.336 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:49:52.336 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:49:52.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:49:52.531+0000 7f824e391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:52.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:49:52.544+0000 7f824e391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:52.644 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:49:52.644 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:49:52.644 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:49:52.644 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:49:52.644 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:49:52.645 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:49:52.645 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:49:52.645 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:49:52.645 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:49:52.645 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:49:52.645 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:49:52.645 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:49:52.648 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:49:52.648 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:49:53.139 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 27 16 5346 5330 12.3368 12.3125 0.0267573 0.0809017 2024-09-22T03:49:53.392 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:49:53.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:49:53.544+0000 7fd373591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:53.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:49:53.553+0000 7fd373591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:54.139 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 28 16 5532 5516 12.3114 11.625 0.0877893 0.0810852 2024-09-22T03:49:55.139 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 29 16 5722 5706 12.2963 11.875 0.10454 0.0811762 2024-09-22T03:49:55.965 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:49:56.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:49:56.112+0000 7f6baf67d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:56.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:49:56.122+0000 7f6baf67d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:56.139 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 30 16 5898 5882 12.253 11 0.0794016 0.0814694 2024-09-22T03:49:57.140 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 31 16 6086 6070 12.2368 11.75 0.0442755 0.0816052 2024-09-22T03:49:57.649 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:49:57.650 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:49:57.650 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:49:57.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:49:57.796+0000 7fe277991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:57.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:49:57.807+0000 7fe277991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:58.106 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:49:58.107 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-22T03:49:58.123 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2024-09-22T03:49:56.972204+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":378077747,"num_objects":5764,"num_object_clones":0,"num_object_copies":17292,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":5841,"num_write_kb":369748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5815,"ondisk_log_size":5815,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":187352,"kb_used_data":67544,"kb_used_omap":0,"kb_used_meta":119744,"kb_avail":377300008,"statfs":{"total":386547056640,"available":386355208192,"internally_reserved":0,"allocated":69165056,"data_stored":1095232529,"data_compressed":52001222,"data_compressed_allocated":68452352,"data_compressed_original":1094991872,"omap_allocated":0,"internal_metadata":122617856},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":189792256,"num_objects":2896,"num_object_clones":0,"num_object_copies":8688,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2896,"num_write_kb":185344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002313"},"pg_stats":[{"pgid":"3.f","version":"19'359","reported_seq":371,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:54.922942+0000","last_change":"2024-09-22T03:49:25.167073+0000","last_active":"2024-09-22T03:49:54.922942+0000","last_peered":"2024-09-22T03:49:54.922942+0000","last_clean":"2024-09-22T03:49:54.922942+0000","last_became_active":"2024-09-22T03:49:25.159818+0000","last_became_peered":"2024-09-22T03:49:25.159818+0000","last_unstale":"2024-09-22T03:49:54.922942+0000","last_undegraded":"2024-09-22T03:49:54.922942+0000","last_fullsized":"2024-09-22T03:49:54.922942+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23527424,"num_objects":359,"num_object_clones":0,"num_object_copies":1077,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":359,"num_write_kb":22976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"19'355","reported_seq":367,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:55.450293+0000","last_change":"2024-09-22T03:49:25.238720+0000","last_active":"2024-09-22T03:49:55.450293+0000","last_peered":"2024-09-22T03:49:55.450293+0000","last_clean":"2024-09-22T03:49:55.450293+0000","last_became_active":"2024-09-22T03:49:25.229005+0000","last_became_peered":"2024-09-22T03:49:25.229005+0000","last_unstale":"2024-09-22T03:49:55.450293+0000","last_undegraded":"2024-09-22T03:49:55.450293+0000","last_fullsized":"2024-09-22T03:49:55.450293+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":355,"log_dups_size":0,"ondisk_log_size":355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23265280,"num_objects":355,"num_object_clones":0,"num_object_copies":1065,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":355,"num_write_kb":22720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"19'358","reported_seq":370,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:54.958061+0000","last_change":"2024-09-22T03:49:25.173605+0000","last_active":"2024-09-22T03:49:54.958061+0000","last_peered":"2024-09-22T03:49:54.958061+0000","last_clean":"2024-09-22T03:49:54.958061+0000","last_became_active":"2024-09-22T03:49:25.165491+0000","last_became_peered":"2024-09-22T03:49:25.165491+0000","last_unstale":"2024-09-22T03:49:54.958061+0000","last_undegraded":"2024-09-22T03:49:54.958061+0000","last_fullsized":"2024-09-22T03:49:54.958061+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23461888,"num_objects":358,"num_object_clones":0,"num_object_copies":1074,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":358,"num_write_kb":22912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"19'336","reported_seq":348,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:54.992014+0000","last_change":"2024-09-22T03:49:25.207920+0000","last_active":"2024-09-22T03:49:54.992014+0000","last_peered":"2024-09-22T03:49:54.992014+0000","last_clean":"2024-09-22T03:49:54.992014+0000","last_became_active":"2024-09-22T03:49:25.198168+0000","last_became_peered":"2024-09-22T03:49:25.198168+0000","last_unstale":"2024-09-22T03:49:54.992014+0000","last_undegraded":"2024-09-22T03:49:54.992014+0000","last_fullsized":"2024-09-22T03:49:54.992014+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22020096,"num_objects":336,"num_object_clones":0,"num_object_copies":1008,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":336,"num_write_kb":21504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"19'359","reported_seq":371,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:55.809447+0000","last_change":"2024-09-22T03:49:25.280543+0000","last_active":"2024-09-22T03:49:55.809447+0000","last_peered":"2024-09-22T03:49:55.809447+0000","last_clean":"2024-09-22T03:49:55.809447+0000","last_became_active":"2024-09-22T03:49:25.268731+0000","last_became_peered":"2024-09-22T03:49:25.268731+0000","last_unstale":"2024-09-22T03:49:55.809447+0000","last_undegraded":"2024-09-22T03:49:55.809447+0000","last_fullsized":"2024-09-22T03:49:55.809447+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23527424,"num_objects":359,"num_object_clones":0,"num_object_copies":1077,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":359,"num_write_kb":22976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"19'360","reported_seq":372,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:54.826457+0000","last_change":"2024-09-22T03:49:25.206225+0000","last_active":"2024-09-22T03:49:54.826457+0000","last_peered":"2024-09-22T03:49:54.826457+0000","last_clean":"2024-09-22T03:49:54.826457+0000","last_became_active":"2024-09-22T03:49:25.201227+0000","last_became_peered":"2024-09-22T03:49:25.201227+0000","last_unstale":"2024-09-22T03:49:54.826457+0000","last_undegraded":"2024-09-22T03:49:54.826457+0000","last_fullsized":"2024-09-22T03:49:54.826457+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23592960,"num_objects":360,"num_object_clones":0,"num_object_copies":1080,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":360,"num_write_kb":23040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"19'373","reported_seq":385,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:54.780202+0000","last_change":"2024-09-22T03:49:25.212585+0000","last_active":"2024-09-22T03:49:54.780202+0000","last_peered":"2024-09-22T03:49:54.780202+0000","last_clean":"2024-09-22T03:49:54.780202+0000","last_became_active":"2024-09-22T03:49:25.203356+0000","last_became_peered":"2024-09-22T03:49:25.203356+0000","last_unstale":"2024-09-22T03:49:54.780202+0000","last_undegraded":"2024-09-22T03:49:54.780202+0000","last_fullsized":"2024-09-22T03:49:54.780202+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24444928,"num_objects":373,"num_object_clones":0,"num_object_copies":1119,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":373,"num_write_kb":23872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"19'352","reported_seq":364,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:54.746355+0000","last_change":"2024-09-22T03:49:25.177465+0000","last_active":"2024-09-22T03:49:54.746355+0000","last_peered":"2024-09-22T03:49:54.746355+0000","last_clean":"2024-09-22T03:49:54.746355+0000","last_became_active":"2024-09-22T03:49:25.170026+0000","last_became_peered":"2024-09-22T03:49:25.170026+0000","last_unstale":"2024-09-22T03:49:54.746355+0000","last_undegraded":"2024-09-22T03:49:54.746355+0000","last_fullsized":"2024-09-22T03:49:54.746355+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":352,"num_object_clones":0,"num_object_copies":1056,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":352,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":100,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:26.053552+0000","last_change":"2024-09-22T03:49:12.034704+0000","last_active":"2024-09-22T03:49:26.053552+0000","last_peered":"2024-09-22T03:49:26.053552+0000","last_clean":"2024-09-22T03:49:26.053552+0000","last_became_active":"2024-09-22T03:49:12.027470+0000","last_became_peered":"2024-09-22T03:49:12.027470+0000","last_unstale":"2024-09-22T03:49:26.053552+0000","last_undegraded":"2024-09-22T03:49:26.053552+0000","last_fullsized":"2024-09-22T03:49:26.053552+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_clean_scrub_stamp":"2024-09-22T03:49:10.979949+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":26,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:26.060600+0000","last_change":"2024-09-22T03:49:17.031458+0000","last_active":"2024-09-22T03:49:26.060600+0000","last_peered":"2024-09-22T03:49:26.060600+0000","last_clean":"2024-09-22T03:49:26.060600+0000","last_became_active":"2024-09-22T03:49:15.125490+0000","last_became_peered":"2024-09-22T03:49:15.125490+0000","last_unstale":"2024-09-22T03:49:26.060600+0000","last_undegraded":"2024-09-22T03:49:26.060600+0000","last_fullsized":"2024-09-22T03:49:26.060600+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"19'364","reported_seq":376,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:54.773106+0000","last_change":"2024-09-22T03:49:25.226827+0000","last_active":"2024-09-22T03:49:54.773106+0000","last_peered":"2024-09-22T03:49:54.773106+0000","last_clean":"2024-09-22T03:49:54.773106+0000","last_became_active":"2024-09-22T03:49:25.218579+0000","last_became_peered":"2024-09-22T03:49:25.218579+0000","last_unstale":"2024-09-22T03:49:54.773106+0000","last_undegraded":"2024-09-22T03:49:54.773106+0000","last_fullsized":"2024-09-22T03:49:54.773106+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23855104,"num_objects":364,"num_object_clones":0,"num_object_copies":1092,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":364,"num_write_kb":23296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":25,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:26.053667+0000","last_change":"2024-09-22T03:49:17.029339+0000","last_active":"2024-09-22T03:49:26.053667+0000","last_peered":"2024-09-22T03:49:26.053667+0000","last_clean":"2024-09-22T03:49:26.053667+0000","last_became_active":"2024-09-22T03:49:15.097304+0000","last_became_peered":"2024-09-22T03:49:15.097304+0000","last_unstale":"2024-09-22T03:49:26.053667+0000","last_undegraded":"2024-09-22T03:49:26.053667+0000","last_fullsized":"2024-09-22T03:49:26.053667+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"19'351","reported_seq":363,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:54.910276+0000","last_change":"2024-09-22T03:49:25.208298+0000","last_active":"2024-09-22T03:49:54.910276+0000","last_peered":"2024-09-22T03:49:54.910276+0000","last_clean":"2024-09-22T03:49:54.910276+0000","last_became_active":"2024-09-22T03:49:25.193750+0000","last_became_peered":"2024-09-22T03:49:25.193750+0000","last_unstale":"2024-09-22T03:49:54.910276+0000","last_undegraded":"2024-09-22T03:49:54.910276+0000","last_fullsized":"2024-09-22T03:49:54.910276+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23003136,"num_objects":351,"num_object_clones":0,"num_object_copies":1053,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":351,"num_write_kb":22464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":25,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:26.056439+0000","last_change":"2024-09-22T03:49:17.029349+0000","last_active":"2024-09-22T03:49:26.056439+0000","last_peered":"2024-09-22T03:49:26.056439+0000","last_clean":"2024-09-22T03:49:26.056439+0000","last_became_active":"2024-09-22T03:49:15.094890+0000","last_became_peered":"2024-09-22T03:49:15.094890+0000","last_unstale":"2024-09-22T03:49:26.056439+0000","last_undegraded":"2024-09-22T03:49:26.056439+0000","last_fullsized":"2024-09-22T03:49:26.056439+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"19'403","reported_seq":415,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:56.017655+0000","last_change":"2024-09-22T03:49:25.226551+0000","last_active":"2024-09-22T03:49:56.017655+0000","last_peered":"2024-09-22T03:49:56.017655+0000","last_clean":"2024-09-22T03:49:56.017655+0000","last_became_active":"2024-09-22T03:49:25.213989+0000","last_became_peered":"2024-09-22T03:49:25.213989+0000","last_unstale":"2024-09-22T03:49:56.017655+0000","last_undegraded":"2024-09-22T03:49:56.017655+0000","last_fullsized":"2024-09-22T03:49:56.017655+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26411008,"num_objects":403,"num_object_clones":0,"num_object_copies":1209,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":403,"num_write_kb":25792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":27,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:26.057565+0000","last_change":"2024-09-22T03:49:17.031466+0000","last_active":"2024-09-22T03:49:26.057565+0000","last_peered":"2024-09-22T03:49:26.057565+0000","last_clean":"2024-09-22T03:49:26.057565+0000","last_became_active":"2024-09-22T03:49:15.098420+0000","last_became_peered":"2024-09-22T03:49:15.098420+0000","last_unstale":"2024-09-22T03:49:26.057565+0000","last_undegraded":"2024-09-22T03:49:26.057565+0000","last_fullsized":"2024-09-22T03:49:26.057565+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"19'355","reported_seq":367,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:54.904270+0000","last_change":"2024-09-22T03:49:25.163198+0000","last_active":"2024-09-22T03:49:54.904270+0000","last_peered":"2024-09-22T03:49:54.904270+0000","last_clean":"2024-09-22T03:49:54.904270+0000","last_became_active":"2024-09-22T03:49:25.145723+0000","last_became_peered":"2024-09-22T03:49:25.145723+0000","last_unstale":"2024-09-22T03:49:54.904270+0000","last_undegraded":"2024-09-22T03:49:54.904270+0000","last_fullsized":"2024-09-22T03:49:54.904270+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":355,"log_dups_size":0,"ondisk_log_size":355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23265280,"num_objects":355,"num_object_clones":0,"num_object_copies":1065,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":355,"num_write_kb":22720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"19'345","reported_seq":357,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:54.821713+0000","last_change":"2024-09-22T03:49:25.168751+0000","last_active":"2024-09-22T03:49:54.821713+0000","last_peered":"2024-09-22T03:49:54.821713+0000","last_clean":"2024-09-22T03:49:54.821713+0000","last_became_active":"2024-09-22T03:49:25.160072+0000","last_became_peered":"2024-09-22T03:49:25.160072+0000","last_unstale":"2024-09-22T03:49:54.821713+0000","last_undegraded":"2024-09-22T03:49:54.821713+0000","last_fullsized":"2024-09-22T03:49:54.821713+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":345,"log_dups_size":0,"ondisk_log_size":345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22609920,"num_objects":345,"num_object_clones":0,"num_object_copies":1035,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":345,"num_write_kb":22080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":25,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:26.061328+0000","last_change":"2024-09-22T03:49:17.036954+0000","last_active":"2024-09-22T03:49:26.061328+0000","last_peered":"2024-09-22T03:49:26.061328+0000","last_clean":"2024-09-22T03:49:26.061328+0000","last_became_active":"2024-09-22T03:49:15.110506+0000","last_became_peered":"2024-09-22T03:49:15.110506+0000","last_unstale":"2024-09-22T03:49:26.061328+0000","last_undegraded":"2024-09-22T03:49:26.061328+0000","last_fullsized":"2024-09-22T03:49:26.061328+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"19'378","reported_seq":390,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:55.875040+0000","last_change":"2024-09-22T03:49:25.218967+0000","last_active":"2024-09-22T03:49:55.875040+0000","last_peered":"2024-09-22T03:49:55.875040+0000","last_clean":"2024-09-22T03:49:55.875040+0000","last_became_active":"2024-09-22T03:49:25.203726+0000","last_became_peered":"2024-09-22T03:49:25.203726+0000","last_unstale":"2024-09-22T03:49:55.875040+0000","last_undegraded":"2024-09-22T03:49:55.875040+0000","last_fullsized":"2024-09-22T03:49:55.875040+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24772608,"num_objects":378,"num_object_clones":0,"num_object_copies":1134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":378,"num_write_kb":24192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":25,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:26.054492+0000","last_change":"2024-09-22T03:49:17.032989+0000","last_active":"2024-09-22T03:49:26.054492+0000","last_peered":"2024-09-22T03:49:26.054492+0000","last_clean":"2024-09-22T03:49:26.054492+0000","last_became_active":"2024-09-22T03:49:15.079260+0000","last_became_peered":"2024-09-22T03:49:15.079260+0000","last_unstale":"2024-09-22T03:49:26.054492+0000","last_undegraded":"2024-09-22T03:49:26.054492+0000","last_fullsized":"2024-09-22T03:49:26.054492+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"19'348","reported_seq":360,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:55.941506+0000","last_change":"2024-09-22T03:49:25.275215+0000","last_active":"2024-09-22T03:49:55.941506+0000","last_peered":"2024-09-22T03:49:55.941506+0000","last_clean":"2024-09-22T03:49:55.941506+0000","last_became_active":"2024-09-22T03:49:25.260843+0000","last_became_peered":"2024-09-22T03:49:25.260843+0000","last_unstale":"2024-09-22T03:49:55.941506+0000","last_undegraded":"2024-09-22T03:49:55.941506+0000","last_fullsized":"2024-09-22T03:49:55.941506+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":348,"log_dups_size":0,"ondisk_log_size":348,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22806528,"num_objects":348,"num_object_clones":0,"num_object_copies":1044,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":348,"num_write_kb":22272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":25,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:26.064309+0000","last_change":"2024-09-22T03:49:17.036402+0000","last_active":"2024-09-22T03:49:26.064309+0000","last_peered":"2024-09-22T03:49:26.064309+0000","last_clean":"2024-09-22T03:49:26.064309+0000","last_became_active":"2024-09-22T03:49:15.108430+0000","last_became_peered":"2024-09-22T03:49:15.108430+0000","last_unstale":"2024-09-22T03:49:26.064309+0000","last_undegraded":"2024-09-22T03:49:26.064309+0000","last_fullsized":"2024-09-22T03:49:26.064309+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"19'364","reported_seq":376,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:54.816506+0000","last_change":"2024-09-22T03:49:25.211493+0000","last_active":"2024-09-22T03:49:54.816506+0000","last_peered":"2024-09-22T03:49:54.816506+0000","last_clean":"2024-09-22T03:49:54.816506+0000","last_became_active":"2024-09-22T03:49:25.194855+0000","last_became_peered":"2024-09-22T03:49:25.194855+0000","last_unstale":"2024-09-22T03:49:54.816506+0000","last_undegraded":"2024-09-22T03:49:54.816506+0000","last_fullsized":"2024-09-22T03:49:54.816506+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23855104,"num_objects":364,"num_object_clones":0,"num_object_copies":1092,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":364,"num_write_kb":23296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":25,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:26.050967+0000","last_change":"2024-09-22T03:49:17.029128+0000","last_active":"2024-09-22T03:49:26.050967+0000","last_peered":"2024-09-22T03:49:26.050967+0000","last_clean":"2024-09-22T03:49:26.050967+0000","last_became_active":"2024-09-22T03:49:15.113396+0000","last_became_peered":"2024-09-22T03:49:15.113396+0000","last_unstale":"2024-09-22T03:49:26.050967+0000","last_undegraded":"2024-09-22T03:49:26.050967+0000","last_fullsized":"2024-09-22T03:49:26.050967+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":377487360,"num_objects":5760,"num_object_clones":0,"num_object_copies":17280,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5760,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":70631424,"data_stored":1130102784,"data_compressed":53659998,"data_compressed_allocated":70631424,"data_compressed_original":1130102784,"omap_allocated":0,"internal_metadata":0},"log_size":5760,"ondisk_log_size":5760,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949673004,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":45648,"kb_used_data":18816,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94326192,"statfs":{"total":96636764160,"available":96590020608,"internally_reserved":0,"allocated":19267584,"data_stored":305314705,"data_compressed":14496827,"data_compressed_allocated":19083264,"data_compressed_original":305250304,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654705708,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":43388,"kb_used_data":16556,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94328452,"statfs":{"total":96636764160,"available":96592334848,"internally_reserved":0,"allocated":16953344,"data_stored":268679537,"data_compressed":12755258,"data_compressed_allocated":16789504,"data_compressed_original":268632064,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705708,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":53496,"kb_used_data":14184,"kb_used_omap":0,"kb_used_meta":39296,"kb_avail":94318344,"statfs":{"total":96636764160,"available":96581984256,"internally_reserved":0,"allocated":14524416,"data_stored":229424017,"data_compressed":10893324,"data_compressed_allocated":14340096,"data_compressed_original":229359616,"omap_allocated":0,"internal_metadata":40239104},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705708,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":44820,"kb_used_data":17988,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94327020,"statfs":{"total":96636764160,"available":96590868480,"internally_reserved":0,"allocated":18419712,"data_stored":291814270,"data_compressed":13855813,"data_compressed_allocated":18239488,"data_compressed_original":291749888,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":18829312,"data_stored":301268992,"data_compressed":14305005,"data_compressed_allocated":18829312,"data_compressed_original":301268992,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":19656704,"data_stored":314507264,"data_compressed":14933571,"data_compressed_allocated":19656704,"data_compressed_original":314507264,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":14766080,"data_stored":236257280,"data_compressed":11218036,"data_compressed_allocated":14766080,"data_compressed_original":236257280,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":17379328,"data_stored":278069248,"data_compressed":13203386,"data_compressed_allocated":17379328,"data_compressed_original":278069248,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:49:58.140 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 32 16 6264 6248 12.202 11.125 0.154032 0.0818168 2024-09-22T03:49:58.508 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:49:58.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:49:58.659+0000 7f9a2a991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:58.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:49:58.672+0000 7f9a2a991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:49:59.140 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 33 16 6454 6438 12.1921 11.875 0.157823 0.0818613 2024-09-22T03:50:00.142 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 34 16 6662 6646 12.2158 13 0.0798811 0.0817642 2024-09-22T03:50:01.090 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:50:01.140 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 35 16 6850 6834 12.2024 11.75 0.14273 0.081833 2024-09-22T03:50:01.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:50:01.256+0000 7ff8f8e93640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:50:01.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:50:01.265+0000 7ff8f8e93640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:50:02.140 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 36 16 7039 7023 12.1916 11.8125 0.108511 0.0819305 2024-09-22T03:50:03.125 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:50:03.125 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:50:03.125 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:50:03.140 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 37 16 7253 7237 12.2235 13.375 0.0871892 0.0817121 2024-09-22T03:50:03.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:50:03.271+0000 7f2ca9b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:50:03.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:50:03.286+0000 7f2ca9b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:50:03.620 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:50:03.620 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-22T03:50:03.638 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":39,"stamp":"2024-09-22T03:50:02.973482+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":439222835,"num_objects":6697,"num_object_clones":0,"num_object_copies":20091,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":6774,"num_write_kb":429460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6748,"ondisk_log_size":6748,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":194356,"kb_used_data":78708,"kb_used_omap":0,"kb_used_meta":115584,"kb_avail":377293004,"statfs":{"total":386547056640,"available":386348036096,"internally_reserved":0,"allocated":80596992,"data_stored":1278143505,"data_compressed":60686814,"data_compressed_allocated":79884288,"data_compressed_original":1277902848,"omap_allocated":0,"internal_metadata":118358016},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":143589376,"num_objects":2191,"num_object_clones":0,"num_object_copies":6573,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2191,"num_write_kb":140224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002391"},"pg_stats":[{"pgid":"3.f","version":"19'413","reported_seq":425,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:59.885920+0000","last_change":"2024-09-22T03:49:25.167073+0000","last_active":"2024-09-22T03:49:59.885920+0000","last_peered":"2024-09-22T03:49:59.885920+0000","last_clean":"2024-09-22T03:49:59.885920+0000","last_became_active":"2024-09-22T03:49:25.159818+0000","last_became_peered":"2024-09-22T03:49:25.159818+0000","last_unstale":"2024-09-22T03:49:59.885920+0000","last_undegraded":"2024-09-22T03:49:59.885920+0000","last_fullsized":"2024-09-22T03:49:59.885920+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27066368,"num_objects":413,"num_object_clones":0,"num_object_copies":1239,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":413,"num_write_kb":26432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"19'409","reported_seq":421,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:50:00.812742+0000","last_change":"2024-09-22T03:49:25.238720+0000","last_active":"2024-09-22T03:50:00.812742+0000","last_peered":"2024-09-22T03:50:00.812742+0000","last_clean":"2024-09-22T03:50:00.812742+0000","last_became_active":"2024-09-22T03:49:25.229005+0000","last_became_peered":"2024-09-22T03:49:25.229005+0000","last_unstale":"2024-09-22T03:50:00.812742+0000","last_undegraded":"2024-09-22T03:50:00.812742+0000","last_fullsized":"2024-09-22T03:50:00.812742+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26804224,"num_objects":409,"num_object_clones":0,"num_object_copies":1227,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":409,"num_write_kb":26176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"19'435","reported_seq":447,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:59.898428+0000","last_change":"2024-09-22T03:49:25.173605+0000","last_active":"2024-09-22T03:49:59.898428+0000","last_peered":"2024-09-22T03:49:59.898428+0000","last_clean":"2024-09-22T03:49:59.898428+0000","last_became_active":"2024-09-22T03:49:25.165491+0000","last_became_peered":"2024-09-22T03:49:25.165491+0000","last_unstale":"2024-09-22T03:49:59.898428+0000","last_undegraded":"2024-09-22T03:49:59.898428+0000","last_fullsized":"2024-09-22T03:49:59.898428+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28508160,"num_objects":435,"num_object_clones":0,"num_object_copies":1305,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":435,"num_write_kb":27840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"19'387","reported_seq":399,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:59.764221+0000","last_change":"2024-09-22T03:49:25.207920+0000","last_active":"2024-09-22T03:49:59.764221+0000","last_peered":"2024-09-22T03:49:59.764221+0000","last_clean":"2024-09-22T03:49:59.764221+0000","last_became_active":"2024-09-22T03:49:25.198168+0000","last_became_peered":"2024-09-22T03:49:25.198168+0000","last_unstale":"2024-09-22T03:49:59.764221+0000","last_undegraded":"2024-09-22T03:49:59.764221+0000","last_fullsized":"2024-09-22T03:49:59.764221+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25362432,"num_objects":387,"num_object_clones":0,"num_object_copies":1161,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":387,"num_write_kb":24768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"19'419","reported_seq":431,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:50:01.059929+0000","last_change":"2024-09-22T03:49:25.280543+0000","last_active":"2024-09-22T03:50:01.059929+0000","last_peered":"2024-09-22T03:50:01.059929+0000","last_clean":"2024-09-22T03:50:01.059929+0000","last_became_active":"2024-09-22T03:49:25.268731+0000","last_became_peered":"2024-09-22T03:49:25.268731+0000","last_unstale":"2024-09-22T03:50:01.059929+0000","last_undegraded":"2024-09-22T03:50:01.059929+0000","last_fullsized":"2024-09-22T03:50:01.059929+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27459584,"num_objects":419,"num_object_clones":0,"num_object_copies":1257,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":419,"num_write_kb":26816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"19'416","reported_seq":428,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:59.650208+0000","last_change":"2024-09-22T03:49:25.206225+0000","last_active":"2024-09-22T03:49:59.650208+0000","last_peered":"2024-09-22T03:49:59.650208+0000","last_clean":"2024-09-22T03:49:59.650208+0000","last_became_active":"2024-09-22T03:49:25.201227+0000","last_became_peered":"2024-09-22T03:49:25.201227+0000","last_unstale":"2024-09-22T03:49:59.650208+0000","last_undegraded":"2024-09-22T03:49:59.650208+0000","last_fullsized":"2024-09-22T03:49:59.650208+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":416,"num_object_clones":0,"num_object_copies":1248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":416,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"19'437","reported_seq":449,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:59.908866+0000","last_change":"2024-09-22T03:49:25.212585+0000","last_active":"2024-09-22T03:49:59.908866+0000","last_peered":"2024-09-22T03:49:59.908866+0000","last_clean":"2024-09-22T03:49:59.908866+0000","last_became_active":"2024-09-22T03:49:25.203356+0000","last_became_peered":"2024-09-22T03:49:25.203356+0000","last_unstale":"2024-09-22T03:49:59.908866+0000","last_undegraded":"2024-09-22T03:49:59.908866+0000","last_fullsized":"2024-09-22T03:49:59.908866+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28639232,"num_objects":437,"num_object_clones":0,"num_object_copies":1311,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":437,"num_write_kb":27968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"19'403","reported_seq":415,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:59.849530+0000","last_change":"2024-09-22T03:49:25.177465+0000","last_active":"2024-09-22T03:49:59.849530+0000","last_peered":"2024-09-22T03:49:59.849530+0000","last_clean":"2024-09-22T03:49:59.849530+0000","last_became_active":"2024-09-22T03:49:25.170026+0000","last_became_peered":"2024-09-22T03:49:25.170026+0000","last_unstale":"2024-09-22T03:49:59.849530+0000","last_undegraded":"2024-09-22T03:49:59.849530+0000","last_fullsized":"2024-09-22T03:49:59.849530+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26411008,"num_objects":403,"num_object_clones":0,"num_object_copies":1209,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":403,"num_write_kb":25792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":100,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:26.053552+0000","last_change":"2024-09-22T03:49:12.034704+0000","last_active":"2024-09-22T03:49:26.053552+0000","last_peered":"2024-09-22T03:49:26.053552+0000","last_clean":"2024-09-22T03:49:26.053552+0000","last_became_active":"2024-09-22T03:49:12.027470+0000","last_became_peered":"2024-09-22T03:49:12.027470+0000","last_unstale":"2024-09-22T03:49:26.053552+0000","last_undegraded":"2024-09-22T03:49:26.053552+0000","last_fullsized":"2024-09-22T03:49:26.053552+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_clean_scrub_stamp":"2024-09-22T03:49:10.979949+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":26,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:26.060600+0000","last_change":"2024-09-22T03:49:17.031458+0000","last_active":"2024-09-22T03:49:26.060600+0000","last_peered":"2024-09-22T03:49:26.060600+0000","last_clean":"2024-09-22T03:49:26.060600+0000","last_became_active":"2024-09-22T03:49:15.125490+0000","last_became_peered":"2024-09-22T03:49:15.125490+0000","last_unstale":"2024-09-22T03:49:26.060600+0000","last_undegraded":"2024-09-22T03:49:26.060600+0000","last_fullsized":"2024-09-22T03:49:26.060600+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"19'417","reported_seq":429,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:59.943932+0000","last_change":"2024-09-22T03:49:25.226827+0000","last_active":"2024-09-22T03:49:59.943932+0000","last_peered":"2024-09-22T03:49:59.943932+0000","last_clean":"2024-09-22T03:49:59.943932+0000","last_became_active":"2024-09-22T03:49:25.218579+0000","last_became_peered":"2024-09-22T03:49:25.218579+0000","last_unstale":"2024-09-22T03:49:59.943932+0000","last_undegraded":"2024-09-22T03:49:59.943932+0000","last_fullsized":"2024-09-22T03:49:59.943932+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27328512,"num_objects":417,"num_object_clones":0,"num_object_copies":1251,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":417,"num_write_kb":26688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":25,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:26.053667+0000","last_change":"2024-09-22T03:49:17.029339+0000","last_active":"2024-09-22T03:49:26.053667+0000","last_peered":"2024-09-22T03:49:26.053667+0000","last_clean":"2024-09-22T03:49:26.053667+0000","last_became_active":"2024-09-22T03:49:15.097304+0000","last_became_peered":"2024-09-22T03:49:15.097304+0000","last_unstale":"2024-09-22T03:49:26.053667+0000","last_undegraded":"2024-09-22T03:49:26.053667+0000","last_fullsized":"2024-09-22T03:49:26.053667+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"19'411","reported_seq":423,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:59.927282+0000","last_change":"2024-09-22T03:49:25.208298+0000","last_active":"2024-09-22T03:49:59.927282+0000","last_peered":"2024-09-22T03:49:59.927282+0000","last_clean":"2024-09-22T03:49:59.927282+0000","last_became_active":"2024-09-22T03:49:25.193750+0000","last_became_peered":"2024-09-22T03:49:25.193750+0000","last_unstale":"2024-09-22T03:49:59.927282+0000","last_undegraded":"2024-09-22T03:49:59.927282+0000","last_fullsized":"2024-09-22T03:49:59.927282+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26935296,"num_objects":411,"num_object_clones":0,"num_object_copies":1233,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":411,"num_write_kb":26304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":25,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:26.056439+0000","last_change":"2024-09-22T03:49:17.029349+0000","last_active":"2024-09-22T03:49:26.056439+0000","last_peered":"2024-09-22T03:49:26.056439+0000","last_clean":"2024-09-22T03:49:26.056439+0000","last_became_active":"2024-09-22T03:49:15.094890+0000","last_became_peered":"2024-09-22T03:49:15.094890+0000","last_unstale":"2024-09-22T03:49:26.056439+0000","last_undegraded":"2024-09-22T03:49:26.056439+0000","last_fullsized":"2024-09-22T03:49:26.056439+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"19'462","reported_seq":474,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:50:00.914663+0000","last_change":"2024-09-22T03:49:25.226551+0000","last_active":"2024-09-22T03:50:00.914663+0000","last_peered":"2024-09-22T03:50:00.914663+0000","last_clean":"2024-09-22T03:50:00.914663+0000","last_became_active":"2024-09-22T03:49:25.213989+0000","last_became_peered":"2024-09-22T03:49:25.213989+0000","last_unstale":"2024-09-22T03:50:00.914663+0000","last_undegraded":"2024-09-22T03:50:00.914663+0000","last_fullsized":"2024-09-22T03:50:00.914663+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30277632,"num_objects":462,"num_object_clones":0,"num_object_copies":1386,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":462,"num_write_kb":29568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":27,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:26.057565+0000","last_change":"2024-09-22T03:49:17.031466+0000","last_active":"2024-09-22T03:49:26.057565+0000","last_peered":"2024-09-22T03:49:26.057565+0000","last_clean":"2024-09-22T03:49:26.057565+0000","last_became_active":"2024-09-22T03:49:15.098420+0000","last_became_peered":"2024-09-22T03:49:15.098420+0000","last_unstale":"2024-09-22T03:49:26.057565+0000","last_undegraded":"2024-09-22T03:49:26.057565+0000","last_fullsized":"2024-09-22T03:49:26.057565+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"19'414","reported_seq":426,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:59.629930+0000","last_change":"2024-09-22T03:49:25.163198+0000","last_active":"2024-09-22T03:49:59.629930+0000","last_peered":"2024-09-22T03:49:59.629930+0000","last_clean":"2024-09-22T03:49:59.629930+0000","last_became_active":"2024-09-22T03:49:25.145723+0000","last_became_peered":"2024-09-22T03:49:25.145723+0000","last_unstale":"2024-09-22T03:49:59.629930+0000","last_undegraded":"2024-09-22T03:49:59.629930+0000","last_fullsized":"2024-09-22T03:49:59.629930+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27131904,"num_objects":414,"num_object_clones":0,"num_object_copies":1242,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":414,"num_write_kb":26496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"19'404","reported_seq":416,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:59.808156+0000","last_change":"2024-09-22T03:49:25.168751+0000","last_active":"2024-09-22T03:49:59.808156+0000","last_peered":"2024-09-22T03:49:59.808156+0000","last_clean":"2024-09-22T03:49:59.808156+0000","last_became_active":"2024-09-22T03:49:25.160072+0000","last_became_peered":"2024-09-22T03:49:25.160072+0000","last_unstale":"2024-09-22T03:49:59.808156+0000","last_undegraded":"2024-09-22T03:49:59.808156+0000","last_fullsized":"2024-09-22T03:49:59.808156+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26476544,"num_objects":404,"num_object_clones":0,"num_object_copies":1212,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":404,"num_write_kb":25856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":25,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:26.061328+0000","last_change":"2024-09-22T03:49:17.036954+0000","last_active":"2024-09-22T03:49:26.061328+0000","last_peered":"2024-09-22T03:49:26.061328+0000","last_clean":"2024-09-22T03:49:26.061328+0000","last_became_active":"2024-09-22T03:49:15.110506+0000","last_became_peered":"2024-09-22T03:49:15.110506+0000","last_unstale":"2024-09-22T03:49:26.061328+0000","last_undegraded":"2024-09-22T03:49:26.061328+0000","last_fullsized":"2024-09-22T03:49:26.061328+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"19'433","reported_seq":445,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:50:01.020975+0000","last_change":"2024-09-22T03:49:25.218967+0000","last_active":"2024-09-22T03:50:01.020975+0000","last_peered":"2024-09-22T03:50:01.020975+0000","last_clean":"2024-09-22T03:50:01.020975+0000","last_became_active":"2024-09-22T03:49:25.203726+0000","last_became_peered":"2024-09-22T03:49:25.203726+0000","last_unstale":"2024-09-22T03:50:01.020975+0000","last_undegraded":"2024-09-22T03:50:01.020975+0000","last_fullsized":"2024-09-22T03:50:01.020975+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28377088,"num_objects":433,"num_object_clones":0,"num_object_copies":1299,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":433,"num_write_kb":27712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":25,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:26.054492+0000","last_change":"2024-09-22T03:49:17.032989+0000","last_active":"2024-09-22T03:49:26.054492+0000","last_peered":"2024-09-22T03:49:26.054492+0000","last_clean":"2024-09-22T03:49:26.054492+0000","last_became_active":"2024-09-22T03:49:15.079260+0000","last_became_peered":"2024-09-22T03:49:15.079260+0000","last_unstale":"2024-09-22T03:49:26.054492+0000","last_undegraded":"2024-09-22T03:49:26.054492+0000","last_fullsized":"2024-09-22T03:49:26.054492+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"19'417","reported_seq":429,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:50:00.608273+0000","last_change":"2024-09-22T03:49:25.275215+0000","last_active":"2024-09-22T03:50:00.608273+0000","last_peered":"2024-09-22T03:50:00.608273+0000","last_clean":"2024-09-22T03:50:00.608273+0000","last_became_active":"2024-09-22T03:49:25.260843+0000","last_became_peered":"2024-09-22T03:49:25.260843+0000","last_unstale":"2024-09-22T03:50:00.608273+0000","last_undegraded":"2024-09-22T03:50:00.608273+0000","last_fullsized":"2024-09-22T03:50:00.608273+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27328512,"num_objects":417,"num_object_clones":0,"num_object_copies":1251,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":417,"num_write_kb":26688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":25,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:26.064309+0000","last_change":"2024-09-22T03:49:17.036402+0000","last_active":"2024-09-22T03:49:26.064309+0000","last_peered":"2024-09-22T03:49:26.064309+0000","last_clean":"2024-09-22T03:49:26.064309+0000","last_became_active":"2024-09-22T03:49:15.108430+0000","last_became_peered":"2024-09-22T03:49:15.108430+0000","last_unstale":"2024-09-22T03:49:26.064309+0000","last_undegraded":"2024-09-22T03:49:26.064309+0000","last_fullsized":"2024-09-22T03:49:26.064309+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"19'416","reported_seq":428,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:59.963703+0000","last_change":"2024-09-22T03:49:25.211493+0000","last_active":"2024-09-22T03:49:59.963703+0000","last_peered":"2024-09-22T03:49:59.963703+0000","last_clean":"2024-09-22T03:49:59.963703+0000","last_became_active":"2024-09-22T03:49:25.194855+0000","last_became_peered":"2024-09-22T03:49:25.194855+0000","last_unstale":"2024-09-22T03:49:59.963703+0000","last_undegraded":"2024-09-22T03:49:59.963703+0000","last_fullsized":"2024-09-22T03:49:59.963703+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":416,"num_object_clones":0,"num_object_copies":1248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":416,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":25,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:26.050967+0000","last_change":"2024-09-22T03:49:17.029128+0000","last_active":"2024-09-22T03:49:26.050967+0000","last_peered":"2024-09-22T03:49:26.050967+0000","last_clean":"2024-09-22T03:49:26.050967+0000","last_became_active":"2024-09-22T03:49:15.113396+0000","last_became_peered":"2024-09-22T03:49:15.113396+0000","last_unstale":"2024-09-22T03:49:26.050967+0000","last_undegraded":"2024-09-22T03:49:26.050967+0000","last_fullsized":"2024-09-22T03:49:26.050967+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":438632448,"num_objects":6693,"num_object_clones":0,"num_object_copies":20079,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6693,"num_write_kb":428352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":82161664,"data_stored":1314586624,"data_compressed":62420278,"data_compressed_allocated":82161664,"data_compressed_original":1314586624,"omap_allocated":0,"internal_metadata":0},"log_size":6693,"ondisk_log_size":6693,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949673009,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":52864,"kb_used_data":21872,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94318976,"statfs":{"total":96636764160,"available":96582631424,"internally_reserved":0,"allocated":22396928,"data_stored":355384209,"data_compressed":16874395,"data_compressed_allocated":22212608,"data_compressed_original":355319808,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654705713,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":46232,"kb_used_data":19400,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94325608,"statfs":{"total":96636764160,"available":96589422592,"internally_reserved":0,"allocated":19865600,"data_stored":315275633,"data_compressed":14967890,"data_compressed_allocated":19701760,"data_compressed_original":315228160,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705713,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":43252,"kb_used_data":16420,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94328588,"statfs":{"total":96636764160,"available":96592474112,"internally_reserved":0,"allocated":16814080,"data_stored":266058641,"data_compressed":12632932,"data_compressed_allocated":16629760,"data_compressed_original":265994240,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705713,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":52008,"kb_used_data":21016,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94319832,"statfs":{"total":96636764160,"available":96583507968,"internally_reserved":0,"allocated":21520384,"data_stored":341425022,"data_compressed":16211597,"data_compressed_allocated":21340160,"data_compressed_original":341360640,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":21962752,"data_stored":351404032,"data_compressed":16685685,"data_compressed_allocated":21962752,"data_compressed_original":351404032,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":22806528,"data_stored":364904448,"data_compressed":17326699,"data_compressed_allocated":22806528,"data_compressed_original":364904448,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":17088512,"data_stored":273416192,"data_compressed":12982540,"data_compressed_allocated":17088512,"data_compressed_original":273416192,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20303872,"data_stored":324861952,"data_compressed":15425354,"data_compressed_allocated":20303872,"data_compressed_original":324861952,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:50:03.944 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:50:04.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:50:04.131+0000 7f559fb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:50:04.140 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 38 16 7433 7417 12.1979 11.25 0.0967584 0.0818832 2024-09-22T03:50:04.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:50:04.141+0000 7f559fb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:50:05.140 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 39 16 7618 7602 12.1816 11.5625 0.0591487 0.0819495 2024-09-22T03:50:06.141 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:2024-09-22T03:50:06.140663+0000 min lat: 0.0165006 max lat: 0.193822 avg lat: 0.0820783 2024-09-22T03:50:06.141 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-22T03:50:06.141 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 40 16 7803 7787 12.1661 11.5625 0.116421 0.0820783 2024-09-22T03:50:06.559 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:50:06.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:50:06.714+0000 7fc5c7948640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:50:06.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:50:06.723+0000 7fc5c7948640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:50:07.140 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 41 16 7980 7964 12.1391 11.0625 0.125084 0.0822884 2024-09-22T03:50:08.141 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 42 16 8160 8144 12.1179 11.25 0.0597242 0.0824184 2024-09-22T03:50:08.641 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:50:08.641 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:50:08.641 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:50:08.641 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:50:08.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:50:08.814+0000 7f9b24afd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:50:08.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:50:08.828+0000 7f9b24afd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:50:08.945 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:50:08.945 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:50:08.945 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:50:08.945 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:50:08.945 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:50:08.945 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:50:08.945 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:50:08.945 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:50:08.945 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:50:08.946 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:50:08.946 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:50:08.946 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:50:08.949 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:50:08.950 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:50:08.950 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:50:09.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:50:09.127+0000 7fd984751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:50:09.140 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:50:09.141 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 43 16 8347 8331 12.1079 11.6875 0.0830146 0.0824787 2024-09-22T03:50:09.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:50:09.142+0000 7fd984751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:50:09.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:50:09.309+0000 7f2c32f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:50:09.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:50:09.322+0000 7f2c32f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:50:09.340 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:50:09.340 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:50:09.340 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:50:09.340 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:50:09.340 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:50:09.340 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:50:09.340 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:50:09.340 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:50:09.340 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:50:09.340 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:50:09.341 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:50:09.341 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:50:09.345 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:50:09.346 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:50:09.346 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:50:09.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:50:09.550+0000 7f1f1dc46640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:50:09.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:50:09.562+0000 7f1f1dc46640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:50:09.592 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:50:09.592 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:50:09.592 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:50:09.592 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:50:09.592 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:50:09.593 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:50:09.593 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:50:09.593 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:50:09.593 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:50:09.593 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:50:09.593 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:50:09.593 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:50:09.596 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:50:09.596 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:50:09.596 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:50:09.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:50:09.745+0000 7f5b64151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:50:09.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:50:09.766+0000 7f5b64151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:50:09.805 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:50:09.805 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:50:09.805 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:50:09.805 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:50:09.805 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:50:09.805 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:50:09.805 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:50:09.805 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:50:09.805 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:50:09.805 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:50:09.806 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:50:09.806 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:50:09.809 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:50:09.809 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:50:10.141 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 44 16 8503 8487 12.0543 9.75 0.0937831 0.0828721 2024-09-22T03:50:11.141 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 45 16 8691 8675 12.0475 11.75 0.117338 0.082901 2024-09-22T03:50:11.793 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:50:11.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:50:11.956+0000 7fd39f791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:50:11.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:50:11.965+0000 7fd39f791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:50:12.141 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 46 16 8872 8856 12.0315 11.3125 0.045287 0.0830032 2024-09-22T03:50:13.141 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 47 16 9053 9037 12.0162 11.3125 0.0835001 0.0830982 2024-09-22T03:50:14.141 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 48 16 9235 9219 12.0028 11.375 0.152741 0.0831885 2024-09-22T03:50:14.431 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:50:14.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:50:14.581+0000 7f031e991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:50:14.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:50:14.590+0000 7f031e991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:50:14.810 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:50:14.811 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:50:14.811 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:50:14.811 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:50:14.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:50:14.970+0000 7f029fd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:50:14.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:50:14.986+0000 7f029fd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:50:15.141 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 49 16 9409 9393 11.9798 10.875 0.0854968 0.0834016 2024-09-22T03:50:15.204 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:50:15.204 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:50:15.204 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:50:15.205 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:50:15.205 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:50:15.205 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:50:15.205 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:50:15.205 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:50:15.205 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:50:15.205 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:50:15.205 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:50:15.205 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:50:15.208 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:50:15.208 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:50:15.208 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:50:15.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:50:15.398+0000 7fa314948640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:50:15.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:50:15.414+0000 7fa314948640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:50:15.565 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:50:15.565 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:50:15.565 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:50:15.565 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:50:15.565 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:50:15.565 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:50:15.565 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:50:15.566 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:50:15.566 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:50:15.566 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:50:15.566 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:50:15.566 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:50:15.570 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:50:15.570 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:50:15.570 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:50:15.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:50:15.728+0000 7f6ed76d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:50:15.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:50:15.746+0000 7f6ed76d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:50:15.774 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:50:15.774 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:50:15.774 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:50:15.774 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:50:15.774 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:50:15.774 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:50:15.774 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:50:15.775 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:50:15.775 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:50:15.775 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:50:15.775 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:50:15.775 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:50:15.779 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:50:15.780 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:50:15.780 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:50:15.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:50:15.955+0000 7f3ae2863640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:50:15.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:50:15.973+0000 7f3ae2863640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:50:16.028 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:50:16.029 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:50:16.029 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:50:16.029 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:50:16.029 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:50:16.029 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:50:16.029 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:50:16.029 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:50:16.029 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:50:16.029 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:50:16.029 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:50:16.029 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:50:16.033 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:50:16.033 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:50:16.141 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 50 16 9583 9567 11.9577 10.875 0.0823486 0.0835465 2024-09-22T03:50:16.953 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:50:17.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:50:17.125+0000 7fc6ceb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:50:17.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:50:17.136+0000 7fc6ceb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:50:17.141 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 51 16 9779 9763 11.9634 12.25 0.123344 0.0834955 2024-09-22T03:50:18.142 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 52 16 9963 9947 11.9544 11.5 0.0704422 0.0835589 2024-09-22T03:50:19.142 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 53 16 10159 10143 11.96 12.25 0.0873711 0.0835282 2024-09-22T03:50:19.489 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:50:19.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:50:19.644+0000 7f9fb8791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:50:19.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:50:19.653+0000 7f9fb8791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:50:20.142 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 54 16 10332 10316 11.9387 10.8125 0.0709919 0.083659 2024-09-22T03:50:21.034 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:50:21.034 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-22T03:50:21.142 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 55 16 10517 10501 11.9319 11.5625 0.124141 0.0837001 2024-09-22T03:50:21.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:50:21.203+0000 7f2550551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:50:21.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:50:21.226+0000 7f2550551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:50:21.675 INFO:teuthology.orchestra.run.smithi037.stderr:reweighted osd.0 to 1 (10000) 2024-09-22T03:50:21.696 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-22T03:50:21.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:50:21.851+0000 7f15c4b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:50:21.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:50:21.874+0000 7f15c4b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:50:22.127 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:50:22.142 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 56 16 10680 10664 11.9007 10.1875 0.0850048 0.0839581 2024-09-22T03:50:22.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:50:22.272+0000 7f91cd0d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:50:22.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:50:22.282+0000 7f91cd0d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:50:22.675 INFO:teuthology.orchestra.run.smithi037.stderr:reweighted osd.1 to 1 (10000) 2024-09-22T03:50:22.699 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-22T03:50:22.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:50:22.865+0000 7fdacd8ec640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:50:22.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:50:22.883+0000 7fdacd8ec640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:50:23.142 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 57 16 10835 10819 11.8618 9.6875 0.166909 0.0841984 2024-09-22T03:50:23.682 INFO:teuthology.orchestra.run.smithi037.stderr:reweighted osd.2 to 1 (10000) 2024-09-22T03:50:23.702 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-22T03:50:23.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:50:23.859+0000 7f2a17191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:50:23.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:50:23.879+0000 7f2a17191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:50:24.142 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 58 16 11002 10986 11.8373 10.4375 0.16797 0.0843725 2024-09-22T03:50:24.630 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:50:24.688 INFO:teuthology.orchestra.run.smithi037.stderr:reweighted osd.3 to 1 (10000) 2024-09-22T03:50:24.716 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-22T03:50:24.716 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:50:24.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:50:24.792+0000 7fe2cd246640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:50:24.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:50:24.804+0000 7fe2cd246640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:50:24.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:50:24.902+0000 7f30a8951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:50:24.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:50:24.917+0000 7f30a8951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:50:25.142 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 59 16 11168 11152 11.8125 10.375 0.0968542 0.0845573 2024-09-22T03:50:25.239 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:50:25.239 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-22T03:50:25.258 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":54,"stamp":"2024-09-22T03:50:24.977952+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":679936563,"num_objects":10370,"num_object_clones":0,"num_object_copies":31110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":10447,"num_write_kb":664532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10421,"ondisk_log_size":10421,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":267936,"kb_used_data":123168,"kb_used_omap":0,"kb_used_meta":144704,"kb_avail":377219424,"statfs":{"total":386547056640,"available":386272690176,"internally_reserved":0,"allocated":126124032,"data_stored":2006576145,"data_compressed":95276694,"data_compressed_allocated":125411328,"data_compressed_original":2006335488,"omap_allocated":0,"internal_metadata":148176896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19857408,"num_objects":303,"num_object_clones":0,"num_object_copies":909,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":303,"num_write_kb":19392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000889"},"pg_stats":[{"pgid":"3.f","version":"19'639","reported_seq":651,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:50:19.960939+0000","last_change":"2024-09-22T03:49:25.167073+0000","last_active":"2024-09-22T03:50:19.960939+0000","last_peered":"2024-09-22T03:50:19.960939+0000","last_clean":"2024-09-22T03:50:19.960939+0000","last_became_active":"2024-09-22T03:49:25.159818+0000","last_became_peered":"2024-09-22T03:49:25.159818+0000","last_unstale":"2024-09-22T03:50:19.960939+0000","last_undegraded":"2024-09-22T03:50:19.960939+0000","last_fullsized":"2024-09-22T03:50:19.960939+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":639,"log_dups_size":0,"ondisk_log_size":639,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41877504,"num_objects":639,"num_object_clones":0,"num_object_copies":1917,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":639,"num_write_kb":40896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"19'665","reported_seq":677,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:50:20.908201+0000","last_change":"2024-09-22T03:49:25.238720+0000","last_active":"2024-09-22T03:50:20.908201+0000","last_peered":"2024-09-22T03:50:20.908201+0000","last_clean":"2024-09-22T03:50:20.908201+0000","last_became_active":"2024-09-22T03:49:25.229005+0000","last_became_peered":"2024-09-22T03:49:25.229005+0000","last_unstale":"2024-09-22T03:50:20.908201+0000","last_undegraded":"2024-09-22T03:50:20.908201+0000","last_fullsized":"2024-09-22T03:50:20.908201+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":665,"log_dups_size":0,"ondisk_log_size":665,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43581440,"num_objects":665,"num_object_clones":0,"num_object_copies":1995,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":665,"num_write_kb":42560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"19'655","reported_seq":667,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:50:19.906520+0000","last_change":"2024-09-22T03:49:25.173605+0000","last_active":"2024-09-22T03:50:19.906520+0000","last_peered":"2024-09-22T03:50:19.906520+0000","last_clean":"2024-09-22T03:50:19.906520+0000","last_became_active":"2024-09-22T03:49:25.165491+0000","last_became_peered":"2024-09-22T03:49:25.165491+0000","last_unstale":"2024-09-22T03:50:19.906520+0000","last_undegraded":"2024-09-22T03:50:19.906520+0000","last_fullsized":"2024-09-22T03:50:19.906520+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":655,"log_dups_size":0,"ondisk_log_size":655,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42926080,"num_objects":655,"num_object_clones":0,"num_object_copies":1965,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":655,"num_write_kb":41920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"19'619","reported_seq":631,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:50:19.931269+0000","last_change":"2024-09-22T03:49:25.207920+0000","last_active":"2024-09-22T03:50:19.931269+0000","last_peered":"2024-09-22T03:50:19.931269+0000","last_clean":"2024-09-22T03:50:19.931269+0000","last_became_active":"2024-09-22T03:49:25.198168+0000","last_became_peered":"2024-09-22T03:49:25.198168+0000","last_unstale":"2024-09-22T03:50:19.931269+0000","last_undegraded":"2024-09-22T03:50:19.931269+0000","last_fullsized":"2024-09-22T03:50:19.931269+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":619,"log_dups_size":0,"ondisk_log_size":619,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40566784,"num_objects":619,"num_object_clones":0,"num_object_copies":1857,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":619,"num_write_kb":39616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"19'670","reported_seq":682,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:50:20.971645+0000","last_change":"2024-09-22T03:49:25.280543+0000","last_active":"2024-09-22T03:50:20.971645+0000","last_peered":"2024-09-22T03:50:20.971645+0000","last_clean":"2024-09-22T03:50:20.971645+0000","last_became_active":"2024-09-22T03:49:25.268731+0000","last_became_peered":"2024-09-22T03:49:25.268731+0000","last_unstale":"2024-09-22T03:50:20.971645+0000","last_undegraded":"2024-09-22T03:50:20.971645+0000","last_fullsized":"2024-09-22T03:50:20.971645+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":670,"log_dups_size":0,"ondisk_log_size":670,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43909120,"num_objects":670,"num_object_clones":0,"num_object_copies":2010,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":670,"num_write_kb":42880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"19'630","reported_seq":642,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:50:19.951910+0000","last_change":"2024-09-22T03:49:25.206225+0000","last_active":"2024-09-22T03:50:19.951910+0000","last_peered":"2024-09-22T03:50:19.951910+0000","last_clean":"2024-09-22T03:50:19.951910+0000","last_became_active":"2024-09-22T03:49:25.201227+0000","last_became_peered":"2024-09-22T03:49:25.201227+0000","last_unstale":"2024-09-22T03:50:19.951910+0000","last_undegraded":"2024-09-22T03:50:19.951910+0000","last_fullsized":"2024-09-22T03:50:19.951910+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":630,"log_dups_size":0,"ondisk_log_size":630,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41287680,"num_objects":630,"num_object_clones":0,"num_object_copies":1890,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":630,"num_write_kb":40320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"19'666","reported_seq":678,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:50:19.813014+0000","last_change":"2024-09-22T03:49:25.212585+0000","last_active":"2024-09-22T03:50:19.813014+0000","last_peered":"2024-09-22T03:50:19.813014+0000","last_clean":"2024-09-22T03:50:19.813014+0000","last_became_active":"2024-09-22T03:49:25.203356+0000","last_became_peered":"2024-09-22T03:49:25.203356+0000","last_unstale":"2024-09-22T03:50:19.813014+0000","last_undegraded":"2024-09-22T03:50:19.813014+0000","last_fullsized":"2024-09-22T03:50:19.813014+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":666,"log_dups_size":0,"ondisk_log_size":666,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43646976,"num_objects":666,"num_object_clones":0,"num_object_copies":1998,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":666,"num_write_kb":42624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"19'640","reported_seq":652,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:50:19.700500+0000","last_change":"2024-09-22T03:49:25.177465+0000","last_active":"2024-09-22T03:50:19.700500+0000","last_peered":"2024-09-22T03:50:19.700500+0000","last_clean":"2024-09-22T03:50:19.700500+0000","last_became_active":"2024-09-22T03:49:25.170026+0000","last_became_peered":"2024-09-22T03:49:25.170026+0000","last_unstale":"2024-09-22T03:50:19.700500+0000","last_undegraded":"2024-09-22T03:50:19.700500+0000","last_fullsized":"2024-09-22T03:50:19.700500+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":640,"log_dups_size":0,"ondisk_log_size":640,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":640,"num_object_clones":0,"num_object_copies":1920,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":640,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":100,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:26.053552+0000","last_change":"2024-09-22T03:49:12.034704+0000","last_active":"2024-09-22T03:49:26.053552+0000","last_peered":"2024-09-22T03:49:26.053552+0000","last_clean":"2024-09-22T03:49:26.053552+0000","last_became_active":"2024-09-22T03:49:12.027470+0000","last_became_peered":"2024-09-22T03:49:12.027470+0000","last_unstale":"2024-09-22T03:49:26.053552+0000","last_undegraded":"2024-09-22T03:49:26.053552+0000","last_fullsized":"2024-09-22T03:49:26.053552+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_clean_scrub_stamp":"2024-09-22T03:49:10.979949+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":26,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:26.060600+0000","last_change":"2024-09-22T03:49:17.031458+0000","last_active":"2024-09-22T03:49:26.060600+0000","last_peered":"2024-09-22T03:49:26.060600+0000","last_clean":"2024-09-22T03:49:26.060600+0000","last_became_active":"2024-09-22T03:49:15.125490+0000","last_became_peered":"2024-09-22T03:49:15.125490+0000","last_unstale":"2024-09-22T03:49:26.060600+0000","last_undegraded":"2024-09-22T03:49:26.060600+0000","last_fullsized":"2024-09-22T03:49:26.060600+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"19'612","reported_seq":624,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:50:19.756989+0000","last_change":"2024-09-22T03:49:25.226827+0000","last_active":"2024-09-22T03:50:19.756989+0000","last_peered":"2024-09-22T03:50:19.756989+0000","last_clean":"2024-09-22T03:50:19.756989+0000","last_became_active":"2024-09-22T03:49:25.218579+0000","last_became_peered":"2024-09-22T03:49:25.218579+0000","last_unstale":"2024-09-22T03:50:19.756989+0000","last_undegraded":"2024-09-22T03:50:19.756989+0000","last_fullsized":"2024-09-22T03:50:19.756989+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":612,"log_dups_size":0,"ondisk_log_size":612,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40108032,"num_objects":612,"num_object_clones":0,"num_object_copies":1836,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":612,"num_write_kb":39168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":25,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:26.053667+0000","last_change":"2024-09-22T03:49:17.029339+0000","last_active":"2024-09-22T03:49:26.053667+0000","last_peered":"2024-09-22T03:49:26.053667+0000","last_clean":"2024-09-22T03:49:26.053667+0000","last_became_active":"2024-09-22T03:49:15.097304+0000","last_became_peered":"2024-09-22T03:49:15.097304+0000","last_unstale":"2024-09-22T03:49:26.053667+0000","last_undegraded":"2024-09-22T03:49:26.053667+0000","last_fullsized":"2024-09-22T03:49:26.053667+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"19'639","reported_seq":651,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:50:19.832591+0000","last_change":"2024-09-22T03:49:25.208298+0000","last_active":"2024-09-22T03:50:19.832591+0000","last_peered":"2024-09-22T03:50:19.832591+0000","last_clean":"2024-09-22T03:50:19.832591+0000","last_became_active":"2024-09-22T03:49:25.193750+0000","last_became_peered":"2024-09-22T03:49:25.193750+0000","last_unstale":"2024-09-22T03:50:19.832591+0000","last_undegraded":"2024-09-22T03:50:19.832591+0000","last_fullsized":"2024-09-22T03:50:19.832591+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":639,"log_dups_size":0,"ondisk_log_size":639,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41877504,"num_objects":639,"num_object_clones":0,"num_object_copies":1917,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":639,"num_write_kb":40896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":25,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:26.056439+0000","last_change":"2024-09-22T03:49:17.029349+0000","last_active":"2024-09-22T03:49:26.056439+0000","last_peered":"2024-09-22T03:49:26.056439+0000","last_clean":"2024-09-22T03:49:26.056439+0000","last_became_active":"2024-09-22T03:49:15.094890+0000","last_became_peered":"2024-09-22T03:49:15.094890+0000","last_unstale":"2024-09-22T03:49:26.056439+0000","last_undegraded":"2024-09-22T03:49:26.056439+0000","last_fullsized":"2024-09-22T03:49:26.056439+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"19'708","reported_seq":720,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:50:20.918241+0000","last_change":"2024-09-22T03:49:25.226551+0000","last_active":"2024-09-22T03:50:20.918241+0000","last_peered":"2024-09-22T03:50:20.918241+0000","last_clean":"2024-09-22T03:50:20.918241+0000","last_became_active":"2024-09-22T03:49:25.213989+0000","last_became_peered":"2024-09-22T03:49:25.213989+0000","last_unstale":"2024-09-22T03:50:20.918241+0000","last_undegraded":"2024-09-22T03:50:20.918241+0000","last_fullsized":"2024-09-22T03:50:20.918241+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":708,"log_dups_size":0,"ondisk_log_size":708,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46399488,"num_objects":708,"num_object_clones":0,"num_object_copies":2124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":708,"num_write_kb":45312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":27,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:26.057565+0000","last_change":"2024-09-22T03:49:17.031466+0000","last_active":"2024-09-22T03:49:26.057565+0000","last_peered":"2024-09-22T03:49:26.057565+0000","last_clean":"2024-09-22T03:49:26.057565+0000","last_became_active":"2024-09-22T03:49:15.098420+0000","last_became_peered":"2024-09-22T03:49:15.098420+0000","last_unstale":"2024-09-22T03:49:26.057565+0000","last_undegraded":"2024-09-22T03:49:26.057565+0000","last_fullsized":"2024-09-22T03:49:26.057565+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"19'634","reported_seq":646,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:50:19.998823+0000","last_change":"2024-09-22T03:49:25.163198+0000","last_active":"2024-09-22T03:50:19.998823+0000","last_peered":"2024-09-22T03:50:19.998823+0000","last_clean":"2024-09-22T03:50:19.998823+0000","last_became_active":"2024-09-22T03:49:25.145723+0000","last_became_peered":"2024-09-22T03:49:25.145723+0000","last_unstale":"2024-09-22T03:50:19.998823+0000","last_undegraded":"2024-09-22T03:50:19.998823+0000","last_fullsized":"2024-09-22T03:50:19.998823+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":634,"log_dups_size":0,"ondisk_log_size":634,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41549824,"num_objects":634,"num_object_clones":0,"num_object_copies":1902,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":634,"num_write_kb":40576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"19'647","reported_seq":659,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:50:19.936370+0000","last_change":"2024-09-22T03:49:25.168751+0000","last_active":"2024-09-22T03:50:19.936370+0000","last_peered":"2024-09-22T03:50:19.936370+0000","last_clean":"2024-09-22T03:50:19.936370+0000","last_became_active":"2024-09-22T03:49:25.160072+0000","last_became_peered":"2024-09-22T03:49:25.160072+0000","last_unstale":"2024-09-22T03:50:19.936370+0000","last_undegraded":"2024-09-22T03:50:19.936370+0000","last_fullsized":"2024-09-22T03:50:19.936370+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":647,"log_dups_size":0,"ondisk_log_size":647,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42401792,"num_objects":647,"num_object_clones":0,"num_object_copies":1941,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":647,"num_write_kb":41408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":25,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:26.061328+0000","last_change":"2024-09-22T03:49:17.036954+0000","last_active":"2024-09-22T03:49:26.061328+0000","last_peered":"2024-09-22T03:49:26.061328+0000","last_clean":"2024-09-22T03:49:26.061328+0000","last_became_active":"2024-09-22T03:49:15.110506+0000","last_became_peered":"2024-09-22T03:49:15.110506+0000","last_unstale":"2024-09-22T03:49:26.061328+0000","last_undegraded":"2024-09-22T03:49:26.061328+0000","last_fullsized":"2024-09-22T03:49:26.061328+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"19'654","reported_seq":666,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:50:20.980930+0000","last_change":"2024-09-22T03:49:25.218967+0000","last_active":"2024-09-22T03:50:20.980930+0000","last_peered":"2024-09-22T03:50:20.980930+0000","last_clean":"2024-09-22T03:50:20.980930+0000","last_became_active":"2024-09-22T03:49:25.203726+0000","last_became_peered":"2024-09-22T03:49:25.203726+0000","last_unstale":"2024-09-22T03:50:20.980930+0000","last_undegraded":"2024-09-22T03:50:20.980930+0000","last_fullsized":"2024-09-22T03:50:20.980930+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":654,"log_dups_size":0,"ondisk_log_size":654,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42860544,"num_objects":654,"num_object_clones":0,"num_object_copies":1962,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":654,"num_write_kb":41856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":25,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:26.054492+0000","last_change":"2024-09-22T03:49:17.032989+0000","last_active":"2024-09-22T03:49:26.054492+0000","last_peered":"2024-09-22T03:49:26.054492+0000","last_clean":"2024-09-22T03:49:26.054492+0000","last_became_active":"2024-09-22T03:49:15.079260+0000","last_became_peered":"2024-09-22T03:49:15.079260+0000","last_unstale":"2024-09-22T03:49:26.054492+0000","last_undegraded":"2024-09-22T03:49:26.054492+0000","last_fullsized":"2024-09-22T03:49:26.054492+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"19'635","reported_seq":647,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:50:20.920960+0000","last_change":"2024-09-22T03:49:25.275215+0000","last_active":"2024-09-22T03:50:20.920960+0000","last_peered":"2024-09-22T03:50:20.920960+0000","last_clean":"2024-09-22T03:50:20.920960+0000","last_became_active":"2024-09-22T03:49:25.260843+0000","last_became_peered":"2024-09-22T03:49:25.260843+0000","last_unstale":"2024-09-22T03:50:20.920960+0000","last_undegraded":"2024-09-22T03:50:20.920960+0000","last_fullsized":"2024-09-22T03:50:20.920960+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":635,"log_dups_size":0,"ondisk_log_size":635,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41615360,"num_objects":635,"num_object_clones":0,"num_object_copies":1905,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":635,"num_write_kb":40640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":25,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:26.064309+0000","last_change":"2024-09-22T03:49:17.036402+0000","last_active":"2024-09-22T03:49:26.064309+0000","last_peered":"2024-09-22T03:49:26.064309+0000","last_clean":"2024-09-22T03:49:26.064309+0000","last_became_active":"2024-09-22T03:49:15.108430+0000","last_became_peered":"2024-09-22T03:49:15.108430+0000","last_unstale":"2024-09-22T03:49:26.064309+0000","last_undegraded":"2024-09-22T03:49:26.064309+0000","last_fullsized":"2024-09-22T03:49:26.064309+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"19'653","reported_seq":665,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:50:19.777143+0000","last_change":"2024-09-22T03:49:25.211493+0000","last_active":"2024-09-22T03:50:19.777143+0000","last_peered":"2024-09-22T03:50:19.777143+0000","last_clean":"2024-09-22T03:50:19.777143+0000","last_became_active":"2024-09-22T03:49:25.194855+0000","last_became_peered":"2024-09-22T03:49:25.194855+0000","last_unstale":"2024-09-22T03:50:19.777143+0000","last_undegraded":"2024-09-22T03:50:19.777143+0000","last_fullsized":"2024-09-22T03:50:19.777143+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":653,"log_dups_size":0,"ondisk_log_size":653,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42795008,"num_objects":653,"num_object_clones":0,"num_object_copies":1959,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":653,"num_write_kb":41792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":25,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:26.050967+0000","last_change":"2024-09-22T03:49:17.029128+0000","last_active":"2024-09-22T03:49:26.050967+0000","last_peered":"2024-09-22T03:49:26.050967+0000","last_clean":"2024-09-22T03:49:26.050967+0000","last_became_active":"2024-09-22T03:49:15.113396+0000","last_became_peered":"2024-09-22T03:49:15.113396+0000","last_unstale":"2024-09-22T03:49:26.050967+0000","last_undegraded":"2024-09-22T03:49:26.050967+0000","last_fullsized":"2024-09-22T03:49:26.050967+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":679346176,"num_objects":10366,"num_object_clones":0,"num_object_copies":31098,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10366,"num_write_kb":663424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":127324160,"data_stored":2037186560,"data_compressed":96733190,"data_compressed_allocated":127324160,"data_compressed_original":2037186560,"omap_allocated":0,"internal_metadata":0},"log_size":10366,"ondisk_log_size":10366,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949673029,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":60656,"kb_used_data":33824,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94311184,"statfs":{"total":96636764160,"available":96574652416,"internally_reserved":0,"allocated":34635776,"data_stored":551205777,"data_compressed":26173051,"data_compressed_allocated":34451456,"data_compressed_original":551141376,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654705733,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":69676,"kb_used_data":30364,"kb_used_omap":0,"kb_used_meta":39296,"kb_avail":94302164,"statfs":{"total":96636764160,"available":96565415936,"internally_reserved":0,"allocated":31092736,"data_stored":494909809,"data_compressed":23497882,"data_compressed_allocated":30928896,"data_compressed_original":494862336,"omap_allocated":0,"internal_metadata":40239104},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705733,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":60828,"kb_used_data":25676,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94311012,"statfs":{"total":96636764160,"available":96574476288,"internally_reserved":0,"allocated":26292224,"data_stored":417708945,"data_compressed":19834100,"data_compressed_allocated":26107904,"data_compressed_original":417644544,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705733,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":76776,"kb_used_data":33304,"kb_used_omap":0,"kb_used_meta":43456,"kb_avail":94295064,"statfs":{"total":96636764160,"available":96558145536,"internally_reserved":0,"allocated":34103296,"data_stored":542751614,"data_compressed":25771661,"data_compressed_allocated":33923072,"data_compressed_original":542687232,"omap_allocated":0,"internal_metadata":44498944},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":34410496,"data_stored":550567936,"data_compressed":26143053,"data_compressed_allocated":34410496,"data_compressed_original":550567936,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":34992128,"data_stored":559874048,"data_compressed":26584899,"data_compressed_allocated":34992128,"data_compressed_original":559874048,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":26509312,"data_stored":424148992,"data_compressed":20140140,"data_compressed_allocated":26509312,"data_compressed_original":424148992,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":31412224,"data_stored":502595584,"data_compressed":23865098,"data_compressed_allocated":31412224,"data_compressed_original":502595584,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:50:25.259 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:50:25.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:50:25.400+0000 7f9b492a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:50:25.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:50:25.417+0000 7f9b492a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:50:25.793 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:50:25.793 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-22T03:50:25.815 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":54,"stamp":"2024-09-22T03:50:24.977952+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":679936563,"num_objects":10370,"num_object_clones":0,"num_object_copies":31110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":10447,"num_write_kb":664532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10421,"ondisk_log_size":10421,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":267936,"kb_used_data":123168,"kb_used_omap":0,"kb_used_meta":144704,"kb_avail":377219424,"statfs":{"total":386547056640,"available":386272690176,"internally_reserved":0,"allocated":126124032,"data_stored":2006576145,"data_compressed":95276694,"data_compressed_allocated":125411328,"data_compressed_original":2006335488,"omap_allocated":0,"internal_metadata":148176896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19857408,"num_objects":303,"num_object_clones":0,"num_object_copies":909,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":303,"num_write_kb":19392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000889"},"pg_stats":[{"pgid":"3.f","version":"19'639","reported_seq":651,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:50:19.960939+0000","last_change":"2024-09-22T03:49:25.167073+0000","last_active":"2024-09-22T03:50:19.960939+0000","last_peered":"2024-09-22T03:50:19.960939+0000","last_clean":"2024-09-22T03:50:19.960939+0000","last_became_active":"2024-09-22T03:49:25.159818+0000","last_became_peered":"2024-09-22T03:49:25.159818+0000","last_unstale":"2024-09-22T03:50:19.960939+0000","last_undegraded":"2024-09-22T03:50:19.960939+0000","last_fullsized":"2024-09-22T03:50:19.960939+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":639,"log_dups_size":0,"ondisk_log_size":639,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41877504,"num_objects":639,"num_object_clones":0,"num_object_copies":1917,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":639,"num_write_kb":40896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"19'665","reported_seq":677,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:50:20.908201+0000","last_change":"2024-09-22T03:49:25.238720+0000","last_active":"2024-09-22T03:50:20.908201+0000","last_peered":"2024-09-22T03:50:20.908201+0000","last_clean":"2024-09-22T03:50:20.908201+0000","last_became_active":"2024-09-22T03:49:25.229005+0000","last_became_peered":"2024-09-22T03:49:25.229005+0000","last_unstale":"2024-09-22T03:50:20.908201+0000","last_undegraded":"2024-09-22T03:50:20.908201+0000","last_fullsized":"2024-09-22T03:50:20.908201+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":665,"log_dups_size":0,"ondisk_log_size":665,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43581440,"num_objects":665,"num_object_clones":0,"num_object_copies":1995,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":665,"num_write_kb":42560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"19'655","reported_seq":667,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:50:19.906520+0000","last_change":"2024-09-22T03:49:25.173605+0000","last_active":"2024-09-22T03:50:19.906520+0000","last_peered":"2024-09-22T03:50:19.906520+0000","last_clean":"2024-09-22T03:50:19.906520+0000","last_became_active":"2024-09-22T03:49:25.165491+0000","last_became_peered":"2024-09-22T03:49:25.165491+0000","last_unstale":"2024-09-22T03:50:19.906520+0000","last_undegraded":"2024-09-22T03:50:19.906520+0000","last_fullsized":"2024-09-22T03:50:19.906520+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":655,"log_dups_size":0,"ondisk_log_size":655,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42926080,"num_objects":655,"num_object_clones":0,"num_object_copies":1965,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":655,"num_write_kb":41920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"19'619","reported_seq":631,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:50:19.931269+0000","last_change":"2024-09-22T03:49:25.207920+0000","last_active":"2024-09-22T03:50:19.931269+0000","last_peered":"2024-09-22T03:50:19.931269+0000","last_clean":"2024-09-22T03:50:19.931269+0000","last_became_active":"2024-09-22T03:49:25.198168+0000","last_became_peered":"2024-09-22T03:49:25.198168+0000","last_unstale":"2024-09-22T03:50:19.931269+0000","last_undegraded":"2024-09-22T03:50:19.931269+0000","last_fullsized":"2024-09-22T03:50:19.931269+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":619,"log_dups_size":0,"ondisk_log_size":619,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40566784,"num_objects":619,"num_object_clones":0,"num_object_copies":1857,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":619,"num_write_kb":39616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"19'670","reported_seq":682,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:50:20.971645+0000","last_change":"2024-09-22T03:49:25.280543+0000","last_active":"2024-09-22T03:50:20.971645+0000","last_peered":"2024-09-22T03:50:20.971645+0000","last_clean":"2024-09-22T03:50:20.971645+0000","last_became_active":"2024-09-22T03:49:25.268731+0000","last_became_peered":"2024-09-22T03:49:25.268731+0000","last_unstale":"2024-09-22T03:50:20.971645+0000","last_undegraded":"2024-09-22T03:50:20.971645+0000","last_fullsized":"2024-09-22T03:50:20.971645+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":670,"log_dups_size":0,"ondisk_log_size":670,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43909120,"num_objects":670,"num_object_clones":0,"num_object_copies":2010,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":670,"num_write_kb":42880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"19'630","reported_seq":642,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:50:19.951910+0000","last_change":"2024-09-22T03:49:25.206225+0000","last_active":"2024-09-22T03:50:19.951910+0000","last_peered":"2024-09-22T03:50:19.951910+0000","last_clean":"2024-09-22T03:50:19.951910+0000","last_became_active":"2024-09-22T03:49:25.201227+0000","last_became_peered":"2024-09-22T03:49:25.201227+0000","last_unstale":"2024-09-22T03:50:19.951910+0000","last_undegraded":"2024-09-22T03:50:19.951910+0000","last_fullsized":"2024-09-22T03:50:19.951910+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":630,"log_dups_size":0,"ondisk_log_size":630,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41287680,"num_objects":630,"num_object_clones":0,"num_object_copies":1890,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":630,"num_write_kb":40320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"19'666","reported_seq":678,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:50:19.813014+0000","last_change":"2024-09-22T03:49:25.212585+0000","last_active":"2024-09-22T03:50:19.813014+0000","last_peered":"2024-09-22T03:50:19.813014+0000","last_clean":"2024-09-22T03:50:19.813014+0000","last_became_active":"2024-09-22T03:49:25.203356+0000","last_became_peered":"2024-09-22T03:49:25.203356+0000","last_unstale":"2024-09-22T03:50:19.813014+0000","last_undegraded":"2024-09-22T03:50:19.813014+0000","last_fullsized":"2024-09-22T03:50:19.813014+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":666,"log_dups_size":0,"ondisk_log_size":666,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43646976,"num_objects":666,"num_object_clones":0,"num_object_copies":1998,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":666,"num_write_kb":42624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"19'640","reported_seq":652,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:50:19.700500+0000","last_change":"2024-09-22T03:49:25.177465+0000","last_active":"2024-09-22T03:50:19.700500+0000","last_peered":"2024-09-22T03:50:19.700500+0000","last_clean":"2024-09-22T03:50:19.700500+0000","last_became_active":"2024-09-22T03:49:25.170026+0000","last_became_peered":"2024-09-22T03:49:25.170026+0000","last_unstale":"2024-09-22T03:50:19.700500+0000","last_undegraded":"2024-09-22T03:50:19.700500+0000","last_fullsized":"2024-09-22T03:50:19.700500+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":640,"log_dups_size":0,"ondisk_log_size":640,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":640,"num_object_clones":0,"num_object_copies":1920,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":640,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":100,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:26.053552+0000","last_change":"2024-09-22T03:49:12.034704+0000","last_active":"2024-09-22T03:49:26.053552+0000","last_peered":"2024-09-22T03:49:26.053552+0000","last_clean":"2024-09-22T03:49:26.053552+0000","last_became_active":"2024-09-22T03:49:12.027470+0000","last_became_peered":"2024-09-22T03:49:12.027470+0000","last_unstale":"2024-09-22T03:49:26.053552+0000","last_undegraded":"2024-09-22T03:49:26.053552+0000","last_fullsized":"2024-09-22T03:49:26.053552+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_clean_scrub_stamp":"2024-09-22T03:49:10.979949+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":26,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:26.060600+0000","last_change":"2024-09-22T03:49:17.031458+0000","last_active":"2024-09-22T03:49:26.060600+0000","last_peered":"2024-09-22T03:49:26.060600+0000","last_clean":"2024-09-22T03:49:26.060600+0000","last_became_active":"2024-09-22T03:49:15.125490+0000","last_became_peered":"2024-09-22T03:49:15.125490+0000","last_unstale":"2024-09-22T03:49:26.060600+0000","last_undegraded":"2024-09-22T03:49:26.060600+0000","last_fullsized":"2024-09-22T03:49:26.060600+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"19'612","reported_seq":624,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:50:19.756989+0000","last_change":"2024-09-22T03:49:25.226827+0000","last_active":"2024-09-22T03:50:19.756989+0000","last_peered":"2024-09-22T03:50:19.756989+0000","last_clean":"2024-09-22T03:50:19.756989+0000","last_became_active":"2024-09-22T03:49:25.218579+0000","last_became_peered":"2024-09-22T03:49:25.218579+0000","last_unstale":"2024-09-22T03:50:19.756989+0000","last_undegraded":"2024-09-22T03:50:19.756989+0000","last_fullsized":"2024-09-22T03:50:19.756989+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":612,"log_dups_size":0,"ondisk_log_size":612,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40108032,"num_objects":612,"num_object_clones":0,"num_object_copies":1836,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":612,"num_write_kb":39168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":25,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:26.053667+0000","last_change":"2024-09-22T03:49:17.029339+0000","last_active":"2024-09-22T03:49:26.053667+0000","last_peered":"2024-09-22T03:49:26.053667+0000","last_clean":"2024-09-22T03:49:26.053667+0000","last_became_active":"2024-09-22T03:49:15.097304+0000","last_became_peered":"2024-09-22T03:49:15.097304+0000","last_unstale":"2024-09-22T03:49:26.053667+0000","last_undegraded":"2024-09-22T03:49:26.053667+0000","last_fullsized":"2024-09-22T03:49:26.053667+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"19'639","reported_seq":651,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:50:19.832591+0000","last_change":"2024-09-22T03:49:25.208298+0000","last_active":"2024-09-22T03:50:19.832591+0000","last_peered":"2024-09-22T03:50:19.832591+0000","last_clean":"2024-09-22T03:50:19.832591+0000","last_became_active":"2024-09-22T03:49:25.193750+0000","last_became_peered":"2024-09-22T03:49:25.193750+0000","last_unstale":"2024-09-22T03:50:19.832591+0000","last_undegraded":"2024-09-22T03:50:19.832591+0000","last_fullsized":"2024-09-22T03:50:19.832591+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":639,"log_dups_size":0,"ondisk_log_size":639,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41877504,"num_objects":639,"num_object_clones":0,"num_object_copies":1917,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":639,"num_write_kb":40896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":25,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:26.056439+0000","last_change":"2024-09-22T03:49:17.029349+0000","last_active":"2024-09-22T03:49:26.056439+0000","last_peered":"2024-09-22T03:49:26.056439+0000","last_clean":"2024-09-22T03:49:26.056439+0000","last_became_active":"2024-09-22T03:49:15.094890+0000","last_became_peered":"2024-09-22T03:49:15.094890+0000","last_unstale":"2024-09-22T03:49:26.056439+0000","last_undegraded":"2024-09-22T03:49:26.056439+0000","last_fullsized":"2024-09-22T03:49:26.056439+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"19'708","reported_seq":720,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:50:20.918241+0000","last_change":"2024-09-22T03:49:25.226551+0000","last_active":"2024-09-22T03:50:20.918241+0000","last_peered":"2024-09-22T03:50:20.918241+0000","last_clean":"2024-09-22T03:50:20.918241+0000","last_became_active":"2024-09-22T03:49:25.213989+0000","last_became_peered":"2024-09-22T03:49:25.213989+0000","last_unstale":"2024-09-22T03:50:20.918241+0000","last_undegraded":"2024-09-22T03:50:20.918241+0000","last_fullsized":"2024-09-22T03:50:20.918241+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":708,"log_dups_size":0,"ondisk_log_size":708,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46399488,"num_objects":708,"num_object_clones":0,"num_object_copies":2124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":708,"num_write_kb":45312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":27,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:26.057565+0000","last_change":"2024-09-22T03:49:17.031466+0000","last_active":"2024-09-22T03:49:26.057565+0000","last_peered":"2024-09-22T03:49:26.057565+0000","last_clean":"2024-09-22T03:49:26.057565+0000","last_became_active":"2024-09-22T03:49:15.098420+0000","last_became_peered":"2024-09-22T03:49:15.098420+0000","last_unstale":"2024-09-22T03:49:26.057565+0000","last_undegraded":"2024-09-22T03:49:26.057565+0000","last_fullsized":"2024-09-22T03:49:26.057565+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"19'634","reported_seq":646,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:50:19.998823+0000","last_change":"2024-09-22T03:49:25.163198+0000","last_active":"2024-09-22T03:50:19.998823+0000","last_peered":"2024-09-22T03:50:19.998823+0000","last_clean":"2024-09-22T03:50:19.998823+0000","last_became_active":"2024-09-22T03:49:25.145723+0000","last_became_peered":"2024-09-22T03:49:25.145723+0000","last_unstale":"2024-09-22T03:50:19.998823+0000","last_undegraded":"2024-09-22T03:50:19.998823+0000","last_fullsized":"2024-09-22T03:50:19.998823+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":634,"log_dups_size":0,"ondisk_log_size":634,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41549824,"num_objects":634,"num_object_clones":0,"num_object_copies":1902,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":634,"num_write_kb":40576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"19'647","reported_seq":659,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:50:19.936370+0000","last_change":"2024-09-22T03:49:25.168751+0000","last_active":"2024-09-22T03:50:19.936370+0000","last_peered":"2024-09-22T03:50:19.936370+0000","last_clean":"2024-09-22T03:50:19.936370+0000","last_became_active":"2024-09-22T03:49:25.160072+0000","last_became_peered":"2024-09-22T03:49:25.160072+0000","last_unstale":"2024-09-22T03:50:19.936370+0000","last_undegraded":"2024-09-22T03:50:19.936370+0000","last_fullsized":"2024-09-22T03:50:19.936370+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":647,"log_dups_size":0,"ondisk_log_size":647,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42401792,"num_objects":647,"num_object_clones":0,"num_object_copies":1941,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":647,"num_write_kb":41408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":25,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:26.061328+0000","last_change":"2024-09-22T03:49:17.036954+0000","last_active":"2024-09-22T03:49:26.061328+0000","last_peered":"2024-09-22T03:49:26.061328+0000","last_clean":"2024-09-22T03:49:26.061328+0000","last_became_active":"2024-09-22T03:49:15.110506+0000","last_became_peered":"2024-09-22T03:49:15.110506+0000","last_unstale":"2024-09-22T03:49:26.061328+0000","last_undegraded":"2024-09-22T03:49:26.061328+0000","last_fullsized":"2024-09-22T03:49:26.061328+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"19'654","reported_seq":666,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:50:20.980930+0000","last_change":"2024-09-22T03:49:25.218967+0000","last_active":"2024-09-22T03:50:20.980930+0000","last_peered":"2024-09-22T03:50:20.980930+0000","last_clean":"2024-09-22T03:50:20.980930+0000","last_became_active":"2024-09-22T03:49:25.203726+0000","last_became_peered":"2024-09-22T03:49:25.203726+0000","last_unstale":"2024-09-22T03:50:20.980930+0000","last_undegraded":"2024-09-22T03:50:20.980930+0000","last_fullsized":"2024-09-22T03:50:20.980930+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":654,"log_dups_size":0,"ondisk_log_size":654,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42860544,"num_objects":654,"num_object_clones":0,"num_object_copies":1962,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":654,"num_write_kb":41856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":25,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:26.054492+0000","last_change":"2024-09-22T03:49:17.032989+0000","last_active":"2024-09-22T03:49:26.054492+0000","last_peered":"2024-09-22T03:49:26.054492+0000","last_clean":"2024-09-22T03:49:26.054492+0000","last_became_active":"2024-09-22T03:49:15.079260+0000","last_became_peered":"2024-09-22T03:49:15.079260+0000","last_unstale":"2024-09-22T03:49:26.054492+0000","last_undegraded":"2024-09-22T03:49:26.054492+0000","last_fullsized":"2024-09-22T03:49:26.054492+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"19'635","reported_seq":647,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:50:20.920960+0000","last_change":"2024-09-22T03:49:25.275215+0000","last_active":"2024-09-22T03:50:20.920960+0000","last_peered":"2024-09-22T03:50:20.920960+0000","last_clean":"2024-09-22T03:50:20.920960+0000","last_became_active":"2024-09-22T03:49:25.260843+0000","last_became_peered":"2024-09-22T03:49:25.260843+0000","last_unstale":"2024-09-22T03:50:20.920960+0000","last_undegraded":"2024-09-22T03:50:20.920960+0000","last_fullsized":"2024-09-22T03:50:20.920960+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":635,"log_dups_size":0,"ondisk_log_size":635,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41615360,"num_objects":635,"num_object_clones":0,"num_object_copies":1905,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":635,"num_write_kb":40640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":25,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:26.064309+0000","last_change":"2024-09-22T03:49:17.036402+0000","last_active":"2024-09-22T03:49:26.064309+0000","last_peered":"2024-09-22T03:49:26.064309+0000","last_clean":"2024-09-22T03:49:26.064309+0000","last_became_active":"2024-09-22T03:49:15.108430+0000","last_became_peered":"2024-09-22T03:49:15.108430+0000","last_unstale":"2024-09-22T03:49:26.064309+0000","last_undegraded":"2024-09-22T03:49:26.064309+0000","last_fullsized":"2024-09-22T03:49:26.064309+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"19'653","reported_seq":665,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:50:19.777143+0000","last_change":"2024-09-22T03:49:25.211493+0000","last_active":"2024-09-22T03:50:19.777143+0000","last_peered":"2024-09-22T03:50:19.777143+0000","last_clean":"2024-09-22T03:50:19.777143+0000","last_became_active":"2024-09-22T03:49:25.194855+0000","last_became_peered":"2024-09-22T03:49:25.194855+0000","last_unstale":"2024-09-22T03:50:19.777143+0000","last_undegraded":"2024-09-22T03:50:19.777143+0000","last_fullsized":"2024-09-22T03:50:19.777143+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":653,"log_dups_size":0,"ondisk_log_size":653,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42795008,"num_objects":653,"num_object_clones":0,"num_object_copies":1959,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":653,"num_write_kb":41792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":25,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:26.050967+0000","last_change":"2024-09-22T03:49:17.029128+0000","last_active":"2024-09-22T03:49:26.050967+0000","last_peered":"2024-09-22T03:49:26.050967+0000","last_clean":"2024-09-22T03:49:26.050967+0000","last_became_active":"2024-09-22T03:49:15.113396+0000","last_became_peered":"2024-09-22T03:49:15.113396+0000","last_unstale":"2024-09-22T03:49:26.050967+0000","last_undegraded":"2024-09-22T03:49:26.050967+0000","last_fullsized":"2024-09-22T03:49:26.050967+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":679346176,"num_objects":10366,"num_object_clones":0,"num_object_copies":31098,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10366,"num_write_kb":663424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":127324160,"data_stored":2037186560,"data_compressed":96733190,"data_compressed_allocated":127324160,"data_compressed_original":2037186560,"omap_allocated":0,"internal_metadata":0},"log_size":10366,"ondisk_log_size":10366,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949673029,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":60656,"kb_used_data":33824,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94311184,"statfs":{"total":96636764160,"available":96574652416,"internally_reserved":0,"allocated":34635776,"data_stored":551205777,"data_compressed":26173051,"data_compressed_allocated":34451456,"data_compressed_original":551141376,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654705733,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":69676,"kb_used_data":30364,"kb_used_omap":0,"kb_used_meta":39296,"kb_avail":94302164,"statfs":{"total":96636764160,"available":96565415936,"internally_reserved":0,"allocated":31092736,"data_stored":494909809,"data_compressed":23497882,"data_compressed_allocated":30928896,"data_compressed_original":494862336,"omap_allocated":0,"internal_metadata":40239104},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705733,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":60828,"kb_used_data":25676,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94311012,"statfs":{"total":96636764160,"available":96574476288,"internally_reserved":0,"allocated":26292224,"data_stored":417708945,"data_compressed":19834100,"data_compressed_allocated":26107904,"data_compressed_original":417644544,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705733,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":76776,"kb_used_data":33304,"kb_used_omap":0,"kb_used_meta":43456,"kb_avail":94295064,"statfs":{"total":96636764160,"available":96558145536,"internally_reserved":0,"allocated":34103296,"data_stored":542751614,"data_compressed":25771661,"data_compressed_allocated":33923072,"data_compressed_original":542687232,"omap_allocated":0,"internal_metadata":44498944},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":34410496,"data_stored":550567936,"data_compressed":26143053,"data_compressed_allocated":34410496,"data_compressed_original":550567936,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":34992128,"data_stored":559874048,"data_compressed":26584899,"data_compressed_allocated":34992128,"data_compressed_original":559874048,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":26509312,"data_stored":424148992,"data_compressed":20140140,"data_compressed_allocated":26509312,"data_compressed_original":424148992,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":31412224,"data_stored":502595584,"data_compressed":23865098,"data_compressed_allocated":31412224,"data_compressed_original":502595584,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:50:25.817 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-22T03:50:25.817 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:50:25.817 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:50:25.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:50:25.979+0000 7f8370c7f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:50:25.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:50:25.992+0000 7f8370c7f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:50:26.142 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:2024-09-22T03:50:26.142544+0000 min lat: 0.0165006 max lat: 0.215049 avg lat: 0.0847933 2024-09-22T03:50:26.143 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-22T03:50:26.143 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 60 16 11326 11310 11.7802 9.875 0.0970653 0.0847933 2024-09-22T03:50:26.322 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:50:26.322 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-22T03:50:26.341 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":54,"stamp":"2024-09-22T03:50:24.977952+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":679936563,"num_objects":10370,"num_object_clones":0,"num_object_copies":31110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":10447,"num_write_kb":664532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10421,"ondisk_log_size":10421,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":267936,"kb_used_data":123168,"kb_used_omap":0,"kb_used_meta":144704,"kb_avail":377219424,"statfs":{"total":386547056640,"available":386272690176,"internally_reserved":0,"allocated":126124032,"data_stored":2006576145,"data_compressed":95276694,"data_compressed_allocated":125411328,"data_compressed_original":2006335488,"omap_allocated":0,"internal_metadata":148176896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19857408,"num_objects":303,"num_object_clones":0,"num_object_copies":909,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":303,"num_write_kb":19392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000889"},"pg_stats":[{"pgid":"3.f","version":"19'639","reported_seq":651,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:50:19.960939+0000","last_change":"2024-09-22T03:49:25.167073+0000","last_active":"2024-09-22T03:50:19.960939+0000","last_peered":"2024-09-22T03:50:19.960939+0000","last_clean":"2024-09-22T03:50:19.960939+0000","last_became_active":"2024-09-22T03:49:25.159818+0000","last_became_peered":"2024-09-22T03:49:25.159818+0000","last_unstale":"2024-09-22T03:50:19.960939+0000","last_undegraded":"2024-09-22T03:50:19.960939+0000","last_fullsized":"2024-09-22T03:50:19.960939+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":639,"log_dups_size":0,"ondisk_log_size":639,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41877504,"num_objects":639,"num_object_clones":0,"num_object_copies":1917,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":639,"num_write_kb":40896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"19'665","reported_seq":677,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:50:20.908201+0000","last_change":"2024-09-22T03:49:25.238720+0000","last_active":"2024-09-22T03:50:20.908201+0000","last_peered":"2024-09-22T03:50:20.908201+0000","last_clean":"2024-09-22T03:50:20.908201+0000","last_became_active":"2024-09-22T03:49:25.229005+0000","last_became_peered":"2024-09-22T03:49:25.229005+0000","last_unstale":"2024-09-22T03:50:20.908201+0000","last_undegraded":"2024-09-22T03:50:20.908201+0000","last_fullsized":"2024-09-22T03:50:20.908201+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":665,"log_dups_size":0,"ondisk_log_size":665,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43581440,"num_objects":665,"num_object_clones":0,"num_object_copies":1995,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":665,"num_write_kb":42560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"19'655","reported_seq":667,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:50:19.906520+0000","last_change":"2024-09-22T03:49:25.173605+0000","last_active":"2024-09-22T03:50:19.906520+0000","last_peered":"2024-09-22T03:50:19.906520+0000","last_clean":"2024-09-22T03:50:19.906520+0000","last_became_active":"2024-09-22T03:49:25.165491+0000","last_became_peered":"2024-09-22T03:49:25.165491+0000","last_unstale":"2024-09-22T03:50:19.906520+0000","last_undegraded":"2024-09-22T03:50:19.906520+0000","last_fullsized":"2024-09-22T03:50:19.906520+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":655,"log_dups_size":0,"ondisk_log_size":655,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42926080,"num_objects":655,"num_object_clones":0,"num_object_copies":1965,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":655,"num_write_kb":41920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"19'619","reported_seq":631,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:50:19.931269+0000","last_change":"2024-09-22T03:49:25.207920+0000","last_active":"2024-09-22T03:50:19.931269+0000","last_peered":"2024-09-22T03:50:19.931269+0000","last_clean":"2024-09-22T03:50:19.931269+0000","last_became_active":"2024-09-22T03:49:25.198168+0000","last_became_peered":"2024-09-22T03:49:25.198168+0000","last_unstale":"2024-09-22T03:50:19.931269+0000","last_undegraded":"2024-09-22T03:50:19.931269+0000","last_fullsized":"2024-09-22T03:50:19.931269+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":619,"log_dups_size":0,"ondisk_log_size":619,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40566784,"num_objects":619,"num_object_clones":0,"num_object_copies":1857,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":619,"num_write_kb":39616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"19'670","reported_seq":682,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:50:20.971645+0000","last_change":"2024-09-22T03:49:25.280543+0000","last_active":"2024-09-22T03:50:20.971645+0000","last_peered":"2024-09-22T03:50:20.971645+0000","last_clean":"2024-09-22T03:50:20.971645+0000","last_became_active":"2024-09-22T03:49:25.268731+0000","last_became_peered":"2024-09-22T03:49:25.268731+0000","last_unstale":"2024-09-22T03:50:20.971645+0000","last_undegraded":"2024-09-22T03:50:20.971645+0000","last_fullsized":"2024-09-22T03:50:20.971645+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":670,"log_dups_size":0,"ondisk_log_size":670,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43909120,"num_objects":670,"num_object_clones":0,"num_object_copies":2010,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":670,"num_write_kb":42880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"19'630","reported_seq":642,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:50:19.951910+0000","last_change":"2024-09-22T03:49:25.206225+0000","last_active":"2024-09-22T03:50:19.951910+0000","last_peered":"2024-09-22T03:50:19.951910+0000","last_clean":"2024-09-22T03:50:19.951910+0000","last_became_active":"2024-09-22T03:49:25.201227+0000","last_became_peered":"2024-09-22T03:49:25.201227+0000","last_unstale":"2024-09-22T03:50:19.951910+0000","last_undegraded":"2024-09-22T03:50:19.951910+0000","last_fullsized":"2024-09-22T03:50:19.951910+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":630,"log_dups_size":0,"ondisk_log_size":630,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41287680,"num_objects":630,"num_object_clones":0,"num_object_copies":1890,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":630,"num_write_kb":40320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"19'666","reported_seq":678,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:50:19.813014+0000","last_change":"2024-09-22T03:49:25.212585+0000","last_active":"2024-09-22T03:50:19.813014+0000","last_peered":"2024-09-22T03:50:19.813014+0000","last_clean":"2024-09-22T03:50:19.813014+0000","last_became_active":"2024-09-22T03:49:25.203356+0000","last_became_peered":"2024-09-22T03:49:25.203356+0000","last_unstale":"2024-09-22T03:50:19.813014+0000","last_undegraded":"2024-09-22T03:50:19.813014+0000","last_fullsized":"2024-09-22T03:50:19.813014+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":666,"log_dups_size":0,"ondisk_log_size":666,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43646976,"num_objects":666,"num_object_clones":0,"num_object_copies":1998,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":666,"num_write_kb":42624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"19'640","reported_seq":652,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:50:19.700500+0000","last_change":"2024-09-22T03:49:25.177465+0000","last_active":"2024-09-22T03:50:19.700500+0000","last_peered":"2024-09-22T03:50:19.700500+0000","last_clean":"2024-09-22T03:50:19.700500+0000","last_became_active":"2024-09-22T03:49:25.170026+0000","last_became_peered":"2024-09-22T03:49:25.170026+0000","last_unstale":"2024-09-22T03:50:19.700500+0000","last_undegraded":"2024-09-22T03:50:19.700500+0000","last_fullsized":"2024-09-22T03:50:19.700500+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":640,"log_dups_size":0,"ondisk_log_size":640,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":640,"num_object_clones":0,"num_object_copies":1920,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":640,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":100,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:26.053552+0000","last_change":"2024-09-22T03:49:12.034704+0000","last_active":"2024-09-22T03:49:26.053552+0000","last_peered":"2024-09-22T03:49:26.053552+0000","last_clean":"2024-09-22T03:49:26.053552+0000","last_became_active":"2024-09-22T03:49:12.027470+0000","last_became_peered":"2024-09-22T03:49:12.027470+0000","last_unstale":"2024-09-22T03:49:26.053552+0000","last_undegraded":"2024-09-22T03:49:26.053552+0000","last_fullsized":"2024-09-22T03:49:26.053552+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_clean_scrub_stamp":"2024-09-22T03:49:10.979949+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":26,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:26.060600+0000","last_change":"2024-09-22T03:49:17.031458+0000","last_active":"2024-09-22T03:49:26.060600+0000","last_peered":"2024-09-22T03:49:26.060600+0000","last_clean":"2024-09-22T03:49:26.060600+0000","last_became_active":"2024-09-22T03:49:15.125490+0000","last_became_peered":"2024-09-22T03:49:15.125490+0000","last_unstale":"2024-09-22T03:49:26.060600+0000","last_undegraded":"2024-09-22T03:49:26.060600+0000","last_fullsized":"2024-09-22T03:49:26.060600+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"19'612","reported_seq":624,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:50:19.756989+0000","last_change":"2024-09-22T03:49:25.226827+0000","last_active":"2024-09-22T03:50:19.756989+0000","last_peered":"2024-09-22T03:50:19.756989+0000","last_clean":"2024-09-22T03:50:19.756989+0000","last_became_active":"2024-09-22T03:49:25.218579+0000","last_became_peered":"2024-09-22T03:49:25.218579+0000","last_unstale":"2024-09-22T03:50:19.756989+0000","last_undegraded":"2024-09-22T03:50:19.756989+0000","last_fullsized":"2024-09-22T03:50:19.756989+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":612,"log_dups_size":0,"ondisk_log_size":612,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40108032,"num_objects":612,"num_object_clones":0,"num_object_copies":1836,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":612,"num_write_kb":39168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":25,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:26.053667+0000","last_change":"2024-09-22T03:49:17.029339+0000","last_active":"2024-09-22T03:49:26.053667+0000","last_peered":"2024-09-22T03:49:26.053667+0000","last_clean":"2024-09-22T03:49:26.053667+0000","last_became_active":"2024-09-22T03:49:15.097304+0000","last_became_peered":"2024-09-22T03:49:15.097304+0000","last_unstale":"2024-09-22T03:49:26.053667+0000","last_undegraded":"2024-09-22T03:49:26.053667+0000","last_fullsized":"2024-09-22T03:49:26.053667+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"19'639","reported_seq":651,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:50:19.832591+0000","last_change":"2024-09-22T03:49:25.208298+0000","last_active":"2024-09-22T03:50:19.832591+0000","last_peered":"2024-09-22T03:50:19.832591+0000","last_clean":"2024-09-22T03:50:19.832591+0000","last_became_active":"2024-09-22T03:49:25.193750+0000","last_became_peered":"2024-09-22T03:49:25.193750+0000","last_unstale":"2024-09-22T03:50:19.832591+0000","last_undegraded":"2024-09-22T03:50:19.832591+0000","last_fullsized":"2024-09-22T03:50:19.832591+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":639,"log_dups_size":0,"ondisk_log_size":639,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41877504,"num_objects":639,"num_object_clones":0,"num_object_copies":1917,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":639,"num_write_kb":40896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":25,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:26.056439+0000","last_change":"2024-09-22T03:49:17.029349+0000","last_active":"2024-09-22T03:49:26.056439+0000","last_peered":"2024-09-22T03:49:26.056439+0000","last_clean":"2024-09-22T03:49:26.056439+0000","last_became_active":"2024-09-22T03:49:15.094890+0000","last_became_peered":"2024-09-22T03:49:15.094890+0000","last_unstale":"2024-09-22T03:49:26.056439+0000","last_undegraded":"2024-09-22T03:49:26.056439+0000","last_fullsized":"2024-09-22T03:49:26.056439+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"19'708","reported_seq":720,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:50:20.918241+0000","last_change":"2024-09-22T03:49:25.226551+0000","last_active":"2024-09-22T03:50:20.918241+0000","last_peered":"2024-09-22T03:50:20.918241+0000","last_clean":"2024-09-22T03:50:20.918241+0000","last_became_active":"2024-09-22T03:49:25.213989+0000","last_became_peered":"2024-09-22T03:49:25.213989+0000","last_unstale":"2024-09-22T03:50:20.918241+0000","last_undegraded":"2024-09-22T03:50:20.918241+0000","last_fullsized":"2024-09-22T03:50:20.918241+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":708,"log_dups_size":0,"ondisk_log_size":708,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46399488,"num_objects":708,"num_object_clones":0,"num_object_copies":2124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":708,"num_write_kb":45312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":27,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:26.057565+0000","last_change":"2024-09-22T03:49:17.031466+0000","last_active":"2024-09-22T03:49:26.057565+0000","last_peered":"2024-09-22T03:49:26.057565+0000","last_clean":"2024-09-22T03:49:26.057565+0000","last_became_active":"2024-09-22T03:49:15.098420+0000","last_became_peered":"2024-09-22T03:49:15.098420+0000","last_unstale":"2024-09-22T03:49:26.057565+0000","last_undegraded":"2024-09-22T03:49:26.057565+0000","last_fullsized":"2024-09-22T03:49:26.057565+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"19'634","reported_seq":646,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:50:19.998823+0000","last_change":"2024-09-22T03:49:25.163198+0000","last_active":"2024-09-22T03:50:19.998823+0000","last_peered":"2024-09-22T03:50:19.998823+0000","last_clean":"2024-09-22T03:50:19.998823+0000","last_became_active":"2024-09-22T03:49:25.145723+0000","last_became_peered":"2024-09-22T03:49:25.145723+0000","last_unstale":"2024-09-22T03:50:19.998823+0000","last_undegraded":"2024-09-22T03:50:19.998823+0000","last_fullsized":"2024-09-22T03:50:19.998823+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":634,"log_dups_size":0,"ondisk_log_size":634,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41549824,"num_objects":634,"num_object_clones":0,"num_object_copies":1902,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":634,"num_write_kb":40576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"19'647","reported_seq":659,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:50:19.936370+0000","last_change":"2024-09-22T03:49:25.168751+0000","last_active":"2024-09-22T03:50:19.936370+0000","last_peered":"2024-09-22T03:50:19.936370+0000","last_clean":"2024-09-22T03:50:19.936370+0000","last_became_active":"2024-09-22T03:49:25.160072+0000","last_became_peered":"2024-09-22T03:49:25.160072+0000","last_unstale":"2024-09-22T03:50:19.936370+0000","last_undegraded":"2024-09-22T03:50:19.936370+0000","last_fullsized":"2024-09-22T03:50:19.936370+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":647,"log_dups_size":0,"ondisk_log_size":647,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42401792,"num_objects":647,"num_object_clones":0,"num_object_copies":1941,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":647,"num_write_kb":41408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":25,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:26.061328+0000","last_change":"2024-09-22T03:49:17.036954+0000","last_active":"2024-09-22T03:49:26.061328+0000","last_peered":"2024-09-22T03:49:26.061328+0000","last_clean":"2024-09-22T03:49:26.061328+0000","last_became_active":"2024-09-22T03:49:15.110506+0000","last_became_peered":"2024-09-22T03:49:15.110506+0000","last_unstale":"2024-09-22T03:49:26.061328+0000","last_undegraded":"2024-09-22T03:49:26.061328+0000","last_fullsized":"2024-09-22T03:49:26.061328+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"19'654","reported_seq":666,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:50:20.980930+0000","last_change":"2024-09-22T03:49:25.218967+0000","last_active":"2024-09-22T03:50:20.980930+0000","last_peered":"2024-09-22T03:50:20.980930+0000","last_clean":"2024-09-22T03:50:20.980930+0000","last_became_active":"2024-09-22T03:49:25.203726+0000","last_became_peered":"2024-09-22T03:49:25.203726+0000","last_unstale":"2024-09-22T03:50:20.980930+0000","last_undegraded":"2024-09-22T03:50:20.980930+0000","last_fullsized":"2024-09-22T03:50:20.980930+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":654,"log_dups_size":0,"ondisk_log_size":654,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42860544,"num_objects":654,"num_object_clones":0,"num_object_copies":1962,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":654,"num_write_kb":41856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":25,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:26.054492+0000","last_change":"2024-09-22T03:49:17.032989+0000","last_active":"2024-09-22T03:49:26.054492+0000","last_peered":"2024-09-22T03:49:26.054492+0000","last_clean":"2024-09-22T03:49:26.054492+0000","last_became_active":"2024-09-22T03:49:15.079260+0000","last_became_peered":"2024-09-22T03:49:15.079260+0000","last_unstale":"2024-09-22T03:49:26.054492+0000","last_undegraded":"2024-09-22T03:49:26.054492+0000","last_fullsized":"2024-09-22T03:49:26.054492+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"19'635","reported_seq":647,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:50:20.920960+0000","last_change":"2024-09-22T03:49:25.275215+0000","last_active":"2024-09-22T03:50:20.920960+0000","last_peered":"2024-09-22T03:50:20.920960+0000","last_clean":"2024-09-22T03:50:20.920960+0000","last_became_active":"2024-09-22T03:49:25.260843+0000","last_became_peered":"2024-09-22T03:49:25.260843+0000","last_unstale":"2024-09-22T03:50:20.920960+0000","last_undegraded":"2024-09-22T03:50:20.920960+0000","last_fullsized":"2024-09-22T03:50:20.920960+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":635,"log_dups_size":0,"ondisk_log_size":635,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41615360,"num_objects":635,"num_object_clones":0,"num_object_copies":1905,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":635,"num_write_kb":40640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":25,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:26.064309+0000","last_change":"2024-09-22T03:49:17.036402+0000","last_active":"2024-09-22T03:49:26.064309+0000","last_peered":"2024-09-22T03:49:26.064309+0000","last_clean":"2024-09-22T03:49:26.064309+0000","last_became_active":"2024-09-22T03:49:15.108430+0000","last_became_peered":"2024-09-22T03:49:15.108430+0000","last_unstale":"2024-09-22T03:49:26.064309+0000","last_undegraded":"2024-09-22T03:49:26.064309+0000","last_fullsized":"2024-09-22T03:49:26.064309+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"19'653","reported_seq":665,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:50:19.777143+0000","last_change":"2024-09-22T03:49:25.211493+0000","last_active":"2024-09-22T03:50:19.777143+0000","last_peered":"2024-09-22T03:50:19.777143+0000","last_clean":"2024-09-22T03:50:19.777143+0000","last_became_active":"2024-09-22T03:49:25.194855+0000","last_became_peered":"2024-09-22T03:49:25.194855+0000","last_unstale":"2024-09-22T03:50:19.777143+0000","last_undegraded":"2024-09-22T03:50:19.777143+0000","last_fullsized":"2024-09-22T03:50:19.777143+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":653,"log_dups_size":0,"ondisk_log_size":653,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42795008,"num_objects":653,"num_object_clones":0,"num_object_copies":1959,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":653,"num_write_kb":41792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":25,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:49:26.050967+0000","last_change":"2024-09-22T03:49:17.029128+0000","last_active":"2024-09-22T03:49:26.050967+0000","last_peered":"2024-09-22T03:49:26.050967+0000","last_clean":"2024-09-22T03:49:26.050967+0000","last_became_active":"2024-09-22T03:49:15.113396+0000","last_became_peered":"2024-09-22T03:49:15.113396+0000","last_unstale":"2024-09-22T03:49:26.050967+0000","last_undegraded":"2024-09-22T03:49:26.050967+0000","last_fullsized":"2024-09-22T03:49:26.050967+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":679346176,"num_objects":10366,"num_object_clones":0,"num_object_copies":31098,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10366,"num_write_kb":663424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":127324160,"data_stored":2037186560,"data_compressed":96733190,"data_compressed_allocated":127324160,"data_compressed_original":2037186560,"omap_allocated":0,"internal_metadata":0},"log_size":10366,"ondisk_log_size":10366,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949673029,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":60656,"kb_used_data":33824,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94311184,"statfs":{"total":96636764160,"available":96574652416,"internally_reserved":0,"allocated":34635776,"data_stored":551205777,"data_compressed":26173051,"data_compressed_allocated":34451456,"data_compressed_original":551141376,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654705733,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":69676,"kb_used_data":30364,"kb_used_omap":0,"kb_used_meta":39296,"kb_avail":94302164,"statfs":{"total":96636764160,"available":96565415936,"internally_reserved":0,"allocated":31092736,"data_stored":494909809,"data_compressed":23497882,"data_compressed_allocated":30928896,"data_compressed_original":494862336,"omap_allocated":0,"internal_metadata":40239104},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705733,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":60828,"kb_used_data":25676,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94311012,"statfs":{"total":96636764160,"available":96574476288,"internally_reserved":0,"allocated":26292224,"data_stored":417708945,"data_compressed":19834100,"data_compressed_allocated":26107904,"data_compressed_original":417644544,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705733,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":76776,"kb_used_data":33304,"kb_used_omap":0,"kb_used_meta":43456,"kb_avail":94295064,"statfs":{"total":96636764160,"available":96558145536,"internally_reserved":0,"allocated":34103296,"data_stored":542751614,"data_compressed":25771661,"data_compressed_allocated":33923072,"data_compressed_original":542687232,"omap_allocated":0,"internal_metadata":44498944},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":34410496,"data_stored":550567936,"data_compressed":26143053,"data_compressed_allocated":34410496,"data_compressed_original":550567936,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":34992128,"data_stored":559874048,"data_compressed":26584899,"data_compressed_allocated":34992128,"data_compressed_original":559874048,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":26509312,"data_stored":424148992,"data_compressed":20140140,"data_compressed_allocated":26509312,"data_compressed_original":424148992,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":31412224,"data_stored":502595584,"data_compressed":23865098,"data_compressed_allocated":31412224,"data_compressed_original":502595584,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:50:27.142 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 61 16 11508 11492 11.7735 11.375 0.0802778 0.0848449 2024-09-22T03:50:27.335 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:50:27.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:50:27.508+0000 7ff2d0246640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:50:27.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:50:27.519+0000 7ff2d0246640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:50:28.143 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 62 16 11693 11677 11.7701 11.5625 0.0582967 0.0848842 2024-09-22T03:50:29.143 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 63 16 11879 11863 11.7678 11.625 0.0634086 0.0849015 2024-09-22T03:50:29.880 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:50:30.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:50:30.041+0000 7f1af4446640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:50:30.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:50:30.050+0000 7f1af4446640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:50:30.143 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 64 16 12052 12036 11.7528 10.8125 0.140003 0.0849886 2024-09-22T03:50:31.143 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 65 16 12241 12225 11.7537 11.8125 0.108807 0.0850053 2024-09-22T03:50:31.343 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:50:31.343 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-22T03:50:31.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:50:31.502+0000 7f97da948640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:50:31.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:50:31.521+0000 7f97da948640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:50:32.038 INFO:teuthology.orchestra.run.smithi037.stderr:reweighted osd.0 to 1 (10000) 2024-09-22T03:50:32.063 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-22T03:50:32.143 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 66 16 12408 12392 11.7338 10.4375 0.136326 0.0851261 2024-09-22T03:50:32.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:50:32.228+0000 7f0188823640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:50:32.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:50:32.247+0000 7f0188823640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:50:32.603 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:50:32.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:50:32.755+0000 7f6343b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:50:32.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:50:32.764+0000 7f6343b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:50:33.143 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 67 16 12563 12547 11.7032 9.6875 0.0513553 0.0853719 2024-09-22T03:50:33.662 INFO:teuthology.orchestra.run.smithi037.stderr:reweighted osd.1 to 1 (10000) 2024-09-22T03:50:33.684 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-22T03:50:33.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:50:33.848+0000 7f67e449c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:50:33.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:50:33.865+0000 7f67e449c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:50:34.143 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 68 16 12737 12721 11.691 10.875 0.0845963 0.0854634 2024-09-22T03:50:34.670 INFO:teuthology.orchestra.run.smithi037.stderr:reweighted osd.2 to 1 (10000) 2024-09-22T03:50:34.691 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-22T03:50:34.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:50:34.848+0000 7f7ddef91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:50:34.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:50:34.864+0000 7f7ddef91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:50:35.143 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 69 16 12892 12876 11.662 9.6875 0.198286 0.0856375 2024-09-22T03:50:35.144 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:50:35.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:50:35.291+0000 7f608b6ec640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:50:35.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:50:35.300+0000 7f608b6ec640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:50:35.676 INFO:teuthology.orchestra.run.smithi037.stderr:reweighted osd.3 to 1 (10000) 2024-09-22T03:50:35.701 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-22T03:50:35.701 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:50:35.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:50:35.906+0000 7f3a55eac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:50:35.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:50:35.918+0000 7f3a55eac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:50:36.143 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 70 16 13061 13045 11.6462 10.5625 0.105431 0.0857763 2024-09-22T03:50:36.291 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:50:36.292 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-22T03:50:36.309 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":63,"stamp":"2024-09-22T03:50:35.676774+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":829948467,"num_objects":12659,"num_object_clones":0,"num_object_copies":37977,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":12736,"num_write_kb":811028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12710,"ondisk_log_size":12710,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":288012,"kb_used_data":151564,"kb_used_omap":0,"kb_used_meta":136384,"kb_avail":377199348,"statfs":{"total":386547056640,"available":386252132352,"internally_reserved":0,"allocated":155201536,"data_stored":2469004631,"data_compressed":117231851,"data_compressed_allocated":154308608,"data_compressed_original":2468691968,"omap_allocated":0,"internal_metadata":139657216},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":55181312,"num_objects":842,"num_object_clones":0,"num_object_copies":2526,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":842,"num_write_kb":53888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.697564"},"pg_stats":[{"pgid":"3.f","version":"26'794","reported_seq":827,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-22T03:50:34.961662+0000","last_change":"2024-09-22T03:49:25.167073+0000","last_active":"2024-09-22T03:50:34.961662+0000","last_peered":"2024-09-22T03:50:34.961662+0000","last_clean":"2024-09-22T03:50:34.961662+0000","last_became_active":"2024-09-22T03:49:25.159818+0000","last_became_peered":"2024-09-22T03:49:25.159818+0000","last_unstale":"2024-09-22T03:50:34.961662+0000","last_undegraded":"2024-09-22T03:50:34.961662+0000","last_fullsized":"2024-09-22T03:50:34.961662+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":794,"log_dups_size":0,"ondisk_log_size":794,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52035584,"num_objects":794,"num_object_clones":0,"num_object_copies":2382,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":794,"num_write_kb":50816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"23'783","reported_seq":807,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-22T03:50:30.842553+0000","last_change":"2024-09-22T03:49:25.238720+0000","last_active":"2024-09-22T03:50:30.842553+0000","last_peered":"2024-09-22T03:50:30.842553+0000","last_clean":"2024-09-22T03:50:30.842553+0000","last_became_active":"2024-09-22T03:49:25.229005+0000","last_became_peered":"2024-09-22T03:49:25.229005+0000","last_unstale":"2024-09-22T03:50:30.842553+0000","last_undegraded":"2024-09-22T03:50:30.842553+0000","last_fullsized":"2024-09-22T03:50:30.842553+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":783,"log_dups_size":0,"ondisk_log_size":783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51314688,"num_objects":783,"num_object_clones":0,"num_object_copies":2349,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":783,"num_write_kb":50112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"26'822","reported_seq":855,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-22T03:50:34.968150+0000","last_change":"2024-09-22T03:49:25.173605+0000","last_active":"2024-09-22T03:50:34.968150+0000","last_peered":"2024-09-22T03:50:34.968150+0000","last_clean":"2024-09-22T03:50:34.968150+0000","last_became_active":"2024-09-22T03:49:25.165491+0000","last_became_peered":"2024-09-22T03:49:25.165491+0000","last_unstale":"2024-09-22T03:50:34.968150+0000","last_undegraded":"2024-09-22T03:50:34.968150+0000","last_fullsized":"2024-09-22T03:50:34.968150+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":822,"log_dups_size":0,"ondisk_log_size":822,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53870592,"num_objects":822,"num_object_clones":0,"num_object_copies":2466,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":822,"num_write_kb":52608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"26'767","reported_seq":800,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-22T03:50:34.823238+0000","last_change":"2024-09-22T03:49:25.207920+0000","last_active":"2024-09-22T03:50:34.823238+0000","last_peered":"2024-09-22T03:50:34.823238+0000","last_clean":"2024-09-22T03:50:34.823238+0000","last_became_active":"2024-09-22T03:49:25.198168+0000","last_became_peered":"2024-09-22T03:49:25.198168+0000","last_unstale":"2024-09-22T03:50:34.823238+0000","last_undegraded":"2024-09-22T03:50:34.823238+0000","last_fullsized":"2024-09-22T03:50:34.823238+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":767,"log_dups_size":0,"ondisk_log_size":767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50266112,"num_objects":767,"num_object_clones":0,"num_object_copies":2301,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":767,"num_write_kb":49088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"23'771","reported_seq":795,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-22T03:50:30.836725+0000","last_change":"2024-09-22T03:49:25.280543+0000","last_active":"2024-09-22T03:50:30.836725+0000","last_peered":"2024-09-22T03:50:30.836725+0000","last_clean":"2024-09-22T03:50:30.836725+0000","last_became_active":"2024-09-22T03:49:25.268731+0000","last_became_peered":"2024-09-22T03:49:25.268731+0000","last_unstale":"2024-09-22T03:50:30.836725+0000","last_undegraded":"2024-09-22T03:50:30.836725+0000","last_fullsized":"2024-09-22T03:50:30.836725+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50528256,"num_objects":771,"num_object_clones":0,"num_object_copies":2313,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":771,"num_write_kb":49344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"26'799","reported_seq":832,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-22T03:50:34.811817+0000","last_change":"2024-09-22T03:49:25.206225+0000","last_active":"2024-09-22T03:50:34.811817+0000","last_peered":"2024-09-22T03:50:34.811817+0000","last_clean":"2024-09-22T03:50:34.811817+0000","last_became_active":"2024-09-22T03:49:25.201227+0000","last_became_peered":"2024-09-22T03:49:25.201227+0000","last_unstale":"2024-09-22T03:50:34.811817+0000","last_undegraded":"2024-09-22T03:50:34.811817+0000","last_fullsized":"2024-09-22T03:50:34.811817+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":799,"log_dups_size":0,"ondisk_log_size":799,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52363264,"num_objects":799,"num_object_clones":0,"num_object_copies":2397,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":799,"num_write_kb":51136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"26'822","reported_seq":855,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-22T03:50:34.955813+0000","last_change":"2024-09-22T03:49:25.212585+0000","last_active":"2024-09-22T03:50:34.955813+0000","last_peered":"2024-09-22T03:50:34.955813+0000","last_clean":"2024-09-22T03:50:34.955813+0000","last_became_active":"2024-09-22T03:49:25.203356+0000","last_became_peered":"2024-09-22T03:49:25.203356+0000","last_unstale":"2024-09-22T03:50:34.955813+0000","last_undegraded":"2024-09-22T03:50:34.955813+0000","last_fullsized":"2024-09-22T03:50:34.955813+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":822,"log_dups_size":0,"ondisk_log_size":822,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53870592,"num_objects":822,"num_object_clones":0,"num_object_copies":2466,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":822,"num_write_kb":52608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"26'797","reported_seq":830,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-22T03:50:34.879126+0000","last_change":"2024-09-22T03:49:25.177465+0000","last_active":"2024-09-22T03:50:34.879126+0000","last_peered":"2024-09-22T03:50:34.879126+0000","last_clean":"2024-09-22T03:50:34.879126+0000","last_became_active":"2024-09-22T03:49:25.170026+0000","last_became_peered":"2024-09-22T03:49:25.170026+0000","last_unstale":"2024-09-22T03:50:34.879126+0000","last_undegraded":"2024-09-22T03:50:34.879126+0000","last_fullsized":"2024-09-22T03:50:34.879126+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":797,"log_dups_size":0,"ondisk_log_size":797,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52232192,"num_objects":797,"num_object_clones":0,"num_object_copies":2391,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":797,"num_write_kb":51008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":112,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-22T03:50:24.762073+0000","last_change":"2024-09-22T03:49:12.034704+0000","last_active":"2024-09-22T03:50:24.762073+0000","last_peered":"2024-09-22T03:50:24.762073+0000","last_clean":"2024-09-22T03:50:24.762073+0000","last_became_active":"2024-09-22T03:49:12.027470+0000","last_became_peered":"2024-09-22T03:49:12.027470+0000","last_unstale":"2024-09-22T03:50:24.762073+0000","last_undegraded":"2024-09-22T03:50:24.762073+0000","last_fullsized":"2024-09-22T03:50:24.762073+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_clean_scrub_stamp":"2024-09-22T03:49:10.979949+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":47,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-22T03:50:34.698100+0000","last_change":"2024-09-22T03:49:17.031458+0000","last_active":"2024-09-22T03:50:34.698100+0000","last_peered":"2024-09-22T03:50:34.698100+0000","last_clean":"2024-09-22T03:50:34.698100+0000","last_became_active":"2024-09-22T03:49:15.125490+0000","last_became_peered":"2024-09-22T03:49:15.125490+0000","last_unstale":"2024-09-22T03:50:34.698100+0000","last_undegraded":"2024-09-22T03:50:34.698100+0000","last_fullsized":"2024-09-22T03:50:34.698100+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"26'769","reported_seq":802,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-22T03:50:34.742825+0000","last_change":"2024-09-22T03:49:25.226827+0000","last_active":"2024-09-22T03:50:34.742825+0000","last_peered":"2024-09-22T03:50:34.742825+0000","last_clean":"2024-09-22T03:50:34.742825+0000","last_became_active":"2024-09-22T03:49:25.218579+0000","last_became_peered":"2024-09-22T03:49:25.218579+0000","last_unstale":"2024-09-22T03:50:34.742825+0000","last_undegraded":"2024-09-22T03:50:34.742825+0000","last_fullsized":"2024-09-22T03:50:34.742825+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":769,"log_dups_size":0,"ondisk_log_size":769,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50397184,"num_objects":769,"num_object_clones":0,"num_object_copies":2307,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":769,"num_write_kb":49216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":46,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-22T03:50:34.690430+0000","last_change":"2024-09-22T03:49:17.029339+0000","last_active":"2024-09-22T03:50:34.690430+0000","last_peered":"2024-09-22T03:50:34.690430+0000","last_clean":"2024-09-22T03:50:34.690430+0000","last_became_active":"2024-09-22T03:49:15.097304+0000","last_became_peered":"2024-09-22T03:49:15.097304+0000","last_unstale":"2024-09-22T03:50:34.690430+0000","last_undegraded":"2024-09-22T03:50:34.690430+0000","last_fullsized":"2024-09-22T03:50:34.690430+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"26'801","reported_seq":834,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-22T03:50:34.762049+0000","last_change":"2024-09-22T03:49:25.208298+0000","last_active":"2024-09-22T03:50:34.762049+0000","last_peered":"2024-09-22T03:50:34.762049+0000","last_clean":"2024-09-22T03:50:34.762049+0000","last_became_active":"2024-09-22T03:49:25.193750+0000","last_became_peered":"2024-09-22T03:49:25.193750+0000","last_unstale":"2024-09-22T03:50:34.762049+0000","last_undegraded":"2024-09-22T03:50:34.762049+0000","last_fullsized":"2024-09-22T03:50:34.762049+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":801,"log_dups_size":0,"ondisk_log_size":801,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52494336,"num_objects":801,"num_object_clones":0,"num_object_copies":2403,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":801,"num_write_kb":51264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":46,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-22T03:50:34.692957+0000","last_change":"2024-09-22T03:49:17.029349+0000","last_active":"2024-09-22T03:50:34.692957+0000","last_peered":"2024-09-22T03:50:34.692957+0000","last_clean":"2024-09-22T03:50:34.692957+0000","last_became_active":"2024-09-22T03:49:15.094890+0000","last_became_peered":"2024-09-22T03:49:15.094890+0000","last_unstale":"2024-09-22T03:50:34.692957+0000","last_undegraded":"2024-09-22T03:50:34.692957+0000","last_fullsized":"2024-09-22T03:50:34.692957+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"23'805","reported_seq":829,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-22T03:50:30.993390+0000","last_change":"2024-09-22T03:49:25.226551+0000","last_active":"2024-09-22T03:50:30.993390+0000","last_peered":"2024-09-22T03:50:30.993390+0000","last_clean":"2024-09-22T03:50:30.993390+0000","last_became_active":"2024-09-22T03:49:25.213989+0000","last_became_peered":"2024-09-22T03:49:25.213989+0000","last_unstale":"2024-09-22T03:50:30.993390+0000","last_undegraded":"2024-09-22T03:50:30.993390+0000","last_fullsized":"2024-09-22T03:50:30.993390+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":805,"log_dups_size":0,"ondisk_log_size":805,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52756480,"num_objects":805,"num_object_clones":0,"num_object_copies":2415,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":805,"num_write_kb":51520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":48,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-22T03:50:34.698824+0000","last_change":"2024-09-22T03:49:17.031466+0000","last_active":"2024-09-22T03:50:34.698824+0000","last_peered":"2024-09-22T03:50:34.698824+0000","last_clean":"2024-09-22T03:50:34.698824+0000","last_became_active":"2024-09-22T03:49:15.098420+0000","last_became_peered":"2024-09-22T03:49:15.098420+0000","last_unstale":"2024-09-22T03:50:34.698824+0000","last_undegraded":"2024-09-22T03:50:34.698824+0000","last_fullsized":"2024-09-22T03:50:34.698824+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"26'786","reported_seq":819,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-22T03:50:34.700871+0000","last_change":"2024-09-22T03:49:25.163198+0000","last_active":"2024-09-22T03:50:34.700871+0000","last_peered":"2024-09-22T03:50:34.700871+0000","last_clean":"2024-09-22T03:50:34.700871+0000","last_became_active":"2024-09-22T03:49:25.145723+0000","last_became_peered":"2024-09-22T03:49:25.145723+0000","last_unstale":"2024-09-22T03:50:34.700871+0000","last_undegraded":"2024-09-22T03:50:34.700871+0000","last_fullsized":"2024-09-22T03:50:34.700871+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":786,"log_dups_size":0,"ondisk_log_size":786,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51511296,"num_objects":786,"num_object_clones":0,"num_object_copies":2358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":786,"num_write_kb":50304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"26'809","reported_seq":842,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-22T03:50:34.770234+0000","last_change":"2024-09-22T03:49:25.168751+0000","last_active":"2024-09-22T03:50:34.770234+0000","last_peered":"2024-09-22T03:50:34.770234+0000","last_clean":"2024-09-22T03:50:34.770234+0000","last_became_active":"2024-09-22T03:49:25.160072+0000","last_became_peered":"2024-09-22T03:49:25.160072+0000","last_unstale":"2024-09-22T03:50:34.770234+0000","last_undegraded":"2024-09-22T03:50:34.770234+0000","last_fullsized":"2024-09-22T03:50:34.770234+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":809,"log_dups_size":0,"ondisk_log_size":809,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53018624,"num_objects":809,"num_object_clones":0,"num_object_copies":2427,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":809,"num_write_kb":51776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-22T03:50:24.769182+0000","last_change":"2024-09-22T03:49:17.036954+0000","last_active":"2024-09-22T03:50:24.769182+0000","last_peered":"2024-09-22T03:50:24.769182+0000","last_clean":"2024-09-22T03:50:24.769182+0000","last_became_active":"2024-09-22T03:49:15.110506+0000","last_became_peered":"2024-09-22T03:49:15.110506+0000","last_unstale":"2024-09-22T03:50:24.769182+0000","last_undegraded":"2024-09-22T03:50:24.769182+0000","last_fullsized":"2024-09-22T03:50:24.769182+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"23'761","reported_seq":785,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-22T03:50:30.847759+0000","last_change":"2024-09-22T03:49:25.218967+0000","last_active":"2024-09-22T03:50:30.847759+0000","last_peered":"2024-09-22T03:50:30.847759+0000","last_clean":"2024-09-22T03:50:30.847759+0000","last_became_active":"2024-09-22T03:49:25.203726+0000","last_became_peered":"2024-09-22T03:49:25.203726+0000","last_unstale":"2024-09-22T03:50:30.847759+0000","last_undegraded":"2024-09-22T03:50:30.847759+0000","last_fullsized":"2024-09-22T03:50:30.847759+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":761,"log_dups_size":0,"ondisk_log_size":761,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49872896,"num_objects":761,"num_object_clones":0,"num_object_copies":2283,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":761,"num_write_kb":48704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-22T03:50:24.765324+0000","last_change":"2024-09-22T03:49:17.032989+0000","last_active":"2024-09-22T03:50:24.765324+0000","last_peered":"2024-09-22T03:50:24.765324+0000","last_clean":"2024-09-22T03:50:24.765324+0000","last_became_active":"2024-09-22T03:49:15.079260+0000","last_became_peered":"2024-09-22T03:49:15.079260+0000","last_unstale":"2024-09-22T03:50:24.765324+0000","last_undegraded":"2024-09-22T03:50:24.765324+0000","last_fullsized":"2024-09-22T03:50:24.765324+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"23'753","reported_seq":777,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-22T03:50:30.897916+0000","last_change":"2024-09-22T03:49:25.275215+0000","last_active":"2024-09-22T03:50:30.897916+0000","last_peered":"2024-09-22T03:50:30.897916+0000","last_clean":"2024-09-22T03:50:30.897916+0000","last_became_active":"2024-09-22T03:49:25.260843+0000","last_became_peered":"2024-09-22T03:49:25.260843+0000","last_unstale":"2024-09-22T03:50:30.897916+0000","last_undegraded":"2024-09-22T03:50:30.897916+0000","last_fullsized":"2024-09-22T03:50:30.897916+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":753,"log_dups_size":0,"ondisk_log_size":753,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49348608,"num_objects":753,"num_object_clones":0,"num_object_copies":2259,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":753,"num_write_kb":48192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-22T03:50:24.765829+0000","last_change":"2024-09-22T03:49:17.036402+0000","last_active":"2024-09-22T03:50:24.765829+0000","last_peered":"2024-09-22T03:50:24.765829+0000","last_clean":"2024-09-22T03:50:24.765829+0000","last_became_active":"2024-09-22T03:49:15.108430+0000","last_became_peered":"2024-09-22T03:49:15.108430+0000","last_unstale":"2024-09-22T03:50:24.765829+0000","last_undegraded":"2024-09-22T03:50:24.765829+0000","last_fullsized":"2024-09-22T03:50:24.765829+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"26'816","reported_seq":849,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-22T03:50:34.707367+0000","last_change":"2024-09-22T03:49:25.211493+0000","last_active":"2024-09-22T03:50:34.707367+0000","last_peered":"2024-09-22T03:50:34.707367+0000","last_clean":"2024-09-22T03:50:34.707367+0000","last_became_active":"2024-09-22T03:49:25.194855+0000","last_became_peered":"2024-09-22T03:49:25.194855+0000","last_unstale":"2024-09-22T03:50:34.707367+0000","last_undegraded":"2024-09-22T03:50:34.707367+0000","last_fullsized":"2024-09-22T03:50:34.707367+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":816,"log_dups_size":0,"ondisk_log_size":816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53477376,"num_objects":816,"num_object_clones":0,"num_object_copies":2448,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":816,"num_write_kb":52224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":46,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-22T03:50:34.692338+0000","last_change":"2024-09-22T03:49:17.029128+0000","last_active":"2024-09-22T03:50:34.692338+0000","last_peered":"2024-09-22T03:50:34.692338+0000","last_clean":"2024-09-22T03:50:34.692338+0000","last_became_active":"2024-09-22T03:49:15.113396+0000","last_became_peered":"2024-09-22T03:49:15.113396+0000","last_unstale":"2024-09-22T03:50:34.692338+0000","last_undegraded":"2024-09-22T03:50:34.692338+0000","last_fullsized":"2024-09-22T03:50:34.692338+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":829358080,"num_objects":12655,"num_object_clones":0,"num_object_copies":37965,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12655,"num_write_kb":809920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":156020736,"data_stored":2496331776,"data_compressed":118535859,"data_compressed_allocated":156020736,"data_compressed_original":2496331776,"omap_allocated":0,"internal_metadata":0},"log_size":12655,"ondisk_log_size":12655,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949673039,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":70480,"kb_used_data":39488,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94301360,"statfs":{"total":96636764160,"available":96564592640,"internally_reserved":0,"allocated":40435712,"data_stored":643493557,"data_compressed":30554746,"data_compressed_allocated":40218624,"data_compressed_original":643416064,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654705748,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":69116,"kb_used_data":38124,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94302724,"statfs":{"total":96636764160,"available":96565989376,"internally_reserved":0,"allocated":39038976,"data_stored":621282855,"data_compressed":29497817,"data_compressed_allocated":38825984,"data_compressed_original":621215744,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705748,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":75664,"kb_used_data":32192,"kb_used_omap":0,"kb_used_meta":43456,"kb_avail":94296176,"statfs":{"total":96636764160,"available":96559284224,"internally_reserved":0,"allocated":32964608,"data_stored":523700295,"data_compressed":24866204,"data_compressed_allocated":32731136,"data_compressed_original":523616256,"omap_allocated":0,"internal_metadata":44498944},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705748,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":72752,"kb_used_data":41760,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94299088,"statfs":{"total":96636764160,"available":96562266112,"internally_reserved":0,"allocated":42762240,"data_stored":680527924,"data_compressed":32313084,"data_compressed_allocated":42532864,"data_compressed_original":680443904,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":42946560,"data_stored":687144960,"data_compressed":32628460,"data_compressed_allocated":42946560,"data_compressed_original":687144960,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40710144,"data_stored":651362304,"data_compressed":30929250,"data_compressed_allocated":40710144,"data_compressed_original":651362304,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":33079296,"data_stored":529268736,"data_compressed":25131788,"data_compressed_allocated":33079296,"data_compressed_original":529268736,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":39284736,"data_stored":628555776,"data_compressed":29846361,"data_compressed_allocated":39284736,"data_compressed_original":628555776,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:50:36.310 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:50:36.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:50:36.467+0000 7fc2e7d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:50:36.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:50:36.479+0000 7fc2e7d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:50:36.764 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:50:36.765 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-22T03:50:36.782 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":63,"stamp":"2024-09-22T03:50:35.676774+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":829948467,"num_objects":12659,"num_object_clones":0,"num_object_copies":37977,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":12736,"num_write_kb":811028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12710,"ondisk_log_size":12710,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":288012,"kb_used_data":151564,"kb_used_omap":0,"kb_used_meta":136384,"kb_avail":377199348,"statfs":{"total":386547056640,"available":386252132352,"internally_reserved":0,"allocated":155201536,"data_stored":2469004631,"data_compressed":117231851,"data_compressed_allocated":154308608,"data_compressed_original":2468691968,"omap_allocated":0,"internal_metadata":139657216},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":55181312,"num_objects":842,"num_object_clones":0,"num_object_copies":2526,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":842,"num_write_kb":53888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.697564"},"pg_stats":[{"pgid":"3.f","version":"26'794","reported_seq":827,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-22T03:50:34.961662+0000","last_change":"2024-09-22T03:49:25.167073+0000","last_active":"2024-09-22T03:50:34.961662+0000","last_peered":"2024-09-22T03:50:34.961662+0000","last_clean":"2024-09-22T03:50:34.961662+0000","last_became_active":"2024-09-22T03:49:25.159818+0000","last_became_peered":"2024-09-22T03:49:25.159818+0000","last_unstale":"2024-09-22T03:50:34.961662+0000","last_undegraded":"2024-09-22T03:50:34.961662+0000","last_fullsized":"2024-09-22T03:50:34.961662+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":794,"log_dups_size":0,"ondisk_log_size":794,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52035584,"num_objects":794,"num_object_clones":0,"num_object_copies":2382,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":794,"num_write_kb":50816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"23'783","reported_seq":807,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-22T03:50:30.842553+0000","last_change":"2024-09-22T03:49:25.238720+0000","last_active":"2024-09-22T03:50:30.842553+0000","last_peered":"2024-09-22T03:50:30.842553+0000","last_clean":"2024-09-22T03:50:30.842553+0000","last_became_active":"2024-09-22T03:49:25.229005+0000","last_became_peered":"2024-09-22T03:49:25.229005+0000","last_unstale":"2024-09-22T03:50:30.842553+0000","last_undegraded":"2024-09-22T03:50:30.842553+0000","last_fullsized":"2024-09-22T03:50:30.842553+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":783,"log_dups_size":0,"ondisk_log_size":783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51314688,"num_objects":783,"num_object_clones":0,"num_object_copies":2349,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":783,"num_write_kb":50112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"26'822","reported_seq":855,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-22T03:50:34.968150+0000","last_change":"2024-09-22T03:49:25.173605+0000","last_active":"2024-09-22T03:50:34.968150+0000","last_peered":"2024-09-22T03:50:34.968150+0000","last_clean":"2024-09-22T03:50:34.968150+0000","last_became_active":"2024-09-22T03:49:25.165491+0000","last_became_peered":"2024-09-22T03:49:25.165491+0000","last_unstale":"2024-09-22T03:50:34.968150+0000","last_undegraded":"2024-09-22T03:50:34.968150+0000","last_fullsized":"2024-09-22T03:50:34.968150+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":822,"log_dups_size":0,"ondisk_log_size":822,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53870592,"num_objects":822,"num_object_clones":0,"num_object_copies":2466,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":822,"num_write_kb":52608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"26'767","reported_seq":800,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-22T03:50:34.823238+0000","last_change":"2024-09-22T03:49:25.207920+0000","last_active":"2024-09-22T03:50:34.823238+0000","last_peered":"2024-09-22T03:50:34.823238+0000","last_clean":"2024-09-22T03:50:34.823238+0000","last_became_active":"2024-09-22T03:49:25.198168+0000","last_became_peered":"2024-09-22T03:49:25.198168+0000","last_unstale":"2024-09-22T03:50:34.823238+0000","last_undegraded":"2024-09-22T03:50:34.823238+0000","last_fullsized":"2024-09-22T03:50:34.823238+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":767,"log_dups_size":0,"ondisk_log_size":767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50266112,"num_objects":767,"num_object_clones":0,"num_object_copies":2301,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":767,"num_write_kb":49088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"23'771","reported_seq":795,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-22T03:50:30.836725+0000","last_change":"2024-09-22T03:49:25.280543+0000","last_active":"2024-09-22T03:50:30.836725+0000","last_peered":"2024-09-22T03:50:30.836725+0000","last_clean":"2024-09-22T03:50:30.836725+0000","last_became_active":"2024-09-22T03:49:25.268731+0000","last_became_peered":"2024-09-22T03:49:25.268731+0000","last_unstale":"2024-09-22T03:50:30.836725+0000","last_undegraded":"2024-09-22T03:50:30.836725+0000","last_fullsized":"2024-09-22T03:50:30.836725+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50528256,"num_objects":771,"num_object_clones":0,"num_object_copies":2313,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":771,"num_write_kb":49344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"26'799","reported_seq":832,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-22T03:50:34.811817+0000","last_change":"2024-09-22T03:49:25.206225+0000","last_active":"2024-09-22T03:50:34.811817+0000","last_peered":"2024-09-22T03:50:34.811817+0000","last_clean":"2024-09-22T03:50:34.811817+0000","last_became_active":"2024-09-22T03:49:25.201227+0000","last_became_peered":"2024-09-22T03:49:25.201227+0000","last_unstale":"2024-09-22T03:50:34.811817+0000","last_undegraded":"2024-09-22T03:50:34.811817+0000","last_fullsized":"2024-09-22T03:50:34.811817+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":799,"log_dups_size":0,"ondisk_log_size":799,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52363264,"num_objects":799,"num_object_clones":0,"num_object_copies":2397,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":799,"num_write_kb":51136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"26'822","reported_seq":855,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-22T03:50:34.955813+0000","last_change":"2024-09-22T03:49:25.212585+0000","last_active":"2024-09-22T03:50:34.955813+0000","last_peered":"2024-09-22T03:50:34.955813+0000","last_clean":"2024-09-22T03:50:34.955813+0000","last_became_active":"2024-09-22T03:49:25.203356+0000","last_became_peered":"2024-09-22T03:49:25.203356+0000","last_unstale":"2024-09-22T03:50:34.955813+0000","last_undegraded":"2024-09-22T03:50:34.955813+0000","last_fullsized":"2024-09-22T03:50:34.955813+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":822,"log_dups_size":0,"ondisk_log_size":822,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53870592,"num_objects":822,"num_object_clones":0,"num_object_copies":2466,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":822,"num_write_kb":52608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"26'797","reported_seq":830,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-22T03:50:34.879126+0000","last_change":"2024-09-22T03:49:25.177465+0000","last_active":"2024-09-22T03:50:34.879126+0000","last_peered":"2024-09-22T03:50:34.879126+0000","last_clean":"2024-09-22T03:50:34.879126+0000","last_became_active":"2024-09-22T03:49:25.170026+0000","last_became_peered":"2024-09-22T03:49:25.170026+0000","last_unstale":"2024-09-22T03:50:34.879126+0000","last_undegraded":"2024-09-22T03:50:34.879126+0000","last_fullsized":"2024-09-22T03:50:34.879126+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":797,"log_dups_size":0,"ondisk_log_size":797,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52232192,"num_objects":797,"num_object_clones":0,"num_object_copies":2391,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":797,"num_write_kb":51008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":112,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-22T03:50:24.762073+0000","last_change":"2024-09-22T03:49:12.034704+0000","last_active":"2024-09-22T03:50:24.762073+0000","last_peered":"2024-09-22T03:50:24.762073+0000","last_clean":"2024-09-22T03:50:24.762073+0000","last_became_active":"2024-09-22T03:49:12.027470+0000","last_became_peered":"2024-09-22T03:49:12.027470+0000","last_unstale":"2024-09-22T03:50:24.762073+0000","last_undegraded":"2024-09-22T03:50:24.762073+0000","last_fullsized":"2024-09-22T03:50:24.762073+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_clean_scrub_stamp":"2024-09-22T03:49:10.979949+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":47,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-22T03:50:34.698100+0000","last_change":"2024-09-22T03:49:17.031458+0000","last_active":"2024-09-22T03:50:34.698100+0000","last_peered":"2024-09-22T03:50:34.698100+0000","last_clean":"2024-09-22T03:50:34.698100+0000","last_became_active":"2024-09-22T03:49:15.125490+0000","last_became_peered":"2024-09-22T03:49:15.125490+0000","last_unstale":"2024-09-22T03:50:34.698100+0000","last_undegraded":"2024-09-22T03:50:34.698100+0000","last_fullsized":"2024-09-22T03:50:34.698100+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"26'769","reported_seq":802,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-22T03:50:34.742825+0000","last_change":"2024-09-22T03:49:25.226827+0000","last_active":"2024-09-22T03:50:34.742825+0000","last_peered":"2024-09-22T03:50:34.742825+0000","last_clean":"2024-09-22T03:50:34.742825+0000","last_became_active":"2024-09-22T03:49:25.218579+0000","last_became_peered":"2024-09-22T03:49:25.218579+0000","last_unstale":"2024-09-22T03:50:34.742825+0000","last_undegraded":"2024-09-22T03:50:34.742825+0000","last_fullsized":"2024-09-22T03:50:34.742825+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":769,"log_dups_size":0,"ondisk_log_size":769,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50397184,"num_objects":769,"num_object_clones":0,"num_object_copies":2307,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":769,"num_write_kb":49216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":46,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-22T03:50:34.690430+0000","last_change":"2024-09-22T03:49:17.029339+0000","last_active":"2024-09-22T03:50:34.690430+0000","last_peered":"2024-09-22T03:50:34.690430+0000","last_clean":"2024-09-22T03:50:34.690430+0000","last_became_active":"2024-09-22T03:49:15.097304+0000","last_became_peered":"2024-09-22T03:49:15.097304+0000","last_unstale":"2024-09-22T03:50:34.690430+0000","last_undegraded":"2024-09-22T03:50:34.690430+0000","last_fullsized":"2024-09-22T03:50:34.690430+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"26'801","reported_seq":834,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-22T03:50:34.762049+0000","last_change":"2024-09-22T03:49:25.208298+0000","last_active":"2024-09-22T03:50:34.762049+0000","last_peered":"2024-09-22T03:50:34.762049+0000","last_clean":"2024-09-22T03:50:34.762049+0000","last_became_active":"2024-09-22T03:49:25.193750+0000","last_became_peered":"2024-09-22T03:49:25.193750+0000","last_unstale":"2024-09-22T03:50:34.762049+0000","last_undegraded":"2024-09-22T03:50:34.762049+0000","last_fullsized":"2024-09-22T03:50:34.762049+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":801,"log_dups_size":0,"ondisk_log_size":801,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52494336,"num_objects":801,"num_object_clones":0,"num_object_copies":2403,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":801,"num_write_kb":51264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":46,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-22T03:50:34.692957+0000","last_change":"2024-09-22T03:49:17.029349+0000","last_active":"2024-09-22T03:50:34.692957+0000","last_peered":"2024-09-22T03:50:34.692957+0000","last_clean":"2024-09-22T03:50:34.692957+0000","last_became_active":"2024-09-22T03:49:15.094890+0000","last_became_peered":"2024-09-22T03:49:15.094890+0000","last_unstale":"2024-09-22T03:50:34.692957+0000","last_undegraded":"2024-09-22T03:50:34.692957+0000","last_fullsized":"2024-09-22T03:50:34.692957+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"23'805","reported_seq":829,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-22T03:50:30.993390+0000","last_change":"2024-09-22T03:49:25.226551+0000","last_active":"2024-09-22T03:50:30.993390+0000","last_peered":"2024-09-22T03:50:30.993390+0000","last_clean":"2024-09-22T03:50:30.993390+0000","last_became_active":"2024-09-22T03:49:25.213989+0000","last_became_peered":"2024-09-22T03:49:25.213989+0000","last_unstale":"2024-09-22T03:50:30.993390+0000","last_undegraded":"2024-09-22T03:50:30.993390+0000","last_fullsized":"2024-09-22T03:50:30.993390+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":805,"log_dups_size":0,"ondisk_log_size":805,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52756480,"num_objects":805,"num_object_clones":0,"num_object_copies":2415,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":805,"num_write_kb":51520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":48,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-22T03:50:34.698824+0000","last_change":"2024-09-22T03:49:17.031466+0000","last_active":"2024-09-22T03:50:34.698824+0000","last_peered":"2024-09-22T03:50:34.698824+0000","last_clean":"2024-09-22T03:50:34.698824+0000","last_became_active":"2024-09-22T03:49:15.098420+0000","last_became_peered":"2024-09-22T03:49:15.098420+0000","last_unstale":"2024-09-22T03:50:34.698824+0000","last_undegraded":"2024-09-22T03:50:34.698824+0000","last_fullsized":"2024-09-22T03:50:34.698824+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"26'786","reported_seq":819,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-22T03:50:34.700871+0000","last_change":"2024-09-22T03:49:25.163198+0000","last_active":"2024-09-22T03:50:34.700871+0000","last_peered":"2024-09-22T03:50:34.700871+0000","last_clean":"2024-09-22T03:50:34.700871+0000","last_became_active":"2024-09-22T03:49:25.145723+0000","last_became_peered":"2024-09-22T03:49:25.145723+0000","last_unstale":"2024-09-22T03:50:34.700871+0000","last_undegraded":"2024-09-22T03:50:34.700871+0000","last_fullsized":"2024-09-22T03:50:34.700871+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":786,"log_dups_size":0,"ondisk_log_size":786,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51511296,"num_objects":786,"num_object_clones":0,"num_object_copies":2358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":786,"num_write_kb":50304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"26'809","reported_seq":842,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-22T03:50:34.770234+0000","last_change":"2024-09-22T03:49:25.168751+0000","last_active":"2024-09-22T03:50:34.770234+0000","last_peered":"2024-09-22T03:50:34.770234+0000","last_clean":"2024-09-22T03:50:34.770234+0000","last_became_active":"2024-09-22T03:49:25.160072+0000","last_became_peered":"2024-09-22T03:49:25.160072+0000","last_unstale":"2024-09-22T03:50:34.770234+0000","last_undegraded":"2024-09-22T03:50:34.770234+0000","last_fullsized":"2024-09-22T03:50:34.770234+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":809,"log_dups_size":0,"ondisk_log_size":809,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53018624,"num_objects":809,"num_object_clones":0,"num_object_copies":2427,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":809,"num_write_kb":51776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-22T03:50:24.769182+0000","last_change":"2024-09-22T03:49:17.036954+0000","last_active":"2024-09-22T03:50:24.769182+0000","last_peered":"2024-09-22T03:50:24.769182+0000","last_clean":"2024-09-22T03:50:24.769182+0000","last_became_active":"2024-09-22T03:49:15.110506+0000","last_became_peered":"2024-09-22T03:49:15.110506+0000","last_unstale":"2024-09-22T03:50:24.769182+0000","last_undegraded":"2024-09-22T03:50:24.769182+0000","last_fullsized":"2024-09-22T03:50:24.769182+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"23'761","reported_seq":785,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-22T03:50:30.847759+0000","last_change":"2024-09-22T03:49:25.218967+0000","last_active":"2024-09-22T03:50:30.847759+0000","last_peered":"2024-09-22T03:50:30.847759+0000","last_clean":"2024-09-22T03:50:30.847759+0000","last_became_active":"2024-09-22T03:49:25.203726+0000","last_became_peered":"2024-09-22T03:49:25.203726+0000","last_unstale":"2024-09-22T03:50:30.847759+0000","last_undegraded":"2024-09-22T03:50:30.847759+0000","last_fullsized":"2024-09-22T03:50:30.847759+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":761,"log_dups_size":0,"ondisk_log_size":761,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49872896,"num_objects":761,"num_object_clones":0,"num_object_copies":2283,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":761,"num_write_kb":48704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-22T03:50:24.765324+0000","last_change":"2024-09-22T03:49:17.032989+0000","last_active":"2024-09-22T03:50:24.765324+0000","last_peered":"2024-09-22T03:50:24.765324+0000","last_clean":"2024-09-22T03:50:24.765324+0000","last_became_active":"2024-09-22T03:49:15.079260+0000","last_became_peered":"2024-09-22T03:49:15.079260+0000","last_unstale":"2024-09-22T03:50:24.765324+0000","last_undegraded":"2024-09-22T03:50:24.765324+0000","last_fullsized":"2024-09-22T03:50:24.765324+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"23'753","reported_seq":777,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-22T03:50:30.897916+0000","last_change":"2024-09-22T03:49:25.275215+0000","last_active":"2024-09-22T03:50:30.897916+0000","last_peered":"2024-09-22T03:50:30.897916+0000","last_clean":"2024-09-22T03:50:30.897916+0000","last_became_active":"2024-09-22T03:49:25.260843+0000","last_became_peered":"2024-09-22T03:49:25.260843+0000","last_unstale":"2024-09-22T03:50:30.897916+0000","last_undegraded":"2024-09-22T03:50:30.897916+0000","last_fullsized":"2024-09-22T03:50:30.897916+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":753,"log_dups_size":0,"ondisk_log_size":753,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49348608,"num_objects":753,"num_object_clones":0,"num_object_copies":2259,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":753,"num_write_kb":48192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-22T03:50:24.765829+0000","last_change":"2024-09-22T03:49:17.036402+0000","last_active":"2024-09-22T03:50:24.765829+0000","last_peered":"2024-09-22T03:50:24.765829+0000","last_clean":"2024-09-22T03:50:24.765829+0000","last_became_active":"2024-09-22T03:49:15.108430+0000","last_became_peered":"2024-09-22T03:49:15.108430+0000","last_unstale":"2024-09-22T03:50:24.765829+0000","last_undegraded":"2024-09-22T03:50:24.765829+0000","last_fullsized":"2024-09-22T03:50:24.765829+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"26'816","reported_seq":849,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-22T03:50:34.707367+0000","last_change":"2024-09-22T03:49:25.211493+0000","last_active":"2024-09-22T03:50:34.707367+0000","last_peered":"2024-09-22T03:50:34.707367+0000","last_clean":"2024-09-22T03:50:34.707367+0000","last_became_active":"2024-09-22T03:49:25.194855+0000","last_became_peered":"2024-09-22T03:49:25.194855+0000","last_unstale":"2024-09-22T03:50:34.707367+0000","last_undegraded":"2024-09-22T03:50:34.707367+0000","last_fullsized":"2024-09-22T03:50:34.707367+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":816,"log_dups_size":0,"ondisk_log_size":816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53477376,"num_objects":816,"num_object_clones":0,"num_object_copies":2448,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":816,"num_write_kb":52224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":46,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-22T03:50:34.692338+0000","last_change":"2024-09-22T03:49:17.029128+0000","last_active":"2024-09-22T03:50:34.692338+0000","last_peered":"2024-09-22T03:50:34.692338+0000","last_clean":"2024-09-22T03:50:34.692338+0000","last_became_active":"2024-09-22T03:49:15.113396+0000","last_became_peered":"2024-09-22T03:49:15.113396+0000","last_unstale":"2024-09-22T03:50:34.692338+0000","last_undegraded":"2024-09-22T03:50:34.692338+0000","last_fullsized":"2024-09-22T03:50:34.692338+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":829358080,"num_objects":12655,"num_object_clones":0,"num_object_copies":37965,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12655,"num_write_kb":809920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":156020736,"data_stored":2496331776,"data_compressed":118535859,"data_compressed_allocated":156020736,"data_compressed_original":2496331776,"omap_allocated":0,"internal_metadata":0},"log_size":12655,"ondisk_log_size":12655,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949673039,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":70480,"kb_used_data":39488,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94301360,"statfs":{"total":96636764160,"available":96564592640,"internally_reserved":0,"allocated":40435712,"data_stored":643493557,"data_compressed":30554746,"data_compressed_allocated":40218624,"data_compressed_original":643416064,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654705748,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":69116,"kb_used_data":38124,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94302724,"statfs":{"total":96636764160,"available":96565989376,"internally_reserved":0,"allocated":39038976,"data_stored":621282855,"data_compressed":29497817,"data_compressed_allocated":38825984,"data_compressed_original":621215744,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705748,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":75664,"kb_used_data":32192,"kb_used_omap":0,"kb_used_meta":43456,"kb_avail":94296176,"statfs":{"total":96636764160,"available":96559284224,"internally_reserved":0,"allocated":32964608,"data_stored":523700295,"data_compressed":24866204,"data_compressed_allocated":32731136,"data_compressed_original":523616256,"omap_allocated":0,"internal_metadata":44498944},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705748,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":72752,"kb_used_data":41760,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94299088,"statfs":{"total":96636764160,"available":96562266112,"internally_reserved":0,"allocated":42762240,"data_stored":680527924,"data_compressed":32313084,"data_compressed_allocated":42532864,"data_compressed_original":680443904,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":42946560,"data_stored":687144960,"data_compressed":32628460,"data_compressed_allocated":42946560,"data_compressed_original":687144960,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40710144,"data_stored":651362304,"data_compressed":30929250,"data_compressed_allocated":40710144,"data_compressed_original":651362304,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":33079296,"data_stored":529268736,"data_compressed":25131788,"data_compressed_allocated":33079296,"data_compressed_original":529268736,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":39284736,"data_stored":628555776,"data_compressed":29846361,"data_compressed_allocated":39284736,"data_compressed_original":628555776,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:50:36.783 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-22T03:50:36.783 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:50:36.784 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:50:36.784 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:50:36.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:50:36.932+0000 7f4f55f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:50:36.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:50:36.954+0000 7f4f55f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:50:37.020 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:50:37.020 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:50:37.020 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:50:37.020 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:50:37.020 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:50:37.020 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:50:37.020 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:50:37.020 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:50:37.020 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:50:37.020 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:50:37.020 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:50:37.021 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:50:37.025 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:50:37.025 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:50:37.025 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:50:37.143 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 71 16 13238 13222 11.638 11.0625 0.109584 0.0858744 2024-09-22T03:50:37.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:50:37.182+0000 7f4f16111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:50:37.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:50:37.199+0000 7f4f16111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:50:37.366 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:50:37.367 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:50:37.367 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:50:37.367 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:50:37.367 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:50:37.367 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:50:37.367 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:50:37.367 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:50:37.367 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:50:37.367 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:50:37.367 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:50:37.367 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:50:37.370 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:50:37.371 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:50:37.371 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:50:37.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:50:37.532+0000 7f14db084640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:50:37.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:50:37.550+0000 7f14db084640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:50:37.588 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:50:37.662 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:50:37.662 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:50:37.662 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:50:37.662 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:50:37.662 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:50:37.662 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:50:37.662 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:50:37.662 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:50:37.662 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:50:37.663 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:50:37.663 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:50:37.663 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:50:37.664 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:50:37.664 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:50:37.696 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:50:37.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:50:37.829+0000 7f3d2c791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:50:37.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:50:37.849+0000 7f3d2c791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:50:37.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:50:37.866+0000 7fcc8e391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:50:37.876 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:50:37.876 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:50:37.876 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:50:37.876 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:50:37.876 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:50:37.876 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:50:37.877 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:50:37.877 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:50:37.877 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:50:37.877 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:50:37.877 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:50:37.877 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:50:37.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:50:37.876+0000 7fcc8e391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:50:37.881 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:50:37.882 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:50:38.144 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 72 16 13410 13394 11.6257 10.75 0.0523121 0.0859476 2024-09-22T03:50:39.144 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 73 16 13581 13565 11.6128 10.6875 0.159378 0.0860434 2024-09-22T03:50:40.144 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 74 16 13764 13748 11.6104 11.4375 0.136917 0.0860607 2024-09-22T03:50:40.486 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:50:40.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:50:40.638+0000 7f0b44591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:50:40.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:50:40.649+0000 7f0b44591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:50:41.144 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 75 16 13943 13927 11.6048 11.1875 0.115784 0.0861269 2024-09-22T03:50:42.144 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 76 16 14122 14106 11.5993 11.1875 0.103852 0.0861582 2024-09-22T03:50:42.883 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:50:42.883 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:50:42.883 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:50:42.883 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:50:43.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:50:43.053+0000 7f2741b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:50:43.065 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:50:43.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:50:43.070+0000 7f2741b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:50:43.144 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 77 16 14304 14288 11.5963 11.375 0.102203 0.0861901 2024-09-22T03:50:43.216 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:50:43.216 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:50:43.216 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:50:43.216 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:50:43.216 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:50:43.216 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:50:43.216 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:50:43.216 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:50:43.216 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:50:43.216 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:50:43.216 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:50:43.217 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:50:43.221 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:50:43.221 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:50:43.221 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:50:43.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:50:43.227+0000 7f6163088640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:50:43.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:50:43.240+0000 7f6163088640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:50:43.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:50:43.391+0000 7fb3fe191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:50:43.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:50:43.407+0000 7fb3fe191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:50:43.627 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:50:43.627 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:50:43.627 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:50:43.627 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:50:43.627 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:50:43.627 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:50:43.627 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:50:43.627 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:50:43.627 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:50:43.628 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:50:43.628 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:50:43.628 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:50:43.632 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:50:43.633 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:50:43.633 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:50:43.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:50:43.838+0000 7fc28e911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:50:43.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:50:43.855+0000 7fc28e911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:50:43.885 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:50:43.885 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:50:43.885 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:50:43.885 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:50:43.885 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:50:43.885 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:50:43.885 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:50:43.886 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:50:43.886 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:50:43.886 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:50:43.886 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:50:43.886 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:50:43.890 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:50:43.890 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:50:43.890 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:50:44.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:50:44.032+0000 7f8ecaf11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:50:44.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:50:44.051+0000 7f8ecaf11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:50:44.121 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:50:44.121 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:50:44.121 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:50:44.121 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:50:44.121 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:50:44.121 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:50:44.121 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:50:44.121 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:50:44.121 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:50:44.121 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:50:44.121 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:50:44.121 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:50:44.125 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:50:44.125 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:50:44.144 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 78 16 14460 14444 11.5726 9.75 0.0790656 0.0863381 2024-09-22T03:50:45.144 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 79 16 14651 14635 11.5773 11.9375 0.0702812 0.0863111 2024-09-22T03:50:45.656 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:50:45.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:50:45.824+0000 7f2595511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:50:45.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:50:45.835+0000 7f2595511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:50:46.144 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:2024-09-22T03:50:46.144397+0000 min lat: 0.0165006 max lat: 0.238053 avg lat: 0.0864084 2024-09-22T03:50:46.145 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-22T03:50:46.145 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 80 16 14820 14804 11.5646 10.5625 0.041809 0.0864084 2024-09-22T03:50:47.144 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 81 16 14987 14971 11.5506 10.4375 0.124664 0.0864952 2024-09-22T03:50:48.144 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 82 16 15168 15152 11.5477 11.3125 0.145277 0.0865438 2024-09-22T03:50:48.270 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:50:48.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:50:48.432+0000 7f515a846640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:50:48.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:50:48.442+0000 7f515a846640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:50:49.126 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:50:49.126 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:50:49.127 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:50:49.127 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:50:49.144 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 83 16 15346 15330 11.5426 11.125 0.0543708 0.086585 2024-09-22T03:50:49.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:50:49.303+0000 7fc7a984f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:50:49.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:50:49.318+0000 7fc7a984f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:50:49.548 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:50:49.548 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:50:49.548 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:50:49.548 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:50:49.548 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:50:49.548 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:50:49.549 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:50:49.549 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:50:49.549 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:50:49.549 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:50:49.549 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:50:49.549 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:50:49.552 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:50:49.552 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:50:49.552 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:50:49.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:50:49.757+0000 7f40944d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:50:49.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:50:49.773+0000 7f40944d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:50:49.951 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:50:49.951 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:50:49.951 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:50:49.951 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:50:49.951 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:50:49.951 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:50:49.952 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:50:49.952 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:50:49.952 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:50:49.952 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:50:49.952 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:50:49.952 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:50:49.955 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:50:49.955 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:50:49.955 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:50:50.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:50:50.097+0000 7f3214391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:50:50.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:50:50.112+0000 7f3214391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:50:50.145 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 84 16 15513 15497 11.5294 10.4375 0.106064 0.0866633 2024-09-22T03:50:50.158 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:50:50.158 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:50:50.158 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:50:50.158 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:50:50.158 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:50:50.158 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:50:50.158 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:50:50.159 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:50:50.159 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:50:50.159 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:50:50.159 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:50:50.159 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:50:50.162 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:50:50.162 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:50:50.163 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:50:50.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:50:50.321+0000 7f0c5624f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:50:50.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:50:50.342+0000 7f0c5624f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:50:50.378 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:50:50.378 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:50:50.378 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:50:50.378 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:50:50.378 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:50:50.378 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:50:50.378 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:50:50.378 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:50:50.379 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:50:50.379 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:50:50.379 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:50:50.379 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:50:50.382 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:50:50.382 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:50:50.893 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:50:51.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:50:51.052+0000 7f9d7e791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:50:51.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:50:51.062+0000 7f9d7e791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:50:51.145 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 85 16 15689 15673 11.5232 11 0.0682563 0.0867126 2024-09-22T03:50:52.145 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 86 16 15872 15856 11.5222 11.4375 0.0812788 0.0867361 2024-09-22T03:50:53.145 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 87 16 16052 16036 11.5191 11.25 0.087621 0.0867534 2024-09-22T03:50:53.663 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:50:53.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:50:53.816+0000 7f4e93c88640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:50:53.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:50:53.825+0000 7f4e93c88640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:50:54.145 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 88 16 16217 16201 11.5053 10.3125 0.132983 0.0868438 2024-09-22T03:50:55.145 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 89 16 16394 16378 11.5003 11.0625 0.096363 0.0868928 2024-09-22T03:50:55.384 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:50:55.384 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:50:55.384 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:50:55.384 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:50:55.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:50:55.562+0000 7f87ca391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:50:55.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:50:55.579+0000 7f87ca391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:50:55.617 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:50:55.617 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:50:55.618 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:50:55.618 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:50:55.618 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:50:55.618 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:50:55.618 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:50:55.618 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:50:55.618 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:50:55.618 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:50:55.618 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:50:55.618 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:50:55.621 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:50:55.621 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:50:55.622 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:50:55.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:50:55.764+0000 7f63cd351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:50:55.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:50:55.783+0000 7f63cd351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:50:55.984 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:50:55.984 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:50:55.984 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:50:55.984 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:50:55.984 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:50:55.984 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:50:55.984 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:50:55.985 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:50:55.985 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:50:55.985 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:50:55.985 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:50:55.985 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:50:55.988 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:50:55.989 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:50:55.989 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:50:56.145 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 90 14 16559 16545 11.4885 10.4375 0.0460311 0.0869701 2024-09-22T03:50:56.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:50:56.153+0000 7f8bb7591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:50:56.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:50:56.169+0000 7f8bb7591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:50:56.187 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:50:56.187 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:50:56.187 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:50:56.187 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:50:56.187 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:50:56.187 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:50:56.187 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:50:56.187 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:50:56.188 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:50:56.188 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:50:56.188 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:50:56.188 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:50:56.191 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:50:56.191 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:50:56.191 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:50:56.246 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:50:56.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:50:56.300+0000 7fbf6dac8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:50:56.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:50:56.311+0000 7fbf6dac8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:50:56.328 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:50:56.329 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:50:56.329 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:50:56.329 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:50:56.329 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:50:56.329 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:50:56.329 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:50:56.329 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:50:56.329 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:50:56.329 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:50:56.329 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:50:56.329 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:50:56.332 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:50:56.332 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:50:56.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:50:56.357+0000 7f6cff446640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:50:56.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:50:56.364+0000 7f6cff446640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:50:57.146 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Total time run: 90.075 2024-09-22T03:50:57.146 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Total writes made: 16559 2024-09-22T03:50:57.146 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Write size: 65536 2024-09-22T03:50:57.146 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Object size: 65536 2024-09-22T03:50:57.146 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Bandwidth (MB/sec): 11.4897 2024-09-22T03:50:57.146 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Stddev Bandwidth: 0.901449 2024-09-22T03:50:57.146 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Max bandwidth (MB/sec): 13.375 2024-09-22T03:50:57.146 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Min bandwidth (MB/sec): 9.6875 2024-09-22T03:50:57.146 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Average IOPS: 183 2024-09-22T03:50:57.146 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Stddev IOPS: 14.4232 2024-09-22T03:50:57.146 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Max IOPS: 214 2024-09-22T03:50:57.146 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Min IOPS: 155 2024-09-22T03:50:57.146 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Average Latency(s): 0.0869991 2024-09-22T03:50:57.147 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Stddev Latency(s): 0.0326793 2024-09-22T03:50:57.147 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Max latency(s): 0.238053 2024-09-22T03:50:57.147 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Min latency(s): 0.0165006 2024-09-22T03:50:57.172 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Cleaning up (deleting benchmark objects) 2024-09-22T03:50:58.464 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:50:58.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:50:58.615+0000 7fb68b351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:50:58.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:50:58.625+0000 7fb68b351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:01.003 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:51:01.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:51:01.160+0000 7f9743efd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:01.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:51:01.171+0000 7f9743efd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:01.333 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:51:01.333 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:51:01.333 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:51:01.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:51:01.479+0000 7ffa90d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:01.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:51:01.496+0000 7ffa90d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:01.816 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:51:01.816 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-22T03:51:01.836 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":76,"stamp":"2024-09-22T03:51:00.985502+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1057096267,"num_objects":16126,"num_object_clones":0,"num_object_copies":48378,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":17071,"num_write_kb":1060629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17045,"ondisk_log_size":17045,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":315452,"kb_used_data":195640,"kb_used_omap":0,"kb_used_meta":119744,"kb_avail":377171908,"statfs":{"total":386547056640,"available":386224033792,"internally_reserved":0,"allocated":200335360,"data_stored":3189736801,"data_compressed":151455667,"data_compressed_allocated":199352320,"data_compressed_original":3189391360,"omap_allocated":0,"internal_metadata":122617856},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":94109720,"num_objects":1437,"num_object_clones":0,"num_object_copies":4311,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2305,"num_write_kb":119681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002396"},"pg_stats":[{"pgid":"3.f","version":"27'1089","reported_seq":1125,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-22T03:50:59.974229+0000","last_change":"2024-09-22T03:49:25.167073+0000","last_active":"2024-09-22T03:50:59.974229+0000","last_peered":"2024-09-22T03:50:59.974229+0000","last_clean":"2024-09-22T03:50:59.974229+0000","last_became_active":"2024-09-22T03:49:25.159818+0000","last_became_peered":"2024-09-22T03:49:25.159818+0000","last_unstale":"2024-09-22T03:50:59.974229+0000","last_undegraded":"2024-09-22T03:50:59.974229+0000","last_fullsized":"2024-09-22T03:50:59.974229+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1089,"log_dups_size":0,"ondisk_log_size":1089,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65863680,"num_objects":1005,"num_object_clones":0,"num_object_copies":3015,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1089,"num_write_kb":67008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"27'1053","reported_seq":1089,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-22T03:50:56.024116+0000","last_change":"2024-09-22T03:49:25.238720+0000","last_active":"2024-09-22T03:50:56.024116+0000","last_peered":"2024-09-22T03:50:56.024116+0000","last_clean":"2024-09-22T03:50:56.024116+0000","last_became_active":"2024-09-22T03:49:25.229005+0000","last_became_peered":"2024-09-22T03:49:25.229005+0000","last_unstale":"2024-09-22T03:50:56.024116+0000","last_undegraded":"2024-09-22T03:50:56.024116+0000","last_fullsized":"2024-09-22T03:50:56.024116+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1053,"log_dups_size":0,"ondisk_log_size":1053,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69009408,"num_objects":1053,"num_object_clones":0,"num_object_copies":3159,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1053,"num_write_kb":67392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"27'1108","reported_seq":1145,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-22T03:50:59.863228+0000","last_change":"2024-09-22T03:49:25.173605+0000","last_active":"2024-09-22T03:50:59.863228+0000","last_peered":"2024-09-22T03:50:59.863228+0000","last_clean":"2024-09-22T03:50:59.863228+0000","last_became_active":"2024-09-22T03:49:25.165491+0000","last_became_peered":"2024-09-22T03:49:25.165491+0000","last_unstale":"2024-09-22T03:50:59.863228+0000","last_undegraded":"2024-09-22T03:50:59.863228+0000","last_fullsized":"2024-09-22T03:50:59.863228+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1108,"log_dups_size":0,"ondisk_log_size":1108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67043352,"num_objects":1024,"num_object_clones":0,"num_object_copies":3072,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1108,"num_write_kb":68161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"27'1033","reported_seq":1069,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-22T03:50:59.951608+0000","last_change":"2024-09-22T03:49:25.207920+0000","last_active":"2024-09-22T03:50:59.951608+0000","last_peered":"2024-09-22T03:50:59.951608+0000","last_clean":"2024-09-22T03:50:59.951608+0000","last_became_active":"2024-09-22T03:49:25.198168+0000","last_became_peered":"2024-09-22T03:49:25.198168+0000","last_unstale":"2024-09-22T03:50:59.951608+0000","last_undegraded":"2024-09-22T03:50:59.951608+0000","last_fullsized":"2024-09-22T03:50:59.951608+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1033,"log_dups_size":0,"ondisk_log_size":1033,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63635456,"num_objects":971,"num_object_clones":0,"num_object_copies":2913,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1033,"num_write_kb":64128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"27'1030","reported_seq":1066,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-22T03:50:55.976482+0000","last_change":"2024-09-22T03:49:25.280543+0000","last_active":"2024-09-22T03:50:55.976482+0000","last_peered":"2024-09-22T03:50:55.976482+0000","last_clean":"2024-09-22T03:50:55.976482+0000","last_became_active":"2024-09-22T03:49:25.268731+0000","last_became_peered":"2024-09-22T03:49:25.268731+0000","last_unstale":"2024-09-22T03:50:55.976482+0000","last_undegraded":"2024-09-22T03:50:55.976482+0000","last_fullsized":"2024-09-22T03:50:55.976482+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1030,"log_dups_size":0,"ondisk_log_size":1030,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67502080,"num_objects":1030,"num_object_clones":0,"num_object_copies":3090,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1030,"num_write_kb":65920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"27'1066","reported_seq":1102,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-22T03:50:59.864426+0000","last_change":"2024-09-22T03:49:25.206225+0000","last_active":"2024-09-22T03:50:59.864426+0000","last_peered":"2024-09-22T03:50:59.864426+0000","last_clean":"2024-09-22T03:50:59.864426+0000","last_became_active":"2024-09-22T03:49:25.201227+0000","last_became_peered":"2024-09-22T03:49:25.201227+0000","last_unstale":"2024-09-22T03:50:59.864426+0000","last_undegraded":"2024-09-22T03:50:59.864426+0000","last_fullsized":"2024-09-22T03:50:59.864426+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1066,"log_dups_size":0,"ondisk_log_size":1066,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63963136,"num_objects":976,"num_object_clones":0,"num_object_copies":2928,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1066,"num_write_kb":65344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"27'1091","reported_seq":1127,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-22T03:50:59.929937+0000","last_change":"2024-09-22T03:49:25.212585+0000","last_active":"2024-09-22T03:50:59.929937+0000","last_peered":"2024-09-22T03:50:59.929937+0000","last_clean":"2024-09-22T03:50:59.929937+0000","last_became_active":"2024-09-22T03:49:25.203356+0000","last_became_peered":"2024-09-22T03:49:25.203356+0000","last_unstale":"2024-09-22T03:50:59.929937+0000","last_undegraded":"2024-09-22T03:50:59.929937+0000","last_fullsized":"2024-09-22T03:50:59.929937+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1091,"log_dups_size":0,"ondisk_log_size":1091,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65601536,"num_objects":1001,"num_object_clones":0,"num_object_copies":3003,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1091,"num_write_kb":66944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"27'1091","reported_seq":1127,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-22T03:50:59.740769+0000","last_change":"2024-09-22T03:49:25.177465+0000","last_active":"2024-09-22T03:50:59.740769+0000","last_peered":"2024-09-22T03:50:59.740769+0000","last_clean":"2024-09-22T03:50:59.740769+0000","last_became_active":"2024-09-22T03:49:25.170026+0000","last_became_peered":"2024-09-22T03:49:25.170026+0000","last_unstale":"2024-09-22T03:50:59.740769+0000","last_undegraded":"2024-09-22T03:50:59.740769+0000","last_fullsized":"2024-09-22T03:50:59.740769+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1091,"log_dups_size":0,"ondisk_log_size":1091,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66387968,"num_objects":1013,"num_object_clones":0,"num_object_copies":3039,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1091,"num_write_kb":67328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":124,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-22T03:50:35.728055+0000","last_change":"2024-09-22T03:49:12.034704+0000","last_active":"2024-09-22T03:50:35.728055+0000","last_peered":"2024-09-22T03:50:35.728055+0000","last_clean":"2024-09-22T03:50:35.728055+0000","last_became_active":"2024-09-22T03:49:12.027470+0000","last_became_peered":"2024-09-22T03:49:12.027470+0000","last_unstale":"2024-09-22T03:50:35.728055+0000","last_undegraded":"2024-09-22T03:50:35.728055+0000","last_fullsized":"2024-09-22T03:50:35.728055+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_clean_scrub_stamp":"2024-09-22T03:49:10.979949+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-22T03:50:35.727762+0000","last_change":"2024-09-22T03:49:17.031458+0000","last_active":"2024-09-22T03:50:35.727762+0000","last_peered":"2024-09-22T03:50:35.727762+0000","last_clean":"2024-09-22T03:50:35.727762+0000","last_became_active":"2024-09-22T03:49:15.125490+0000","last_became_peered":"2024-09-22T03:49:15.125490+0000","last_unstale":"2024-09-22T03:50:35.727762+0000","last_undegraded":"2024-09-22T03:50:35.727762+0000","last_fullsized":"2024-09-22T03:50:35.727762+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"27'1042","reported_seq":1078,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-22T03:50:59.815712+0000","last_change":"2024-09-22T03:49:25.226827+0000","last_active":"2024-09-22T03:50:59.815712+0000","last_peered":"2024-09-22T03:50:59.815712+0000","last_clean":"2024-09-22T03:50:59.815712+0000","last_became_active":"2024-09-22T03:49:25.218579+0000","last_became_peered":"2024-09-22T03:49:25.218579+0000","last_unstale":"2024-09-22T03:50:59.815712+0000","last_undegraded":"2024-09-22T03:50:59.815712+0000","last_fullsized":"2024-09-22T03:50:59.815712+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1042,"log_dups_size":0,"ondisk_log_size":1042,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62128128,"num_objects":948,"num_object_clones":0,"num_object_copies":2844,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1042,"num_write_kb":63680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-22T03:50:35.725927+0000","last_change":"2024-09-22T03:49:17.029339+0000","last_active":"2024-09-22T03:50:35.725927+0000","last_peered":"2024-09-22T03:50:35.725927+0000","last_clean":"2024-09-22T03:50:35.725927+0000","last_became_active":"2024-09-22T03:49:15.097304+0000","last_became_peered":"2024-09-22T03:49:15.097304+0000","last_unstale":"2024-09-22T03:50:35.725927+0000","last_undegraded":"2024-09-22T03:50:35.725927+0000","last_fullsized":"2024-09-22T03:50:35.725927+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"27'1056","reported_seq":1092,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-22T03:50:59.611154+0000","last_change":"2024-09-22T03:49:25.208298+0000","last_active":"2024-09-22T03:50:59.611154+0000","last_peered":"2024-09-22T03:50:59.611154+0000","last_clean":"2024-09-22T03:50:59.611154+0000","last_became_active":"2024-09-22T03:49:25.193750+0000","last_became_peered":"2024-09-22T03:49:25.193750+0000","last_unstale":"2024-09-22T03:50:59.611154+0000","last_undegraded":"2024-09-22T03:50:59.611154+0000","last_fullsized":"2024-09-22T03:50:59.611154+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1056,"log_dups_size":0,"ondisk_log_size":1056,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65536000,"num_objects":1000,"num_object_clones":0,"num_object_copies":3000,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1056,"num_write_kb":65792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-22T03:50:35.725860+0000","last_change":"2024-09-22T03:49:17.029349+0000","last_active":"2024-09-22T03:50:35.725860+0000","last_peered":"2024-09-22T03:50:35.725860+0000","last_clean":"2024-09-22T03:50:35.725860+0000","last_became_active":"2024-09-22T03:49:15.094890+0000","last_became_peered":"2024-09-22T03:49:15.094890+0000","last_unstale":"2024-09-22T03:50:35.725860+0000","last_undegraded":"2024-09-22T03:50:35.725860+0000","last_fullsized":"2024-09-22T03:50:35.725860+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"27'1067","reported_seq":1103,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-22T03:50:55.478212+0000","last_change":"2024-09-22T03:49:25.226551+0000","last_active":"2024-09-22T03:50:55.478212+0000","last_peered":"2024-09-22T03:50:55.478212+0000","last_clean":"2024-09-22T03:50:55.478212+0000","last_became_active":"2024-09-22T03:49:25.213989+0000","last_became_peered":"2024-09-22T03:49:25.213989+0000","last_unstale":"2024-09-22T03:50:55.478212+0000","last_undegraded":"2024-09-22T03:50:55.478212+0000","last_fullsized":"2024-09-22T03:50:55.478212+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1067,"log_dups_size":0,"ondisk_log_size":1067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69926912,"num_objects":1067,"num_object_clones":0,"num_object_copies":3201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1067,"num_write_kb":68288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-22T03:50:35.728288+0000","last_change":"2024-09-22T03:49:17.031466+0000","last_active":"2024-09-22T03:50:35.728288+0000","last_peered":"2024-09-22T03:50:35.728288+0000","last_clean":"2024-09-22T03:50:35.728288+0000","last_became_active":"2024-09-22T03:49:15.098420+0000","last_became_peered":"2024-09-22T03:49:15.098420+0000","last_unstale":"2024-09-22T03:50:35.728288+0000","last_undegraded":"2024-09-22T03:50:35.728288+0000","last_fullsized":"2024-09-22T03:50:35.728288+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"27'1051","reported_seq":1087,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-22T03:50:59.818368+0000","last_change":"2024-09-22T03:49:25.163198+0000","last_active":"2024-09-22T03:50:59.818368+0000","last_peered":"2024-09-22T03:50:59.818368+0000","last_clean":"2024-09-22T03:50:59.818368+0000","last_became_active":"2024-09-22T03:49:25.145723+0000","last_became_peered":"2024-09-22T03:49:25.145723+0000","last_unstale":"2024-09-22T03:50:59.818368+0000","last_undegraded":"2024-09-22T03:50:59.818368+0000","last_fullsized":"2024-09-22T03:50:59.818368+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1051,"log_dups_size":0,"ondisk_log_size":1051,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63635456,"num_objects":971,"num_object_clones":0,"num_object_copies":2913,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1051,"num_write_kb":64704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"27'1078","reported_seq":1114,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-22T03:50:59.983267+0000","last_change":"2024-09-22T03:49:25.168751+0000","last_active":"2024-09-22T03:50:59.983267+0000","last_peered":"2024-09-22T03:50:59.983267+0000","last_clean":"2024-09-22T03:50:59.983267+0000","last_became_active":"2024-09-22T03:49:25.160072+0000","last_became_peered":"2024-09-22T03:49:25.160072+0000","last_unstale":"2024-09-22T03:50:59.983267+0000","last_undegraded":"2024-09-22T03:50:59.983267+0000","last_fullsized":"2024-09-22T03:50:59.983267+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1078,"log_dups_size":0,"ondisk_log_size":1078,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65404928,"num_objects":998,"num_object_clones":0,"num_object_copies":2994,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1078,"num_write_kb":66432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-22T03:50:35.738700+0000","last_change":"2024-09-22T03:49:17.036954+0000","last_active":"2024-09-22T03:50:35.738700+0000","last_peered":"2024-09-22T03:50:35.738700+0000","last_clean":"2024-09-22T03:50:35.738700+0000","last_became_active":"2024-09-22T03:49:15.110506+0000","last_became_peered":"2024-09-22T03:49:15.110506+0000","last_unstale":"2024-09-22T03:50:35.738700+0000","last_undegraded":"2024-09-22T03:50:35.738700+0000","last_fullsized":"2024-09-22T03:50:35.738700+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"27'1037","reported_seq":1073,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-22T03:50:55.925449+0000","last_change":"2024-09-22T03:49:25.218967+0000","last_active":"2024-09-22T03:50:55.925449+0000","last_peered":"2024-09-22T03:50:55.925449+0000","last_clean":"2024-09-22T03:50:55.925449+0000","last_became_active":"2024-09-22T03:49:25.203726+0000","last_became_peered":"2024-09-22T03:49:25.203726+0000","last_unstale":"2024-09-22T03:50:55.925449+0000","last_undegraded":"2024-09-22T03:50:55.925449+0000","last_fullsized":"2024-09-22T03:50:55.925449+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1037,"log_dups_size":0,"ondisk_log_size":1037,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67960832,"num_objects":1037,"num_object_clones":0,"num_object_copies":3111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1037,"num_write_kb":66368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-22T03:50:35.731503+0000","last_change":"2024-09-22T03:49:17.032989+0000","last_active":"2024-09-22T03:50:35.731503+0000","last_peered":"2024-09-22T03:50:35.731503+0000","last_clean":"2024-09-22T03:50:35.731503+0000","last_became_active":"2024-09-22T03:49:15.079260+0000","last_became_peered":"2024-09-22T03:49:15.079260+0000","last_unstale":"2024-09-22T03:50:35.731503+0000","last_undegraded":"2024-09-22T03:50:35.731503+0000","last_fullsized":"2024-09-22T03:50:35.731503+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"27'1023","reported_seq":1059,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-22T03:50:55.950233+0000","last_change":"2024-09-22T03:49:25.275215+0000","last_active":"2024-09-22T03:50:55.950233+0000","last_peered":"2024-09-22T03:50:55.950233+0000","last_clean":"2024-09-22T03:50:55.950233+0000","last_became_active":"2024-09-22T03:49:25.260843+0000","last_became_peered":"2024-09-22T03:49:25.260843+0000","last_unstale":"2024-09-22T03:50:55.950233+0000","last_undegraded":"2024-09-22T03:50:55.950233+0000","last_fullsized":"2024-09-22T03:50:55.950233+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1023,"log_dups_size":0,"ondisk_log_size":1023,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67043328,"num_objects":1023,"num_object_clones":0,"num_object_copies":3069,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1023,"num_write_kb":65472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-22T03:50:35.746045+0000","last_change":"2024-09-22T03:49:17.036402+0000","last_active":"2024-09-22T03:50:35.746045+0000","last_peered":"2024-09-22T03:50:35.746045+0000","last_clean":"2024-09-22T03:50:35.746045+0000","last_became_active":"2024-09-22T03:49:15.108430+0000","last_became_peered":"2024-09-22T03:49:15.108430+0000","last_unstale":"2024-09-22T03:50:35.746045+0000","last_undegraded":"2024-09-22T03:50:35.746045+0000","last_fullsized":"2024-09-22T03:50:35.746045+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"27'1075","reported_seq":1111,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-22T03:50:59.922063+0000","last_change":"2024-09-22T03:49:25.211493+0000","last_active":"2024-09-22T03:50:59.922063+0000","last_peered":"2024-09-22T03:50:59.922063+0000","last_clean":"2024-09-22T03:50:59.922063+0000","last_became_active":"2024-09-22T03:49:25.194855+0000","last_became_peered":"2024-09-22T03:49:25.194855+0000","last_unstale":"2024-09-22T03:50:59.922063+0000","last_undegraded":"2024-09-22T03:50:59.922063+0000","last_fullsized":"2024-09-22T03:50:59.922063+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1075,"log_dups_size":0,"ondisk_log_size":1075,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65863680,"num_objects":1005,"num_object_clones":0,"num_object_copies":3015,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1075,"num_write_kb":66560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-22T03:50:35.729150+0000","last_change":"2024-09-22T03:49:17.029128+0000","last_active":"2024-09-22T03:50:35.729150+0000","last_peered":"2024-09-22T03:50:35.729150+0000","last_clean":"2024-09-22T03:50:35.729150+0000","last_became_active":"2024-09-22T03:49:15.113396+0000","last_became_peered":"2024-09-22T03:49:15.113396+0000","last_unstale":"2024-09-22T03:50:35.729150+0000","last_undegraded":"2024-09-22T03:50:35.729150+0000","last_fullsized":"2024-09-22T03:50:35.729150+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":1056505880,"num_objects":16122,"num_object_clones":0,"num_object_copies":48366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":16990,"num_write_kb":1059521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":198082560,"data_stored":3169189936,"data_compressed":150488313,"data_compressed_allocated":198074368,"data_compressed_original":3169189888,"omap_allocated":0,"internal_metadata":0},"log_size":16990,"ondisk_log_size":16990,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949673064,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":80396,"kb_used_data":53564,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94291444,"statfs":{"total":96636764160,"available":96554438656,"internally_reserved":0,"allocated":54849536,"data_stored":873603545,"data_compressed":41480978,"data_compressed_allocated":54599680,"data_compressed_original":873512960,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654705773,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":75340,"kb_used_data":48508,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94296500,"statfs":{"total":96636764160,"available":96559616000,"internally_reserved":0,"allocated":49672192,"data_stored":791093201,"data_compressed":37561406,"data_compressed_allocated":49438720,"data_compressed_original":791019520,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705773,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":75772,"kb_used_data":40620,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94296068,"statfs":{"total":96636764160,"available":96559173632,"internally_reserved":0,"allocated":41594880,"data_stored":661529049,"data_compressed":31411084,"data_compressed_allocated":41345024,"data_compressed_original":661438464,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705773,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":83944,"kb_used_data":52948,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94287896,"statfs":{"total":96636764160,"available":96550805504,"internally_reserved":0,"allocated":54218752,"data_stored":863511006,"data_compressed":41002199,"data_compressed_allocated":53968896,"data_compressed_original":863420416,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":53391360,"data_stored":854196248,"data_compressed":40561491,"data_compressed_allocated":53387264,"data_compressed_original":854196224,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":55033856,"data_stored":880541696,"data_compressed":41811914,"data_compressed_allocated":55033856,"data_compressed_original":880541696,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40796160,"data_stored":652738560,"data_compressed":30995264,"data_compressed_allocated":40796160,"data_compressed_original":652738560,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":48861184,"data_stored":781713432,"data_compressed":37119644,"data_compressed_allocated":48857088,"data_compressed_original":781713408,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:51:03.588 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:51:03.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:51:03.757+0000 7fe114751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:03.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:51:03.766+0000 7fe114751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:06.150 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:51:06.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:51:06.286+0000 7ff138951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:06.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:51:06.295+0000 7ff138951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:06.838 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:51:06.838 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-22T03:51:06.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:51:06.988+0000 7f4912191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:07.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:51:07.010+0000 7f4912191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:07.677 INFO:teuthology.orchestra.run.smithi037.stderr:reweighted osd.0 to 1 (10000) 2024-09-22T03:51:07.697 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-22T03:51:07.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:51:07.843+0000 7ff89a4d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:07.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:51:07.863+0000 7ff89a4d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:08.684 INFO:teuthology.orchestra.run.smithi037.stderr:reweighted osd.1 to 1 (10000) 2024-09-22T03:51:08.705 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-22T03:51:08.761 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:51:08.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:51:08.858+0000 7f35f7191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:08.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:51:08.884+0000 7f35f7191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:08.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:51:08.943+0000 7f2e1c911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:08.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:51:08.956+0000 7f2e1c911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:09.691 INFO:teuthology.orchestra.run.smithi037.stderr:reweighted osd.2 to 1 (10000) 2024-09-22T03:51:09.710 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-22T03:51:09.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:51:09.864+0000 7f0fe52bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:09.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:51:09.885+0000 7f0fe52bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:10.700 INFO:teuthology.orchestra.run.smithi037.stderr:reweighted osd.3 to 1 (10000) 2024-09-22T03:51:10.724 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-22T03:51:10.724 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:51:10.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:51:10.895+0000 7f9e9ccd1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:10.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:51:10.910+0000 7f9e9ccd1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:11.318 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:51:11.319 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-22T03:51:11.342 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":85,"stamp":"2024-09-22T03:51:10.987466+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":934871627,"num_objects":14261,"num_object_clones":0,"num_object_copies":42783,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":18944,"num_write_kb":1060885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18918,"ondisk_log_size":18918,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":314328,"kb_used_data":173712,"kb_used_omap":0,"kb_used_meta":140544,"kb_avail":377173032,"statfs":{"total":386547056640,"available":386225184768,"internally_reserved":0,"allocated":177881088,"data_stored":2829636143,"data_compressed":134357405,"data_compressed_allocated":176844800,"data_compressed_original":2829271040,"omap_allocated":0,"internal_metadata":143917056},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-42795008,"num_objects":-653,"num_object_clones":0,"num_object_copies":-1959,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":653,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000730"},"pg_stats":[{"pgid":"3.f","version":"30'1210","reported_seq":1255,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-22T03:51:09.936882+0000","last_change":"2024-09-22T03:49:25.167073+0000","last_active":"2024-09-22T03:51:09.936882+0000","last_peered":"2024-09-22T03:51:09.936882+0000","last_clean":"2024-09-22T03:51:09.936882+0000","last_became_active":"2024-09-22T03:49:25.159818+0000","last_became_peered":"2024-09-22T03:49:25.159818+0000","last_unstale":"2024-09-22T03:51:09.936882+0000","last_undegraded":"2024-09-22T03:51:09.936882+0000","last_fullsized":"2024-09-22T03:51:09.936882+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1210,"log_dups_size":0,"ondisk_log_size":1210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57933824,"num_objects":884,"num_object_clones":0,"num_object_copies":2652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1210,"num_write_kb":67008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"27'1149","reported_seq":1185,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-22T03:51:05.940352+0000","last_change":"2024-09-22T03:49:25.238720+0000","last_active":"2024-09-22T03:51:05.940352+0000","last_peered":"2024-09-22T03:51:05.940352+0000","last_clean":"2024-09-22T03:51:05.940352+0000","last_became_active":"2024-09-22T03:49:25.229005+0000","last_became_peered":"2024-09-22T03:49:25.229005+0000","last_unstale":"2024-09-22T03:51:05.940352+0000","last_undegraded":"2024-09-22T03:51:05.940352+0000","last_fullsized":"2024-09-22T03:51:05.940352+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1149,"log_dups_size":0,"ondisk_log_size":1149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62980096,"num_objects":961,"num_object_clones":0,"num_object_copies":2883,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1149,"num_write_kb":67520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"30'1221","reported_seq":1267,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-22T03:51:09.858466+0000","last_change":"2024-09-22T03:49:25.173605+0000","last_active":"2024-09-22T03:51:09.858466+0000","last_peered":"2024-09-22T03:51:09.858466+0000","last_clean":"2024-09-22T03:51:09.858466+0000","last_became_active":"2024-09-22T03:49:25.165491+0000","last_became_peered":"2024-09-22T03:49:25.165491+0000","last_unstale":"2024-09-22T03:51:09.858466+0000","last_undegraded":"2024-09-22T03:51:09.858466+0000","last_fullsized":"2024-09-22T03:51:09.858466+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1221,"log_dups_size":0,"ondisk_log_size":1221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59637784,"num_objects":911,"num_object_clones":0,"num_object_copies":2733,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1221,"num_write_kb":68161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"30'1153","reported_seq":1198,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-22T03:51:09.951080+0000","last_change":"2024-09-22T03:49:25.207920+0000","last_active":"2024-09-22T03:51:09.951080+0000","last_peered":"2024-09-22T03:51:09.951080+0000","last_clean":"2024-09-22T03:51:09.951080+0000","last_became_active":"2024-09-22T03:49:25.198168+0000","last_became_peered":"2024-09-22T03:49:25.198168+0000","last_unstale":"2024-09-22T03:51:09.951080+0000","last_undegraded":"2024-09-22T03:51:09.951080+0000","last_fullsized":"2024-09-22T03:51:09.951080+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1153,"log_dups_size":0,"ondisk_log_size":1153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55771136,"num_objects":851,"num_object_clones":0,"num_object_copies":2553,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1153,"num_write_kb":64128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"27'1141","reported_seq":1177,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-22T03:51:06.080410+0000","last_change":"2024-09-22T03:49:25.280543+0000","last_active":"2024-09-22T03:51:06.080410+0000","last_peered":"2024-09-22T03:51:06.080410+0000","last_clean":"2024-09-22T03:51:06.080410+0000","last_became_active":"2024-09-22T03:49:25.268731+0000","last_became_peered":"2024-09-22T03:49:25.268731+0000","last_unstale":"2024-09-22T03:51:06.080410+0000","last_undegraded":"2024-09-22T03:51:06.080410+0000","last_fullsized":"2024-09-22T03:51:06.080410+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1141,"log_dups_size":0,"ondisk_log_size":1141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60227584,"num_objects":919,"num_object_clones":0,"num_object_copies":2757,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1141,"num_write_kb":65920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"30'1189","reported_seq":1234,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-22T03:51:09.824277+0000","last_change":"2024-09-22T03:49:25.206225+0000","last_active":"2024-09-22T03:51:09.824277+0000","last_peered":"2024-09-22T03:51:09.824277+0000","last_clean":"2024-09-22T03:51:09.824277+0000","last_became_active":"2024-09-22T03:49:25.201227+0000","last_became_peered":"2024-09-22T03:49:25.201227+0000","last_unstale":"2024-09-22T03:51:09.824277+0000","last_undegraded":"2024-09-22T03:51:09.824277+0000","last_fullsized":"2024-09-22T03:51:09.824277+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1189,"log_dups_size":0,"ondisk_log_size":1189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55902208,"num_objects":853,"num_object_clones":0,"num_object_copies":2559,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1189,"num_write_kb":65344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"30'1211","reported_seq":1256,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-22T03:51:09.911866+0000","last_change":"2024-09-22T03:49:25.212585+0000","last_active":"2024-09-22T03:51:09.911866+0000","last_peered":"2024-09-22T03:51:09.911866+0000","last_clean":"2024-09-22T03:51:09.911866+0000","last_became_active":"2024-09-22T03:49:25.203356+0000","last_became_peered":"2024-09-22T03:49:25.203356+0000","last_unstale":"2024-09-22T03:51:09.911866+0000","last_undegraded":"2024-09-22T03:51:09.911866+0000","last_fullsized":"2024-09-22T03:51:09.911866+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1211,"log_dups_size":0,"ondisk_log_size":1211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57737216,"num_objects":881,"num_object_clones":0,"num_object_copies":2643,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1211,"num_write_kb":66944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"30'1210","reported_seq":1255,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-22T03:51:09.716958+0000","last_change":"2024-09-22T03:49:25.177465+0000","last_active":"2024-09-22T03:51:09.716958+0000","last_peered":"2024-09-22T03:51:09.716958+0000","last_clean":"2024-09-22T03:51:09.716958+0000","last_became_active":"2024-09-22T03:49:25.170026+0000","last_became_peered":"2024-09-22T03:49:25.170026+0000","last_unstale":"2024-09-22T03:51:09.716958+0000","last_undegraded":"2024-09-22T03:51:09.716958+0000","last_fullsized":"2024-09-22T03:51:09.716958+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1210,"log_dups_size":0,"ondisk_log_size":1210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58589184,"num_objects":894,"num_object_clones":0,"num_object_copies":2682,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1210,"num_write_kb":67328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":124,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-22T03:50:35.728055+0000","last_change":"2024-09-22T03:49:12.034704+0000","last_active":"2024-09-22T03:50:35.728055+0000","last_peered":"2024-09-22T03:50:35.728055+0000","last_clean":"2024-09-22T03:50:35.728055+0000","last_became_active":"2024-09-22T03:49:12.027470+0000","last_became_peered":"2024-09-22T03:49:12.027470+0000","last_unstale":"2024-09-22T03:50:35.728055+0000","last_undegraded":"2024-09-22T03:50:35.728055+0000","last_fullsized":"2024-09-22T03:50:35.728055+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_clean_scrub_stamp":"2024-09-22T03:49:10.979949+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":59,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-22T03:51:09.715305+0000","last_change":"2024-09-22T03:49:17.031458+0000","last_active":"2024-09-22T03:51:09.715305+0000","last_peered":"2024-09-22T03:51:09.715305+0000","last_clean":"2024-09-22T03:51:09.715305+0000","last_became_active":"2024-09-22T03:49:15.125490+0000","last_became_peered":"2024-09-22T03:49:15.125490+0000","last_unstale":"2024-09-22T03:51:09.715305+0000","last_undegraded":"2024-09-22T03:51:09.715305+0000","last_fullsized":"2024-09-22T03:51:09.715305+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"30'1165","reported_seq":1210,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-22T03:51:09.931676+0000","last_change":"2024-09-22T03:49:25.226827+0000","last_active":"2024-09-22T03:51:09.931676+0000","last_peered":"2024-09-22T03:51:09.931676+0000","last_clean":"2024-09-22T03:51:09.931676+0000","last_became_active":"2024-09-22T03:49:25.218579+0000","last_became_peered":"2024-09-22T03:49:25.218579+0000","last_unstale":"2024-09-22T03:51:09.931676+0000","last_undegraded":"2024-09-22T03:51:09.931676+0000","last_fullsized":"2024-09-22T03:51:09.931676+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1165,"log_dups_size":0,"ondisk_log_size":1165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54067200,"num_objects":825,"num_object_clones":0,"num_object_copies":2475,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1165,"num_write_kb":63680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":58,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-22T03:51:09.710867+0000","last_change":"2024-09-22T03:49:17.029339+0000","last_active":"2024-09-22T03:51:09.710867+0000","last_peered":"2024-09-22T03:51:09.710867+0000","last_clean":"2024-09-22T03:51:09.710867+0000","last_became_active":"2024-09-22T03:49:15.097304+0000","last_became_peered":"2024-09-22T03:49:15.097304+0000","last_unstale":"2024-09-22T03:51:09.710867+0000","last_undegraded":"2024-09-22T03:51:09.710867+0000","last_fullsized":"2024-09-22T03:51:09.710867+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"30'1168","reported_seq":1213,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-22T03:51:09.801787+0000","last_change":"2024-09-22T03:49:25.208298+0000","last_active":"2024-09-22T03:51:09.801787+0000","last_peered":"2024-09-22T03:51:09.801787+0000","last_clean":"2024-09-22T03:51:09.801787+0000","last_became_active":"2024-09-22T03:49:25.193750+0000","last_became_peered":"2024-09-22T03:49:25.193750+0000","last_unstale":"2024-09-22T03:51:09.801787+0000","last_undegraded":"2024-09-22T03:51:09.801787+0000","last_fullsized":"2024-09-22T03:51:09.801787+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1168,"log_dups_size":0,"ondisk_log_size":1168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58195968,"num_objects":888,"num_object_clones":0,"num_object_copies":2664,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1168,"num_write_kb":65792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":58,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-22T03:51:09.728773+0000","last_change":"2024-09-22T03:49:17.029349+0000","last_active":"2024-09-22T03:51:09.728773+0000","last_peered":"2024-09-22T03:51:09.728773+0000","last_clean":"2024-09-22T03:51:09.728773+0000","last_became_active":"2024-09-22T03:49:15.094890+0000","last_became_peered":"2024-09-22T03:49:15.094890+0000","last_unstale":"2024-09-22T03:51:09.728773+0000","last_undegraded":"2024-09-22T03:51:09.728773+0000","last_fullsized":"2024-09-22T03:51:09.728773+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"27'1186","reported_seq":1222,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-22T03:51:05.935885+0000","last_change":"2024-09-22T03:49:25.226551+0000","last_active":"2024-09-22T03:51:05.935885+0000","last_peered":"2024-09-22T03:51:05.935885+0000","last_clean":"2024-09-22T03:51:05.935885+0000","last_became_active":"2024-09-22T03:49:25.213989+0000","last_became_peered":"2024-09-22T03:49:25.213989+0000","last_unstale":"2024-09-22T03:51:05.935885+0000","last_undegraded":"2024-09-22T03:51:05.935885+0000","last_fullsized":"2024-09-22T03:51:05.935885+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1186,"log_dups_size":0,"ondisk_log_size":1186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62390272,"num_objects":952,"num_object_clones":0,"num_object_copies":2856,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1186,"num_write_kb":68416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":60,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-22T03:51:09.718146+0000","last_change":"2024-09-22T03:49:17.031466+0000","last_active":"2024-09-22T03:51:09.718146+0000","last_peered":"2024-09-22T03:51:09.718146+0000","last_clean":"2024-09-22T03:51:09.718146+0000","last_became_active":"2024-09-22T03:49:15.098420+0000","last_became_peered":"2024-09-22T03:49:15.098420+0000","last_unstale":"2024-09-22T03:51:09.718146+0000","last_undegraded":"2024-09-22T03:51:09.718146+0000","last_fullsized":"2024-09-22T03:51:09.718146+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"30'1173","reported_seq":1218,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-22T03:51:09.757034+0000","last_change":"2024-09-22T03:49:25.163198+0000","last_active":"2024-09-22T03:51:09.757034+0000","last_peered":"2024-09-22T03:51:09.757034+0000","last_clean":"2024-09-22T03:51:09.757034+0000","last_became_active":"2024-09-22T03:49:25.145723+0000","last_became_peered":"2024-09-22T03:49:25.145723+0000","last_unstale":"2024-09-22T03:51:09.757034+0000","last_undegraded":"2024-09-22T03:51:09.757034+0000","last_fullsized":"2024-09-22T03:51:09.757034+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1173,"log_dups_size":0,"ondisk_log_size":1173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55640064,"num_objects":849,"num_object_clones":0,"num_object_copies":2547,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1173,"num_write_kb":64704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"30'1194","reported_seq":1239,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-22T03:51:10.008829+0000","last_change":"2024-09-22T03:49:25.168751+0000","last_active":"2024-09-22T03:51:10.008829+0000","last_peered":"2024-09-22T03:51:10.008829+0000","last_clean":"2024-09-22T03:51:10.008829+0000","last_became_active":"2024-09-22T03:49:25.160072+0000","last_became_peered":"2024-09-22T03:49:25.160072+0000","last_unstale":"2024-09-22T03:51:10.008829+0000","last_undegraded":"2024-09-22T03:51:10.008829+0000","last_fullsized":"2024-09-22T03:51:10.008829+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1194,"log_dups_size":0,"ondisk_log_size":1194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57802752,"num_objects":882,"num_object_clones":0,"num_object_copies":2646,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1194,"num_write_kb":66432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-22T03:50:35.738700+0000","last_change":"2024-09-22T03:49:17.036954+0000","last_active":"2024-09-22T03:50:35.738700+0000","last_peered":"2024-09-22T03:50:35.738700+0000","last_clean":"2024-09-22T03:50:35.738700+0000","last_became_active":"2024-09-22T03:49:15.110506+0000","last_became_peered":"2024-09-22T03:49:15.110506+0000","last_unstale":"2024-09-22T03:50:35.738700+0000","last_undegraded":"2024-09-22T03:50:35.738700+0000","last_fullsized":"2024-09-22T03:50:35.738700+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"27'1154","reported_seq":1190,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-22T03:51:05.876564+0000","last_change":"2024-09-22T03:49:25.218967+0000","last_active":"2024-09-22T03:51:05.876564+0000","last_peered":"2024-09-22T03:51:05.876564+0000","last_clean":"2024-09-22T03:51:05.876564+0000","last_became_active":"2024-09-22T03:49:25.203726+0000","last_became_peered":"2024-09-22T03:49:25.203726+0000","last_unstale":"2024-09-22T03:51:05.876564+0000","last_undegraded":"2024-09-22T03:51:05.876564+0000","last_fullsized":"2024-09-22T03:51:05.876564+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1154,"log_dups_size":0,"ondisk_log_size":1154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60293120,"num_objects":920,"num_object_clones":0,"num_object_copies":2760,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1154,"num_write_kb":66368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-22T03:50:35.731503+0000","last_change":"2024-09-22T03:49:17.032989+0000","last_active":"2024-09-22T03:50:35.731503+0000","last_peered":"2024-09-22T03:50:35.731503+0000","last_clean":"2024-09-22T03:50:35.731503+0000","last_became_active":"2024-09-22T03:49:15.079260+0000","last_became_peered":"2024-09-22T03:49:15.079260+0000","last_unstale":"2024-09-22T03:50:35.731503+0000","last_undegraded":"2024-09-22T03:50:35.731503+0000","last_fullsized":"2024-09-22T03:50:35.731503+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"27'1131","reported_seq":1167,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-22T03:51:05.756489+0000","last_change":"2024-09-22T03:49:25.275215+0000","last_active":"2024-09-22T03:51:05.756489+0000","last_peered":"2024-09-22T03:51:05.756489+0000","last_clean":"2024-09-22T03:51:05.756489+0000","last_became_active":"2024-09-22T03:49:25.260843+0000","last_became_peered":"2024-09-22T03:49:25.260843+0000","last_unstale":"2024-09-22T03:51:05.756489+0000","last_undegraded":"2024-09-22T03:51:05.756489+0000","last_fullsized":"2024-09-22T03:51:05.756489+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1131,"log_dups_size":0,"ondisk_log_size":1131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59965440,"num_objects":915,"num_object_clones":0,"num_object_copies":2745,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1131,"num_write_kb":65472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-22T03:50:35.746045+0000","last_change":"2024-09-22T03:49:17.036402+0000","last_active":"2024-09-22T03:50:35.746045+0000","last_peered":"2024-09-22T03:50:35.746045+0000","last_clean":"2024-09-22T03:50:35.746045+0000","last_became_active":"2024-09-22T03:49:15.108430+0000","last_became_peered":"2024-09-22T03:49:15.108430+0000","last_unstale":"2024-09-22T03:50:35.746045+0000","last_undegraded":"2024-09-22T03:50:35.746045+0000","last_fullsized":"2024-09-22T03:50:35.746045+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"30'1208","reported_seq":1253,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-22T03:51:09.879189+0000","last_change":"2024-09-22T03:49:25.211493+0000","last_active":"2024-09-22T03:51:09.879189+0000","last_peered":"2024-09-22T03:51:09.879189+0000","last_clean":"2024-09-22T03:51:09.879189+0000","last_became_active":"2024-09-22T03:49:25.194855+0000","last_became_peered":"2024-09-22T03:49:25.194855+0000","last_unstale":"2024-09-22T03:51:09.879189+0000","last_undegraded":"2024-09-22T03:51:09.879189+0000","last_fullsized":"2024-09-22T03:51:09.879189+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1208,"log_dups_size":0,"ondisk_log_size":1208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57147392,"num_objects":872,"num_object_clones":0,"num_object_copies":2616,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1208,"num_write_kb":66560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":58,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-22T03:51:09.710341+0000","last_change":"2024-09-22T03:49:17.029128+0000","last_active":"2024-09-22T03:51:09.710341+0000","last_peered":"2024-09-22T03:51:09.710341+0000","last_clean":"2024-09-22T03:51:09.710341+0000","last_became_active":"2024-09-22T03:49:15.113396+0000","last_became_peered":"2024-09-22T03:49:15.113396+0000","last_unstale":"2024-09-22T03:51:09.710341+0000","last_undegraded":"2024-09-22T03:51:09.710341+0000","last_fullsized":"2024-09-22T03:51:09.710341+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":934281240,"num_objects":14257,"num_object_clones":0,"num_object_copies":42771,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":18863,"num_write_kb":1059777,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":174862336,"data_stored":2797600840,"data_compressed":132845053,"data_compressed_allocated":174850048,"data_compressed_original":2797600768,"omap_allocated":0,"internal_metadata":0},"log_size":18863,"ondisk_log_size":18863,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949673074,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":83872,"kb_used_data":48720,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94287968,"statfs":{"total":96636764160,"available":96550879232,"internally_reserved":0,"allocated":49889280,"data_stored":794173937,"data_compressed":37710151,"data_compressed_allocated":49635328,"data_compressed_original":794083328,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654705783,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":73672,"kb_used_data":42680,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94298168,"statfs":{"total":96636764160,"available":96561324032,"internally_reserved":0,"allocated":43704320,"data_stored":695351651,"data_compressed":33015207,"data_compressed_allocated":43454464,"data_compressed_original":695271424,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705783,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":75016,"kb_used_data":35696,"kb_used_omap":0,"kb_used_meta":39296,"kb_avail":94296824,"statfs":{"total":96636764160,"available":96559947776,"internally_reserved":0,"allocated":36552704,"data_stored":580598635,"data_compressed":27568144,"data_compressed_allocated":36286464,"data_compressed_original":580501504,"omap_allocated":0,"internal_metadata":40239104},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705783,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":81768,"kb_used_data":46616,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94290072,"statfs":{"total":96636764160,"available":96553033728,"internally_reserved":0,"allocated":47734784,"data_stored":759511920,"data_compressed":36063903,"data_compressed_allocated":47468544,"data_compressed_original":759414784,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":46993408,"data_stored":751829016,"data_compressed":35700863,"data_compressed_allocated":46989312,"data_compressed_original":751828992,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":49049600,"data_stored":784728088,"data_compressed":37263087,"data_compressed_allocated":49045504,"data_compressed_original":784728064,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":35835904,"data_stored":573374464,"data_compressed":27226888,"data_compressed_allocated":35835904,"data_compressed_original":573374464,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":42983424,"data_stored":687669272,"data_compressed":32654215,"data_compressed_allocated":42979328,"data_compressed_original":687669248,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:51:11.343 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:51:11.511 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:51:11.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:51:11.522+0000 7f61e0d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:11.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:51:11.537+0000 7f61e0d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:11.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:51:11.692+0000 7fbef2f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:11.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:51:11.704+0000 7fbef2f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:11.858 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:51:11.859 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-22T03:51:11.876 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":85,"stamp":"2024-09-22T03:51:10.987466+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":934871627,"num_objects":14261,"num_object_clones":0,"num_object_copies":42783,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":18944,"num_write_kb":1060885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18918,"ondisk_log_size":18918,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":314328,"kb_used_data":173712,"kb_used_omap":0,"kb_used_meta":140544,"kb_avail":377173032,"statfs":{"total":386547056640,"available":386225184768,"internally_reserved":0,"allocated":177881088,"data_stored":2829636143,"data_compressed":134357405,"data_compressed_allocated":176844800,"data_compressed_original":2829271040,"omap_allocated":0,"internal_metadata":143917056},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-42795008,"num_objects":-653,"num_object_clones":0,"num_object_copies":-1959,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":653,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000730"},"pg_stats":[{"pgid":"3.f","version":"30'1210","reported_seq":1255,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-22T03:51:09.936882+0000","last_change":"2024-09-22T03:49:25.167073+0000","last_active":"2024-09-22T03:51:09.936882+0000","last_peered":"2024-09-22T03:51:09.936882+0000","last_clean":"2024-09-22T03:51:09.936882+0000","last_became_active":"2024-09-22T03:49:25.159818+0000","last_became_peered":"2024-09-22T03:49:25.159818+0000","last_unstale":"2024-09-22T03:51:09.936882+0000","last_undegraded":"2024-09-22T03:51:09.936882+0000","last_fullsized":"2024-09-22T03:51:09.936882+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1210,"log_dups_size":0,"ondisk_log_size":1210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57933824,"num_objects":884,"num_object_clones":0,"num_object_copies":2652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1210,"num_write_kb":67008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"27'1149","reported_seq":1185,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-22T03:51:05.940352+0000","last_change":"2024-09-22T03:49:25.238720+0000","last_active":"2024-09-22T03:51:05.940352+0000","last_peered":"2024-09-22T03:51:05.940352+0000","last_clean":"2024-09-22T03:51:05.940352+0000","last_became_active":"2024-09-22T03:49:25.229005+0000","last_became_peered":"2024-09-22T03:49:25.229005+0000","last_unstale":"2024-09-22T03:51:05.940352+0000","last_undegraded":"2024-09-22T03:51:05.940352+0000","last_fullsized":"2024-09-22T03:51:05.940352+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1149,"log_dups_size":0,"ondisk_log_size":1149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62980096,"num_objects":961,"num_object_clones":0,"num_object_copies":2883,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1149,"num_write_kb":67520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"30'1221","reported_seq":1267,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-22T03:51:09.858466+0000","last_change":"2024-09-22T03:49:25.173605+0000","last_active":"2024-09-22T03:51:09.858466+0000","last_peered":"2024-09-22T03:51:09.858466+0000","last_clean":"2024-09-22T03:51:09.858466+0000","last_became_active":"2024-09-22T03:49:25.165491+0000","last_became_peered":"2024-09-22T03:49:25.165491+0000","last_unstale":"2024-09-22T03:51:09.858466+0000","last_undegraded":"2024-09-22T03:51:09.858466+0000","last_fullsized":"2024-09-22T03:51:09.858466+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1221,"log_dups_size":0,"ondisk_log_size":1221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59637784,"num_objects":911,"num_object_clones":0,"num_object_copies":2733,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1221,"num_write_kb":68161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"30'1153","reported_seq":1198,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-22T03:51:09.951080+0000","last_change":"2024-09-22T03:49:25.207920+0000","last_active":"2024-09-22T03:51:09.951080+0000","last_peered":"2024-09-22T03:51:09.951080+0000","last_clean":"2024-09-22T03:51:09.951080+0000","last_became_active":"2024-09-22T03:49:25.198168+0000","last_became_peered":"2024-09-22T03:49:25.198168+0000","last_unstale":"2024-09-22T03:51:09.951080+0000","last_undegraded":"2024-09-22T03:51:09.951080+0000","last_fullsized":"2024-09-22T03:51:09.951080+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1153,"log_dups_size":0,"ondisk_log_size":1153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55771136,"num_objects":851,"num_object_clones":0,"num_object_copies":2553,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1153,"num_write_kb":64128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"27'1141","reported_seq":1177,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-22T03:51:06.080410+0000","last_change":"2024-09-22T03:49:25.280543+0000","last_active":"2024-09-22T03:51:06.080410+0000","last_peered":"2024-09-22T03:51:06.080410+0000","last_clean":"2024-09-22T03:51:06.080410+0000","last_became_active":"2024-09-22T03:49:25.268731+0000","last_became_peered":"2024-09-22T03:49:25.268731+0000","last_unstale":"2024-09-22T03:51:06.080410+0000","last_undegraded":"2024-09-22T03:51:06.080410+0000","last_fullsized":"2024-09-22T03:51:06.080410+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1141,"log_dups_size":0,"ondisk_log_size":1141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60227584,"num_objects":919,"num_object_clones":0,"num_object_copies":2757,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1141,"num_write_kb":65920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"30'1189","reported_seq":1234,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-22T03:51:09.824277+0000","last_change":"2024-09-22T03:49:25.206225+0000","last_active":"2024-09-22T03:51:09.824277+0000","last_peered":"2024-09-22T03:51:09.824277+0000","last_clean":"2024-09-22T03:51:09.824277+0000","last_became_active":"2024-09-22T03:49:25.201227+0000","last_became_peered":"2024-09-22T03:49:25.201227+0000","last_unstale":"2024-09-22T03:51:09.824277+0000","last_undegraded":"2024-09-22T03:51:09.824277+0000","last_fullsized":"2024-09-22T03:51:09.824277+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1189,"log_dups_size":0,"ondisk_log_size":1189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55902208,"num_objects":853,"num_object_clones":0,"num_object_copies":2559,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1189,"num_write_kb":65344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"30'1211","reported_seq":1256,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-22T03:51:09.911866+0000","last_change":"2024-09-22T03:49:25.212585+0000","last_active":"2024-09-22T03:51:09.911866+0000","last_peered":"2024-09-22T03:51:09.911866+0000","last_clean":"2024-09-22T03:51:09.911866+0000","last_became_active":"2024-09-22T03:49:25.203356+0000","last_became_peered":"2024-09-22T03:49:25.203356+0000","last_unstale":"2024-09-22T03:51:09.911866+0000","last_undegraded":"2024-09-22T03:51:09.911866+0000","last_fullsized":"2024-09-22T03:51:09.911866+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1211,"log_dups_size":0,"ondisk_log_size":1211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57737216,"num_objects":881,"num_object_clones":0,"num_object_copies":2643,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1211,"num_write_kb":66944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"30'1210","reported_seq":1255,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-22T03:51:09.716958+0000","last_change":"2024-09-22T03:49:25.177465+0000","last_active":"2024-09-22T03:51:09.716958+0000","last_peered":"2024-09-22T03:51:09.716958+0000","last_clean":"2024-09-22T03:51:09.716958+0000","last_became_active":"2024-09-22T03:49:25.170026+0000","last_became_peered":"2024-09-22T03:49:25.170026+0000","last_unstale":"2024-09-22T03:51:09.716958+0000","last_undegraded":"2024-09-22T03:51:09.716958+0000","last_fullsized":"2024-09-22T03:51:09.716958+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1210,"log_dups_size":0,"ondisk_log_size":1210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58589184,"num_objects":894,"num_object_clones":0,"num_object_copies":2682,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1210,"num_write_kb":67328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":124,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-22T03:50:35.728055+0000","last_change":"2024-09-22T03:49:12.034704+0000","last_active":"2024-09-22T03:50:35.728055+0000","last_peered":"2024-09-22T03:50:35.728055+0000","last_clean":"2024-09-22T03:50:35.728055+0000","last_became_active":"2024-09-22T03:49:12.027470+0000","last_became_peered":"2024-09-22T03:49:12.027470+0000","last_unstale":"2024-09-22T03:50:35.728055+0000","last_undegraded":"2024-09-22T03:50:35.728055+0000","last_fullsized":"2024-09-22T03:50:35.728055+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_clean_scrub_stamp":"2024-09-22T03:49:10.979949+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":59,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-22T03:51:09.715305+0000","last_change":"2024-09-22T03:49:17.031458+0000","last_active":"2024-09-22T03:51:09.715305+0000","last_peered":"2024-09-22T03:51:09.715305+0000","last_clean":"2024-09-22T03:51:09.715305+0000","last_became_active":"2024-09-22T03:49:15.125490+0000","last_became_peered":"2024-09-22T03:49:15.125490+0000","last_unstale":"2024-09-22T03:51:09.715305+0000","last_undegraded":"2024-09-22T03:51:09.715305+0000","last_fullsized":"2024-09-22T03:51:09.715305+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"30'1165","reported_seq":1210,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-22T03:51:09.931676+0000","last_change":"2024-09-22T03:49:25.226827+0000","last_active":"2024-09-22T03:51:09.931676+0000","last_peered":"2024-09-22T03:51:09.931676+0000","last_clean":"2024-09-22T03:51:09.931676+0000","last_became_active":"2024-09-22T03:49:25.218579+0000","last_became_peered":"2024-09-22T03:49:25.218579+0000","last_unstale":"2024-09-22T03:51:09.931676+0000","last_undegraded":"2024-09-22T03:51:09.931676+0000","last_fullsized":"2024-09-22T03:51:09.931676+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1165,"log_dups_size":0,"ondisk_log_size":1165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54067200,"num_objects":825,"num_object_clones":0,"num_object_copies":2475,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1165,"num_write_kb":63680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":58,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-22T03:51:09.710867+0000","last_change":"2024-09-22T03:49:17.029339+0000","last_active":"2024-09-22T03:51:09.710867+0000","last_peered":"2024-09-22T03:51:09.710867+0000","last_clean":"2024-09-22T03:51:09.710867+0000","last_became_active":"2024-09-22T03:49:15.097304+0000","last_became_peered":"2024-09-22T03:49:15.097304+0000","last_unstale":"2024-09-22T03:51:09.710867+0000","last_undegraded":"2024-09-22T03:51:09.710867+0000","last_fullsized":"2024-09-22T03:51:09.710867+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"30'1168","reported_seq":1213,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-22T03:51:09.801787+0000","last_change":"2024-09-22T03:49:25.208298+0000","last_active":"2024-09-22T03:51:09.801787+0000","last_peered":"2024-09-22T03:51:09.801787+0000","last_clean":"2024-09-22T03:51:09.801787+0000","last_became_active":"2024-09-22T03:49:25.193750+0000","last_became_peered":"2024-09-22T03:49:25.193750+0000","last_unstale":"2024-09-22T03:51:09.801787+0000","last_undegraded":"2024-09-22T03:51:09.801787+0000","last_fullsized":"2024-09-22T03:51:09.801787+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1168,"log_dups_size":0,"ondisk_log_size":1168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58195968,"num_objects":888,"num_object_clones":0,"num_object_copies":2664,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1168,"num_write_kb":65792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":58,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-22T03:51:09.728773+0000","last_change":"2024-09-22T03:49:17.029349+0000","last_active":"2024-09-22T03:51:09.728773+0000","last_peered":"2024-09-22T03:51:09.728773+0000","last_clean":"2024-09-22T03:51:09.728773+0000","last_became_active":"2024-09-22T03:49:15.094890+0000","last_became_peered":"2024-09-22T03:49:15.094890+0000","last_unstale":"2024-09-22T03:51:09.728773+0000","last_undegraded":"2024-09-22T03:51:09.728773+0000","last_fullsized":"2024-09-22T03:51:09.728773+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"27'1186","reported_seq":1222,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-22T03:51:05.935885+0000","last_change":"2024-09-22T03:49:25.226551+0000","last_active":"2024-09-22T03:51:05.935885+0000","last_peered":"2024-09-22T03:51:05.935885+0000","last_clean":"2024-09-22T03:51:05.935885+0000","last_became_active":"2024-09-22T03:49:25.213989+0000","last_became_peered":"2024-09-22T03:49:25.213989+0000","last_unstale":"2024-09-22T03:51:05.935885+0000","last_undegraded":"2024-09-22T03:51:05.935885+0000","last_fullsized":"2024-09-22T03:51:05.935885+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1186,"log_dups_size":0,"ondisk_log_size":1186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62390272,"num_objects":952,"num_object_clones":0,"num_object_copies":2856,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1186,"num_write_kb":68416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":60,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-22T03:51:09.718146+0000","last_change":"2024-09-22T03:49:17.031466+0000","last_active":"2024-09-22T03:51:09.718146+0000","last_peered":"2024-09-22T03:51:09.718146+0000","last_clean":"2024-09-22T03:51:09.718146+0000","last_became_active":"2024-09-22T03:49:15.098420+0000","last_became_peered":"2024-09-22T03:49:15.098420+0000","last_unstale":"2024-09-22T03:51:09.718146+0000","last_undegraded":"2024-09-22T03:51:09.718146+0000","last_fullsized":"2024-09-22T03:51:09.718146+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"30'1173","reported_seq":1218,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-22T03:51:09.757034+0000","last_change":"2024-09-22T03:49:25.163198+0000","last_active":"2024-09-22T03:51:09.757034+0000","last_peered":"2024-09-22T03:51:09.757034+0000","last_clean":"2024-09-22T03:51:09.757034+0000","last_became_active":"2024-09-22T03:49:25.145723+0000","last_became_peered":"2024-09-22T03:49:25.145723+0000","last_unstale":"2024-09-22T03:51:09.757034+0000","last_undegraded":"2024-09-22T03:51:09.757034+0000","last_fullsized":"2024-09-22T03:51:09.757034+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1173,"log_dups_size":0,"ondisk_log_size":1173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55640064,"num_objects":849,"num_object_clones":0,"num_object_copies":2547,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1173,"num_write_kb":64704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"30'1194","reported_seq":1239,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-22T03:51:10.008829+0000","last_change":"2024-09-22T03:49:25.168751+0000","last_active":"2024-09-22T03:51:10.008829+0000","last_peered":"2024-09-22T03:51:10.008829+0000","last_clean":"2024-09-22T03:51:10.008829+0000","last_became_active":"2024-09-22T03:49:25.160072+0000","last_became_peered":"2024-09-22T03:49:25.160072+0000","last_unstale":"2024-09-22T03:51:10.008829+0000","last_undegraded":"2024-09-22T03:51:10.008829+0000","last_fullsized":"2024-09-22T03:51:10.008829+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1194,"log_dups_size":0,"ondisk_log_size":1194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57802752,"num_objects":882,"num_object_clones":0,"num_object_copies":2646,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1194,"num_write_kb":66432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-22T03:50:35.738700+0000","last_change":"2024-09-22T03:49:17.036954+0000","last_active":"2024-09-22T03:50:35.738700+0000","last_peered":"2024-09-22T03:50:35.738700+0000","last_clean":"2024-09-22T03:50:35.738700+0000","last_became_active":"2024-09-22T03:49:15.110506+0000","last_became_peered":"2024-09-22T03:49:15.110506+0000","last_unstale":"2024-09-22T03:50:35.738700+0000","last_undegraded":"2024-09-22T03:50:35.738700+0000","last_fullsized":"2024-09-22T03:50:35.738700+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"27'1154","reported_seq":1190,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-22T03:51:05.876564+0000","last_change":"2024-09-22T03:49:25.218967+0000","last_active":"2024-09-22T03:51:05.876564+0000","last_peered":"2024-09-22T03:51:05.876564+0000","last_clean":"2024-09-22T03:51:05.876564+0000","last_became_active":"2024-09-22T03:49:25.203726+0000","last_became_peered":"2024-09-22T03:49:25.203726+0000","last_unstale":"2024-09-22T03:51:05.876564+0000","last_undegraded":"2024-09-22T03:51:05.876564+0000","last_fullsized":"2024-09-22T03:51:05.876564+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1154,"log_dups_size":0,"ondisk_log_size":1154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60293120,"num_objects":920,"num_object_clones":0,"num_object_copies":2760,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1154,"num_write_kb":66368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-22T03:50:35.731503+0000","last_change":"2024-09-22T03:49:17.032989+0000","last_active":"2024-09-22T03:50:35.731503+0000","last_peered":"2024-09-22T03:50:35.731503+0000","last_clean":"2024-09-22T03:50:35.731503+0000","last_became_active":"2024-09-22T03:49:15.079260+0000","last_became_peered":"2024-09-22T03:49:15.079260+0000","last_unstale":"2024-09-22T03:50:35.731503+0000","last_undegraded":"2024-09-22T03:50:35.731503+0000","last_fullsized":"2024-09-22T03:50:35.731503+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"27'1131","reported_seq":1167,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-22T03:51:05.756489+0000","last_change":"2024-09-22T03:49:25.275215+0000","last_active":"2024-09-22T03:51:05.756489+0000","last_peered":"2024-09-22T03:51:05.756489+0000","last_clean":"2024-09-22T03:51:05.756489+0000","last_became_active":"2024-09-22T03:49:25.260843+0000","last_became_peered":"2024-09-22T03:49:25.260843+0000","last_unstale":"2024-09-22T03:51:05.756489+0000","last_undegraded":"2024-09-22T03:51:05.756489+0000","last_fullsized":"2024-09-22T03:51:05.756489+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1131,"log_dups_size":0,"ondisk_log_size":1131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59965440,"num_objects":915,"num_object_clones":0,"num_object_copies":2745,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1131,"num_write_kb":65472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-22T03:50:35.746045+0000","last_change":"2024-09-22T03:49:17.036402+0000","last_active":"2024-09-22T03:50:35.746045+0000","last_peered":"2024-09-22T03:50:35.746045+0000","last_clean":"2024-09-22T03:50:35.746045+0000","last_became_active":"2024-09-22T03:49:15.108430+0000","last_became_peered":"2024-09-22T03:49:15.108430+0000","last_unstale":"2024-09-22T03:50:35.746045+0000","last_undegraded":"2024-09-22T03:50:35.746045+0000","last_fullsized":"2024-09-22T03:50:35.746045+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"30'1208","reported_seq":1253,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-22T03:51:09.879189+0000","last_change":"2024-09-22T03:49:25.211493+0000","last_active":"2024-09-22T03:51:09.879189+0000","last_peered":"2024-09-22T03:51:09.879189+0000","last_clean":"2024-09-22T03:51:09.879189+0000","last_became_active":"2024-09-22T03:49:25.194855+0000","last_became_peered":"2024-09-22T03:49:25.194855+0000","last_unstale":"2024-09-22T03:51:09.879189+0000","last_undegraded":"2024-09-22T03:51:09.879189+0000","last_fullsized":"2024-09-22T03:51:09.879189+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1208,"log_dups_size":0,"ondisk_log_size":1208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57147392,"num_objects":872,"num_object_clones":0,"num_object_copies":2616,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1208,"num_write_kb":66560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":58,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-22T03:51:09.710341+0000","last_change":"2024-09-22T03:49:17.029128+0000","last_active":"2024-09-22T03:51:09.710341+0000","last_peered":"2024-09-22T03:51:09.710341+0000","last_clean":"2024-09-22T03:51:09.710341+0000","last_became_active":"2024-09-22T03:49:15.113396+0000","last_became_peered":"2024-09-22T03:49:15.113396+0000","last_unstale":"2024-09-22T03:51:09.710341+0000","last_undegraded":"2024-09-22T03:51:09.710341+0000","last_fullsized":"2024-09-22T03:51:09.710341+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":934281240,"num_objects":14257,"num_object_clones":0,"num_object_copies":42771,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":18863,"num_write_kb":1059777,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":174862336,"data_stored":2797600840,"data_compressed":132845053,"data_compressed_allocated":174850048,"data_compressed_original":2797600768,"omap_allocated":0,"internal_metadata":0},"log_size":18863,"ondisk_log_size":18863,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949673074,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":83872,"kb_used_data":48720,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94287968,"statfs":{"total":96636764160,"available":96550879232,"internally_reserved":0,"allocated":49889280,"data_stored":794173937,"data_compressed":37710151,"data_compressed_allocated":49635328,"data_compressed_original":794083328,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654705783,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":73672,"kb_used_data":42680,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94298168,"statfs":{"total":96636764160,"available":96561324032,"internally_reserved":0,"allocated":43704320,"data_stored":695351651,"data_compressed":33015207,"data_compressed_allocated":43454464,"data_compressed_original":695271424,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705783,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":75016,"kb_used_data":35696,"kb_used_omap":0,"kb_used_meta":39296,"kb_avail":94296824,"statfs":{"total":96636764160,"available":96559947776,"internally_reserved":0,"allocated":36552704,"data_stored":580598635,"data_compressed":27568144,"data_compressed_allocated":36286464,"data_compressed_original":580501504,"omap_allocated":0,"internal_metadata":40239104},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705783,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":81768,"kb_used_data":46616,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94290072,"statfs":{"total":96636764160,"available":96553033728,"internally_reserved":0,"allocated":47734784,"data_stored":759511920,"data_compressed":36063903,"data_compressed_allocated":47468544,"data_compressed_original":759414784,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":46993408,"data_stored":751829016,"data_compressed":35700863,"data_compressed_allocated":46989312,"data_compressed_original":751828992,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":49049600,"data_stored":784728088,"data_compressed":37263087,"data_compressed_allocated":49045504,"data_compressed_original":784728064,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":35835904,"data_stored":573374464,"data_compressed":27226888,"data_compressed_allocated":35835904,"data_compressed_original":573374464,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":42983424,"data_stored":687669272,"data_compressed":32654215,"data_compressed_allocated":42979328,"data_compressed_original":687669248,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:51:11.878 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-22T03:51:11.878 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:51:11.878 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:51:11.878 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:51:12.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:51:12.085+0000 7f61e8991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:12.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:51:12.103+0000 7f61e8991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:12.151 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:51:12.151 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:51:12.151 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:51:12.151 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:51:12.151 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:51:12.151 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:51:12.151 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:51:12.151 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:51:12.151 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:51:12.151 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:51:12.152 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:51:12.152 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:51:12.156 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:51:12.156 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:51:12.156 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:51:12.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:51:12.362+0000 7faa728fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:12.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:51:12.376+0000 7faa728fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:12.670 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:51:12.670 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:51:12.671 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:51:12.671 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:51:12.671 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:51:12.671 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:51:12.671 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:51:12.671 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:51:12.671 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:51:12.671 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:51:12.671 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:51:12.671 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:51:12.675 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:51:12.675 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:51:12.676 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:51:12.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:51:12.832+0000 7f0c7cb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:12.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:51:12.851+0000 7f0c7cb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:12.884 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:51:12.884 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:51:12.885 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:51:12.885 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:51:12.885 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:51:12.885 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:51:12.885 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:51:12.885 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:51:12.885 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:51:12.885 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:51:12.885 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:51:12.885 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:51:12.888 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:51:12.888 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:51:12.889 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:51:13.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:51:13.065+0000 7fa028d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:13.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:51:13.083+0000 7fa028d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:13.109 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:51:13.109 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:51:13.109 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:51:13.109 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:51:13.109 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:51:13.109 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:51:13.109 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:51:13.109 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:51:13.109 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:51:13.109 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:51:13.109 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:51:13.109 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:51:13.113 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:51:13.114 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:51:14.155 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:51:14.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:51:14.307+0000 7fe457391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:14.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:51:14.320+0000 7fe457391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:16.942 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:51:17.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:51:17.103+0000 7fc207d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:17.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:51:17.113+0000 7fc207d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:18.115 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:51:18.115 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:51:18.116 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:51:18.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:51:18.285+0000 7fa614911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:18.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:51:18.295+0000 7fa614911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:18.589 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:51:18.639 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-22T03:51:18.641 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":88,"stamp":"2024-09-22T03:51:16.988619+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":856097355,"num_objects":13059,"num_object_clones":0,"num_object_copies":39177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":20146,"num_write_kb":1060885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":20120,"ondisk_log_size":20120,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":300536,"kb_used_data":159924,"kb_used_omap":0,"kb_used_meta":140544,"kb_avail":377186824,"statfs":{"total":386547056640,"available":386239307776,"internally_reserved":0,"allocated":163762176,"data_stored":2602455561,"data_compressed":123568101,"data_compressed_allocated":162643968,"data_compressed_original":2602057728,"omap_allocated":0,"internal_metadata":143917056},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-121569280,"num_objects":-1855,"num_object_clones":0,"num_object_copies":-5565,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1855,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001477"},"pg_stats":[{"pgid":"3.f","version":"31'1264","reported_seq":1312,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-22T03:51:14.892901+0000","last_change":"2024-09-22T03:49:25.167073+0000","last_active":"2024-09-22T03:51:14.892901+0000","last_peered":"2024-09-22T03:51:14.892901+0000","last_clean":"2024-09-22T03:51:14.892901+0000","last_became_active":"2024-09-22T03:49:25.159818+0000","last_became_peered":"2024-09-22T03:49:25.159818+0000","last_unstale":"2024-09-22T03:51:14.892901+0000","last_undegraded":"2024-09-22T03:51:14.892901+0000","last_fullsized":"2024-09-22T03:51:14.892901+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1264,"log_dups_size":0,"ondisk_log_size":1264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54394880,"num_objects":830,"num_object_clones":0,"num_object_copies":2490,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1264,"num_write_kb":67008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"31'1272","reported_seq":1320,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-22T03:51:15.789031+0000","last_change":"2024-09-22T03:49:25.238720+0000","last_active":"2024-09-22T03:51:15.789031+0000","last_peered":"2024-09-22T03:51:15.789031+0000","last_clean":"2024-09-22T03:51:15.789031+0000","last_became_active":"2024-09-22T03:49:25.229005+0000","last_became_peered":"2024-09-22T03:49:25.229005+0000","last_unstale":"2024-09-22T03:51:15.789031+0000","last_undegraded":"2024-09-22T03:51:15.789031+0000","last_fullsized":"2024-09-22T03:51:15.789031+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1272,"log_dups_size":0,"ondisk_log_size":1272,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54919168,"num_objects":838,"num_object_clones":0,"num_object_copies":2514,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1272,"num_write_kb":67520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"31'1275","reported_seq":1324,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-22T03:51:14.969863+0000","last_change":"2024-09-22T03:49:25.173605+0000","last_active":"2024-09-22T03:51:14.969863+0000","last_peered":"2024-09-22T03:51:14.969863+0000","last_clean":"2024-09-22T03:51:14.969863+0000","last_became_active":"2024-09-22T03:49:25.165491+0000","last_became_peered":"2024-09-22T03:49:25.165491+0000","last_unstale":"2024-09-22T03:51:14.969863+0000","last_undegraded":"2024-09-22T03:51:14.969863+0000","last_fullsized":"2024-09-22T03:51:14.969863+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1275,"log_dups_size":0,"ondisk_log_size":1275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56098840,"num_objects":857,"num_object_clones":0,"num_object_copies":2571,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1275,"num_write_kb":68161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"31'1210","reported_seq":1258,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-22T03:51:14.903795+0000","last_change":"2024-09-22T03:49:25.207920+0000","last_active":"2024-09-22T03:51:14.903795+0000","last_peered":"2024-09-22T03:51:14.903795+0000","last_clean":"2024-09-22T03:51:14.903795+0000","last_became_active":"2024-09-22T03:49:25.198168+0000","last_became_peered":"2024-09-22T03:49:25.198168+0000","last_unstale":"2024-09-22T03:51:14.903795+0000","last_undegraded":"2024-09-22T03:51:14.903795+0000","last_fullsized":"2024-09-22T03:51:14.903795+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1210,"log_dups_size":0,"ondisk_log_size":1210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52035584,"num_objects":794,"num_object_clones":0,"num_object_copies":2382,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1210,"num_write_kb":64128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"31'1252","reported_seq":1300,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-22T03:51:15.953319+0000","last_change":"2024-09-22T03:49:25.280543+0000","last_active":"2024-09-22T03:51:15.953319+0000","last_peered":"2024-09-22T03:51:15.953319+0000","last_clean":"2024-09-22T03:51:15.953319+0000","last_became_active":"2024-09-22T03:49:25.268731+0000","last_became_peered":"2024-09-22T03:49:25.268731+0000","last_unstale":"2024-09-22T03:51:15.953319+0000","last_undegraded":"2024-09-22T03:51:15.953319+0000","last_fullsized":"2024-09-22T03:51:15.953319+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1252,"log_dups_size":0,"ondisk_log_size":1252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52953088,"num_objects":808,"num_object_clones":0,"num_object_copies":2424,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1252,"num_write_kb":65920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"31'1243","reported_seq":1291,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-22T03:51:14.885381+0000","last_change":"2024-09-22T03:49:25.206225+0000","last_active":"2024-09-22T03:51:14.885381+0000","last_peered":"2024-09-22T03:51:14.885381+0000","last_clean":"2024-09-22T03:51:14.885381+0000","last_became_active":"2024-09-22T03:49:25.201227+0000","last_became_peered":"2024-09-22T03:49:25.201227+0000","last_unstale":"2024-09-22T03:51:14.885381+0000","last_undegraded":"2024-09-22T03:51:14.885381+0000","last_fullsized":"2024-09-22T03:51:14.885381+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1243,"log_dups_size":0,"ondisk_log_size":1243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52363264,"num_objects":799,"num_object_clones":0,"num_object_copies":2397,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1243,"num_write_kb":65344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"31'1258","reported_seq":1306,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-22T03:51:14.698903+0000","last_change":"2024-09-22T03:49:25.212585+0000","last_active":"2024-09-22T03:51:14.698903+0000","last_peered":"2024-09-22T03:51:14.698903+0000","last_clean":"2024-09-22T03:51:14.698903+0000","last_became_active":"2024-09-22T03:49:25.203356+0000","last_became_peered":"2024-09-22T03:49:25.203356+0000","last_unstale":"2024-09-22T03:51:14.698903+0000","last_undegraded":"2024-09-22T03:51:14.698903+0000","last_fullsized":"2024-09-22T03:51:14.698903+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1258,"log_dups_size":0,"ondisk_log_size":1258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54657024,"num_objects":834,"num_object_clones":0,"num_object_copies":2502,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1258,"num_write_kb":66944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"31'1266","reported_seq":1314,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-22T03:51:14.916225+0000","last_change":"2024-09-22T03:49:25.177465+0000","last_active":"2024-09-22T03:51:14.916225+0000","last_peered":"2024-09-22T03:51:14.916225+0000","last_clean":"2024-09-22T03:51:14.916225+0000","last_became_active":"2024-09-22T03:49:25.170026+0000","last_became_peered":"2024-09-22T03:49:25.170026+0000","last_unstale":"2024-09-22T03:51:14.916225+0000","last_undegraded":"2024-09-22T03:51:14.916225+0000","last_fullsized":"2024-09-22T03:51:14.916225+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1266,"log_dups_size":0,"ondisk_log_size":1266,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54919168,"num_objects":838,"num_object_clones":0,"num_object_copies":2514,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1266,"num_write_kb":67328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":136,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-22T03:51:10.750906+0000","last_change":"2024-09-22T03:49:12.034704+0000","last_active":"2024-09-22T03:51:10.750906+0000","last_peered":"2024-09-22T03:51:10.750906+0000","last_clean":"2024-09-22T03:51:10.750906+0000","last_became_active":"2024-09-22T03:49:12.027470+0000","last_became_peered":"2024-09-22T03:49:12.027470+0000","last_unstale":"2024-09-22T03:51:10.750906+0000","last_undegraded":"2024-09-22T03:51:10.750906+0000","last_fullsized":"2024-09-22T03:51:10.750906+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_clean_scrub_stamp":"2024-09-22T03:49:10.979949+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":62,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-22T03:51:10.731317+0000","last_change":"2024-09-22T03:49:17.031458+0000","last_active":"2024-09-22T03:51:10.731317+0000","last_peered":"2024-09-22T03:51:10.731317+0000","last_clean":"2024-09-22T03:51:10.731317+0000","last_became_active":"2024-09-22T03:49:15.125490+0000","last_became_peered":"2024-09-22T03:49:15.125490+0000","last_unstale":"2024-09-22T03:51:10.731317+0000","last_undegraded":"2024-09-22T03:51:10.731317+0000","last_fullsized":"2024-09-22T03:51:10.731317+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"31'1228","reported_seq":1276,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-22T03:51:14.997249+0000","last_change":"2024-09-22T03:49:25.226827+0000","last_active":"2024-09-22T03:51:14.997249+0000","last_peered":"2024-09-22T03:51:14.997249+0000","last_clean":"2024-09-22T03:51:14.997249+0000","last_became_active":"2024-09-22T03:49:25.218579+0000","last_became_peered":"2024-09-22T03:49:25.218579+0000","last_unstale":"2024-09-22T03:51:14.997249+0000","last_undegraded":"2024-09-22T03:51:14.997249+0000","last_fullsized":"2024-09-22T03:51:14.997249+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1228,"log_dups_size":0,"ondisk_log_size":1228,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49938432,"num_objects":762,"num_object_clones":0,"num_object_copies":2286,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1228,"num_write_kb":63680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-22T03:51:10.728573+0000","last_change":"2024-09-22T03:49:17.029339+0000","last_active":"2024-09-22T03:51:10.728573+0000","last_peered":"2024-09-22T03:51:10.728573+0000","last_clean":"2024-09-22T03:51:10.728573+0000","last_became_active":"2024-09-22T03:49:15.097304+0000","last_became_peered":"2024-09-22T03:49:15.097304+0000","last_unstale":"2024-09-22T03:51:10.728573+0000","last_undegraded":"2024-09-22T03:51:10.728573+0000","last_fullsized":"2024-09-22T03:51:10.728573+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"31'1236","reported_seq":1284,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-22T03:51:14.968291+0000","last_change":"2024-09-22T03:49:25.208298+0000","last_active":"2024-09-22T03:51:14.968291+0000","last_peered":"2024-09-22T03:51:14.968291+0000","last_clean":"2024-09-22T03:51:14.968291+0000","last_became_active":"2024-09-22T03:49:25.193750+0000","last_became_peered":"2024-09-22T03:49:25.193750+0000","last_unstale":"2024-09-22T03:51:14.968291+0000","last_undegraded":"2024-09-22T03:51:14.968291+0000","last_fullsized":"2024-09-22T03:51:14.968291+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1236,"log_dups_size":0,"ondisk_log_size":1236,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53739520,"num_objects":820,"num_object_clones":0,"num_object_copies":2460,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1236,"num_write_kb":65792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-22T03:51:10.745463+0000","last_change":"2024-09-22T03:49:17.029349+0000","last_active":"2024-09-22T03:51:10.745463+0000","last_peered":"2024-09-22T03:51:10.745463+0000","last_clean":"2024-09-22T03:51:10.745463+0000","last_became_active":"2024-09-22T03:49:15.094890+0000","last_became_peered":"2024-09-22T03:49:15.094890+0000","last_unstale":"2024-09-22T03:51:10.745463+0000","last_undegraded":"2024-09-22T03:51:10.745463+0000","last_fullsized":"2024-09-22T03:51:10.745463+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"31'1308","reported_seq":1356,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-22T03:51:16.053821+0000","last_change":"2024-09-22T03:49:25.226551+0000","last_active":"2024-09-22T03:51:16.053821+0000","last_peered":"2024-09-22T03:51:16.053821+0000","last_clean":"2024-09-22T03:51:16.053821+0000","last_became_active":"2024-09-22T03:49:25.213989+0000","last_became_peered":"2024-09-22T03:49:25.213989+0000","last_unstale":"2024-09-22T03:51:16.053821+0000","last_undegraded":"2024-09-22T03:51:16.053821+0000","last_fullsized":"2024-09-22T03:51:16.053821+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1308,"log_dups_size":0,"ondisk_log_size":1308,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54394880,"num_objects":830,"num_object_clones":0,"num_object_copies":2490,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1308,"num_write_kb":68416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":63,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-22T03:51:10.732680+0000","last_change":"2024-09-22T03:49:17.031466+0000","last_active":"2024-09-22T03:51:10.732680+0000","last_peered":"2024-09-22T03:51:10.732680+0000","last_clean":"2024-09-22T03:51:10.732680+0000","last_became_active":"2024-09-22T03:49:15.098420+0000","last_became_peered":"2024-09-22T03:49:15.098420+0000","last_unstale":"2024-09-22T03:51:10.732680+0000","last_undegraded":"2024-09-22T03:51:10.732680+0000","last_fullsized":"2024-09-22T03:51:10.732680+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"31'1237","reported_seq":1285,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-22T03:51:14.842790+0000","last_change":"2024-09-22T03:49:25.163198+0000","last_active":"2024-09-22T03:51:14.842790+0000","last_peered":"2024-09-22T03:51:14.842790+0000","last_clean":"2024-09-22T03:51:14.842790+0000","last_became_active":"2024-09-22T03:49:25.145723+0000","last_became_peered":"2024-09-22T03:49:25.145723+0000","last_unstale":"2024-09-22T03:51:14.842790+0000","last_undegraded":"2024-09-22T03:51:14.842790+0000","last_fullsized":"2024-09-22T03:51:14.842790+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1237,"log_dups_size":0,"ondisk_log_size":1237,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51445760,"num_objects":785,"num_object_clones":0,"num_object_copies":2355,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1237,"num_write_kb":64704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"31'1248","reported_seq":1296,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-22T03:51:14.468953+0000","last_change":"2024-09-22T03:49:25.168751+0000","last_active":"2024-09-22T03:51:14.468953+0000","last_peered":"2024-09-22T03:51:14.468953+0000","last_clean":"2024-09-22T03:51:14.468953+0000","last_became_active":"2024-09-22T03:49:25.160072+0000","last_became_peered":"2024-09-22T03:49:25.160072+0000","last_unstale":"2024-09-22T03:51:14.468953+0000","last_undegraded":"2024-09-22T03:51:14.468953+0000","last_fullsized":"2024-09-22T03:51:14.468953+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1248,"log_dups_size":0,"ondisk_log_size":1248,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54263808,"num_objects":828,"num_object_clones":0,"num_object_copies":2484,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1248,"num_write_kb":66432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-22T03:51:10.763617+0000","last_change":"2024-09-22T03:49:17.036954+0000","last_active":"2024-09-22T03:51:10.763617+0000","last_peered":"2024-09-22T03:51:10.763617+0000","last_clean":"2024-09-22T03:51:10.763617+0000","last_became_active":"2024-09-22T03:49:15.110506+0000","last_became_peered":"2024-09-22T03:49:15.110506+0000","last_unstale":"2024-09-22T03:51:10.763617+0000","last_undegraded":"2024-09-22T03:51:10.763617+0000","last_fullsized":"2024-09-22T03:51:10.763617+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"31'1271","reported_seq":1319,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-22T03:51:16.016071+0000","last_change":"2024-09-22T03:49:25.218967+0000","last_active":"2024-09-22T03:51:16.016071+0000","last_peered":"2024-09-22T03:51:16.016071+0000","last_clean":"2024-09-22T03:51:16.016071+0000","last_became_active":"2024-09-22T03:49:25.203726+0000","last_became_peered":"2024-09-22T03:49:25.203726+0000","last_unstale":"2024-09-22T03:51:16.016071+0000","last_undegraded":"2024-09-22T03:51:16.016071+0000","last_fullsized":"2024-09-22T03:51:16.016071+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1271,"log_dups_size":0,"ondisk_log_size":1271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52625408,"num_objects":803,"num_object_clones":0,"num_object_copies":2409,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1271,"num_write_kb":66368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-22T03:51:10.748683+0000","last_change":"2024-09-22T03:49:17.032989+0000","last_active":"2024-09-22T03:51:10.748683+0000","last_peered":"2024-09-22T03:51:10.748683+0000","last_clean":"2024-09-22T03:51:10.748683+0000","last_became_active":"2024-09-22T03:49:15.079260+0000","last_became_peered":"2024-09-22T03:49:15.079260+0000","last_unstale":"2024-09-22T03:51:10.748683+0000","last_undegraded":"2024-09-22T03:51:10.748683+0000","last_fullsized":"2024-09-22T03:51:10.748683+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"31'1227","reported_seq":1275,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-22T03:51:15.924969+0000","last_change":"2024-09-22T03:49:25.275215+0000","last_active":"2024-09-22T03:51:15.924969+0000","last_peered":"2024-09-22T03:51:15.924969+0000","last_clean":"2024-09-22T03:51:15.924969+0000","last_became_active":"2024-09-22T03:49:25.260843+0000","last_became_peered":"2024-09-22T03:49:25.260843+0000","last_unstale":"2024-09-22T03:51:15.924969+0000","last_undegraded":"2024-09-22T03:51:15.924969+0000","last_fullsized":"2024-09-22T03:51:15.924969+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1227,"log_dups_size":0,"ondisk_log_size":1227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53673984,"num_objects":819,"num_object_clones":0,"num_object_copies":2457,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1227,"num_write_kb":65472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-22T03:51:10.763842+0000","last_change":"2024-09-22T03:49:17.036402+0000","last_active":"2024-09-22T03:51:10.763842+0000","last_peered":"2024-09-22T03:51:10.763842+0000","last_clean":"2024-09-22T03:51:10.763842+0000","last_became_active":"2024-09-22T03:49:15.108430+0000","last_became_peered":"2024-09-22T03:49:15.108430+0000","last_unstale":"2024-09-22T03:51:10.763842+0000","last_undegraded":"2024-09-22T03:51:10.763842+0000","last_fullsized":"2024-09-22T03:51:10.763842+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"31'1270","reported_seq":1318,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-22T03:51:14.901566+0000","last_change":"2024-09-22T03:49:25.211493+0000","last_active":"2024-09-22T03:51:14.901566+0000","last_peered":"2024-09-22T03:51:14.901566+0000","last_clean":"2024-09-22T03:51:14.901566+0000","last_became_active":"2024-09-22T03:49:25.194855+0000","last_became_peered":"2024-09-22T03:49:25.194855+0000","last_unstale":"2024-09-22T03:51:14.901566+0000","last_undegraded":"2024-09-22T03:51:14.901566+0000","last_fullsized":"2024-09-22T03:51:14.901566+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1270,"log_dups_size":0,"ondisk_log_size":1270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53084160,"num_objects":810,"num_object_clones":0,"num_object_copies":2430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1270,"num_write_kb":66560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-22T03:51:10.726537+0000","last_change":"2024-09-22T03:49:17.029128+0000","last_active":"2024-09-22T03:51:10.726537+0000","last_peered":"2024-09-22T03:51:10.726537+0000","last_clean":"2024-09-22T03:51:10.726537+0000","last_became_active":"2024-09-22T03:49:15.113396+0000","last_became_peered":"2024-09-22T03:49:15.113396+0000","last_unstale":"2024-09-22T03:51:10.726537+0000","last_undegraded":"2024-09-22T03:51:10.726537+0000","last_fullsized":"2024-09-22T03:51:10.726537+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":855506968,"num_objects":13055,"num_object_clones":0,"num_object_copies":39165,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20065,"num_write_kb":1059777,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":160567296,"data_stored":2568880200,"data_compressed":121984173,"data_compressed_allocated":160555008,"data_compressed_original":2568880128,"omap_allocated":0,"internal_metadata":0},"log_size":20065,"ondisk_log_size":20065,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949673084,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":82048,"kb_used_data":42732,"kb_used_omap":0,"kb_used_meta":39296,"kb_avail":94289792,"statfs":{"total":96636764160,"available":96552747008,"internally_reserved":0,"allocated":43757568,"data_stored":695555349,"data_compressed":33026591,"data_compressed_allocated":43470848,"data_compressed_original":695451648,"omap_allocated":0,"internal_metadata":40239104},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654705788,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":75248,"kb_used_data":40096,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94296592,"statfs":{"total":96636764160,"available":96559710208,"internally_reserved":0,"allocated":41058304,"data_stored":652759797,"data_compressed":30992407,"data_compressed_allocated":40792064,"data_compressed_original":652673024,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705788,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":60248,"kb_used_data":33416,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94311592,"statfs":{"total":96636764160,"available":96575070208,"internally_reserved":0,"allocated":34217984,"data_stored":542987517,"data_compressed":25781856,"data_compressed_allocated":33935360,"data_compressed_original":542883840,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705788,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":82992,"kb_used_data":43680,"kb_used_omap":0,"kb_used_meta":39296,"kb_avail":94288848,"statfs":{"total":96636764160,"available":96551780352,"internally_reserved":0,"allocated":44728320,"data_stored":711152898,"data_compressed":33767247,"data_compressed_allocated":44445696,"data_compressed_original":711049216,"omap_allocated":0,"internal_metadata":40239104},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":43925504,"data_stored":702742552,"data_compressed":33369975,"data_compressed_allocated":43921408,"data_compressed_original":702742528,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":42921984,"data_stored":686686232,"data_compressed":32607535,"data_compressed_allocated":42917888,"data_compressed_original":686686208,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":33456128,"data_stored":535298048,"data_compressed":25418816,"data_compressed_allocated":33456128,"data_compressed_original":535298048,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":40263680,"data_stored":644153368,"data_compressed":30587847,"data_compressed_allocated":40259584,"data_compressed_original":644153344,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:51:19.464 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:51:19.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:51:19.631+0000 7f72b1d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:19.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:51:19.639+0000 7f72b1d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:21.938 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:51:22.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:51:22.089+0000 7fb679591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:22.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:51:22.101+0000 7fb679591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:23.642 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:51:23.643 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-22T03:51:23.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:51:23.814+0000 7f31c4afd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:23.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:51:23.832+0000 7f31c4afd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:24.486 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:51:24.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:51:24.641+0000 7f88f8d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:24.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:51:24.650+0000 7f88f8d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:25.068 INFO:teuthology.orchestra.run.smithi037.stderr:reweighted osd.0 to 1 (10000) 2024-09-22T03:51:25.089 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-22T03:51:25.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:51:25.241+0000 7f875607d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:25.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:51:25.257+0000 7f875607d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:26.068 INFO:teuthology.orchestra.run.smithi037.stderr:reweighted osd.1 to 1 (10000) 2024-09-22T03:51:26.095 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-22T03:51:26.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:51:26.249+0000 7f68be8ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:26.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:51:26.270+0000 7f68be8ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:26.975 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:51:27.078 INFO:teuthology.orchestra.run.smithi037.stderr:reweighted osd.2 to 1 (10000) 2024-09-22T03:51:27.106 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-22T03:51:27.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:51:27.149+0000 7f8b3bf51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:27.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:51:27.161+0000 7f8b3bf51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:27.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:51:27.279+0000 7f20e1b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:27.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:51:27.303+0000 7f20e1b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:28.078 INFO:teuthology.orchestra.run.smithi037.stderr:reweighted osd.3 to 1 (10000) 2024-09-22T03:51:28.097 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-22T03:51:28.097 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:51:28.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:51:28.249+0000 7fb0f3351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:28.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:51:28.265+0000 7fb0f3351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:28.626 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:51:28.627 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-22T03:51:28.648 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":97,"stamp":"2024-09-22T03:51:28.078922+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":731382347,"num_objects":11156,"num_object_clones":0,"num_object_copies":33468,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":22049,"num_write_kb":1060885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":22023,"ondisk_log_size":22023,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":283020,"kb_used_data":136836,"kb_used_omap":0,"kb_used_meta":146112,"kb_avail":377204340,"statfs":{"total":386547056640,"available":386257244160,"internally_reserved":0,"allocated":140120064,"data_stored":2224053970,"data_compressed":105599413,"data_compressed_allocated":138993664,"data_compressed_original":2223652864,"omap_allocated":0,"internal_metadata":149618688},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-61210624,"num_objects":-934,"num_object_clones":0,"num_object_copies":-2802,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":934,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.088922"},"pg_stats":[{"pgid":"3.f","version":"31'1387","reported_seq":1435,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-22T03:51:24.759157+0000","last_change":"2024-09-22T03:49:25.167073+0000","last_active":"2024-09-22T03:51:24.759157+0000","last_peered":"2024-09-22T03:51:24.759157+0000","last_clean":"2024-09-22T03:51:24.759157+0000","last_became_active":"2024-09-22T03:49:25.159818+0000","last_became_peered":"2024-09-22T03:49:25.159818+0000","last_unstale":"2024-09-22T03:51:24.759157+0000","last_undegraded":"2024-09-22T03:51:24.759157+0000","last_fullsized":"2024-09-22T03:51:24.759157+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1387,"log_dups_size":0,"ondisk_log_size":1387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46333952,"num_objects":707,"num_object_clones":0,"num_object_copies":2121,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1387,"num_write_kb":67008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"32'1391","reported_seq":1442,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T03:51:25.986799+0000","last_change":"2024-09-22T03:49:25.238720+0000","last_active":"2024-09-22T03:51:25.986799+0000","last_peered":"2024-09-22T03:51:25.986799+0000","last_clean":"2024-09-22T03:51:25.986799+0000","last_became_active":"2024-09-22T03:49:25.229005+0000","last_became_peered":"2024-09-22T03:49:25.229005+0000","last_unstale":"2024-09-22T03:51:25.986799+0000","last_undegraded":"2024-09-22T03:51:25.986799+0000","last_fullsized":"2024-09-22T03:51:25.986799+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1391,"log_dups_size":0,"ondisk_log_size":1391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47120384,"num_objects":719,"num_object_clones":0,"num_object_copies":2157,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1391,"num_write_kb":67520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"31'1402","reported_seq":1451,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-22T03:51:24.855044+0000","last_change":"2024-09-22T03:49:25.173605+0000","last_active":"2024-09-22T03:51:24.855044+0000","last_peered":"2024-09-22T03:51:24.855044+0000","last_clean":"2024-09-22T03:51:24.855044+0000","last_became_active":"2024-09-22T03:49:25.165491+0000","last_became_peered":"2024-09-22T03:49:25.165491+0000","last_unstale":"2024-09-22T03:51:24.855044+0000","last_undegraded":"2024-09-22T03:51:24.855044+0000","last_fullsized":"2024-09-22T03:51:24.855044+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1402,"log_dups_size":0,"ondisk_log_size":1402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47775768,"num_objects":730,"num_object_clones":0,"num_object_copies":2190,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1402,"num_write_kb":68161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"31'1315","reported_seq":1363,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-22T03:51:24.828930+0000","last_change":"2024-09-22T03:49:25.207920+0000","last_active":"2024-09-22T03:51:24.828930+0000","last_peered":"2024-09-22T03:51:24.828930+0000","last_clean":"2024-09-22T03:51:24.828930+0000","last_became_active":"2024-09-22T03:49:25.198168+0000","last_became_peered":"2024-09-22T03:49:25.198168+0000","last_unstale":"2024-09-22T03:51:24.828930+0000","last_undegraded":"2024-09-22T03:51:24.828930+0000","last_fullsized":"2024-09-22T03:51:24.828930+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1315,"log_dups_size":0,"ondisk_log_size":1315,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45154304,"num_objects":689,"num_object_clones":0,"num_object_copies":2067,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1315,"num_write_kb":64128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"32'1366","reported_seq":1417,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T03:51:25.977176+0000","last_change":"2024-09-22T03:49:25.280543+0000","last_active":"2024-09-22T03:51:25.977176+0000","last_peered":"2024-09-22T03:51:25.977176+0000","last_clean":"2024-09-22T03:51:25.977176+0000","last_became_active":"2024-09-22T03:49:25.268731+0000","last_became_peered":"2024-09-22T03:49:25.268731+0000","last_unstale":"2024-09-22T03:51:25.977176+0000","last_undegraded":"2024-09-22T03:51:25.977176+0000","last_fullsized":"2024-09-22T03:51:25.977176+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1366,"log_dups_size":0,"ondisk_log_size":1366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45481984,"num_objects":694,"num_object_clones":0,"num_object_copies":2082,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1366,"num_write_kb":65920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"31'1356","reported_seq":1404,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-22T03:51:24.866641+0000","last_change":"2024-09-22T03:49:25.206225+0000","last_active":"2024-09-22T03:51:24.866641+0000","last_peered":"2024-09-22T03:51:24.866641+0000","last_clean":"2024-09-22T03:51:24.866641+0000","last_became_active":"2024-09-22T03:49:25.201227+0000","last_became_peered":"2024-09-22T03:49:25.201227+0000","last_unstale":"2024-09-22T03:51:24.866641+0000","last_undegraded":"2024-09-22T03:51:24.866641+0000","last_fullsized":"2024-09-22T03:51:24.866641+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1356,"log_dups_size":0,"ondisk_log_size":1356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44957696,"num_objects":686,"num_object_clones":0,"num_object_copies":2058,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1356,"num_write_kb":65344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"31'1403","reported_seq":1451,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-22T03:51:24.879759+0000","last_change":"2024-09-22T03:49:25.212585+0000","last_active":"2024-09-22T03:51:24.879759+0000","last_peered":"2024-09-22T03:51:24.879759+0000","last_clean":"2024-09-22T03:51:24.879759+0000","last_became_active":"2024-09-22T03:49:25.203356+0000","last_became_peered":"2024-09-22T03:49:25.203356+0000","last_unstale":"2024-09-22T03:51:24.879759+0000","last_undegraded":"2024-09-22T03:51:24.879759+0000","last_fullsized":"2024-09-22T03:51:24.879759+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1403,"log_dups_size":0,"ondisk_log_size":1403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45154304,"num_objects":689,"num_object_clones":0,"num_object_copies":2067,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1403,"num_write_kb":66944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"31'1382","reported_seq":1430,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-22T03:51:24.769525+0000","last_change":"2024-09-22T03:49:25.177465+0000","last_active":"2024-09-22T03:51:24.769525+0000","last_peered":"2024-09-22T03:51:24.769525+0000","last_clean":"2024-09-22T03:51:24.769525+0000","last_became_active":"2024-09-22T03:49:25.170026+0000","last_became_peered":"2024-09-22T03:49:25.170026+0000","last_unstale":"2024-09-22T03:51:24.769525+0000","last_undegraded":"2024-09-22T03:51:24.769525+0000","last_fullsized":"2024-09-22T03:51:24.769525+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1382,"log_dups_size":0,"ondisk_log_size":1382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47316992,"num_objects":722,"num_object_clones":0,"num_object_copies":2166,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1382,"num_write_kb":67328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":139,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T03:51:25.107442+0000","last_change":"2024-09-22T03:49:12.034704+0000","last_active":"2024-09-22T03:51:25.107442+0000","last_peered":"2024-09-22T03:51:25.107442+0000","last_clean":"2024-09-22T03:51:25.107442+0000","last_became_active":"2024-09-22T03:49:12.027470+0000","last_became_peered":"2024-09-22T03:49:12.027470+0000","last_unstale":"2024-09-22T03:51:25.107442+0000","last_undegraded":"2024-09-22T03:51:25.107442+0000","last_fullsized":"2024-09-22T03:51:25.107442+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_clean_scrub_stamp":"2024-09-22T03:49:10.979949+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":62,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-22T03:51:10.731317+0000","last_change":"2024-09-22T03:49:17.031458+0000","last_active":"2024-09-22T03:51:10.731317+0000","last_peered":"2024-09-22T03:51:10.731317+0000","last_clean":"2024-09-22T03:51:10.731317+0000","last_became_active":"2024-09-22T03:49:15.125490+0000","last_became_peered":"2024-09-22T03:49:15.125490+0000","last_unstale":"2024-09-22T03:51:10.731317+0000","last_undegraded":"2024-09-22T03:51:10.731317+0000","last_fullsized":"2024-09-22T03:51:10.731317+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"31'1343","reported_seq":1391,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-22T03:51:24.980963+0000","last_change":"2024-09-22T03:49:25.226827+0000","last_active":"2024-09-22T03:51:24.980963+0000","last_peered":"2024-09-22T03:51:24.980963+0000","last_clean":"2024-09-22T03:51:24.980963+0000","last_became_active":"2024-09-22T03:49:25.218579+0000","last_became_peered":"2024-09-22T03:49:25.218579+0000","last_unstale":"2024-09-22T03:51:24.980963+0000","last_undegraded":"2024-09-22T03:51:24.980963+0000","last_fullsized":"2024-09-22T03:51:24.980963+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1343,"log_dups_size":0,"ondisk_log_size":1343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42401792,"num_objects":647,"num_object_clones":0,"num_object_copies":1941,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1343,"num_write_kb":63680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-22T03:51:10.728573+0000","last_change":"2024-09-22T03:49:17.029339+0000","last_active":"2024-09-22T03:51:10.728573+0000","last_peered":"2024-09-22T03:51:10.728573+0000","last_clean":"2024-09-22T03:51:10.728573+0000","last_became_active":"2024-09-22T03:49:15.097304+0000","last_became_peered":"2024-09-22T03:49:15.097304+0000","last_unstale":"2024-09-22T03:51:10.728573+0000","last_undegraded":"2024-09-22T03:51:10.728573+0000","last_fullsized":"2024-09-22T03:51:10.728573+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"31'1360","reported_seq":1408,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-22T03:51:24.815442+0000","last_change":"2024-09-22T03:49:25.208298+0000","last_active":"2024-09-22T03:51:24.815442+0000","last_peered":"2024-09-22T03:51:24.815442+0000","last_clean":"2024-09-22T03:51:24.815442+0000","last_became_active":"2024-09-22T03:49:25.193750+0000","last_became_peered":"2024-09-22T03:49:25.193750+0000","last_unstale":"2024-09-22T03:51:24.815442+0000","last_undegraded":"2024-09-22T03:51:24.815442+0000","last_fullsized":"2024-09-22T03:51:24.815442+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1360,"log_dups_size":0,"ondisk_log_size":1360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45613056,"num_objects":696,"num_object_clones":0,"num_object_copies":2088,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1360,"num_write_kb":65792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-22T03:51:10.745463+0000","last_change":"2024-09-22T03:49:17.029349+0000","last_active":"2024-09-22T03:51:10.745463+0000","last_peered":"2024-09-22T03:51:10.745463+0000","last_clean":"2024-09-22T03:51:10.745463+0000","last_became_active":"2024-09-22T03:49:15.094890+0000","last_became_peered":"2024-09-22T03:49:15.094890+0000","last_unstale":"2024-09-22T03:51:10.745463+0000","last_undegraded":"2024-09-22T03:51:10.745463+0000","last_fullsized":"2024-09-22T03:51:10.745463+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"32'1447","reported_seq":1498,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T03:51:26.047917+0000","last_change":"2024-09-22T03:49:25.226551+0000","last_active":"2024-09-22T03:51:26.047917+0000","last_peered":"2024-09-22T03:51:26.047917+0000","last_clean":"2024-09-22T03:51:26.047917+0000","last_became_active":"2024-09-22T03:49:25.213989+0000","last_became_peered":"2024-09-22T03:49:25.213989+0000","last_unstale":"2024-09-22T03:51:26.047917+0000","last_undegraded":"2024-09-22T03:51:26.047917+0000","last_fullsized":"2024-09-22T03:51:26.047917+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1447,"log_dups_size":0,"ondisk_log_size":1447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45285376,"num_objects":691,"num_object_clones":0,"num_object_copies":2073,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1447,"num_write_kb":68416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":63,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-22T03:51:10.732680+0000","last_change":"2024-09-22T03:49:17.031466+0000","last_active":"2024-09-22T03:51:10.732680+0000","last_peered":"2024-09-22T03:51:10.732680+0000","last_clean":"2024-09-22T03:51:10.732680+0000","last_became_active":"2024-09-22T03:49:15.098420+0000","last_became_peered":"2024-09-22T03:49:15.098420+0000","last_unstale":"2024-09-22T03:51:10.732680+0000","last_undegraded":"2024-09-22T03:51:10.732680+0000","last_fullsized":"2024-09-22T03:51:10.732680+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"31'1337","reported_seq":1385,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-22T03:51:24.907917+0000","last_change":"2024-09-22T03:49:25.163198+0000","last_active":"2024-09-22T03:51:24.907917+0000","last_peered":"2024-09-22T03:51:24.907917+0000","last_clean":"2024-09-22T03:51:24.907917+0000","last_became_active":"2024-09-22T03:49:25.145723+0000","last_became_peered":"2024-09-22T03:49:25.145723+0000","last_unstale":"2024-09-22T03:51:24.907917+0000","last_undegraded":"2024-09-22T03:51:24.907917+0000","last_fullsized":"2024-09-22T03:51:24.907917+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1337,"log_dups_size":0,"ondisk_log_size":1337,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44892160,"num_objects":685,"num_object_clones":0,"num_object_copies":2055,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1337,"num_write_kb":64704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"31'1361","reported_seq":1409,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-22T03:51:24.895604+0000","last_change":"2024-09-22T03:49:25.168751+0000","last_active":"2024-09-22T03:51:24.895604+0000","last_peered":"2024-09-22T03:51:24.895604+0000","last_clean":"2024-09-22T03:51:24.895604+0000","last_became_active":"2024-09-22T03:49:25.160072+0000","last_became_peered":"2024-09-22T03:49:25.160072+0000","last_unstale":"2024-09-22T03:51:24.895604+0000","last_undegraded":"2024-09-22T03:51:24.895604+0000","last_fullsized":"2024-09-22T03:51:24.895604+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1361,"log_dups_size":0,"ondisk_log_size":1361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46858240,"num_objects":715,"num_object_clones":0,"num_object_copies":2145,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1361,"num_write_kb":66432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T03:51:25.136740+0000","last_change":"2024-09-22T03:49:17.036954+0000","last_active":"2024-09-22T03:51:25.136740+0000","last_peered":"2024-09-22T03:51:25.136740+0000","last_clean":"2024-09-22T03:51:25.136740+0000","last_became_active":"2024-09-22T03:49:15.110506+0000","last_became_peered":"2024-09-22T03:49:15.110506+0000","last_unstale":"2024-09-22T03:51:25.136740+0000","last_undegraded":"2024-09-22T03:51:25.136740+0000","last_fullsized":"2024-09-22T03:51:25.136740+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"32'1385","reported_seq":1436,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T03:51:25.967617+0000","last_change":"2024-09-22T03:49:25.218967+0000","last_active":"2024-09-22T03:51:25.967617+0000","last_peered":"2024-09-22T03:51:25.967617+0000","last_clean":"2024-09-22T03:51:25.967617+0000","last_became_active":"2024-09-22T03:49:25.203726+0000","last_became_peered":"2024-09-22T03:49:25.203726+0000","last_unstale":"2024-09-22T03:51:25.967617+0000","last_undegraded":"2024-09-22T03:51:25.967617+0000","last_fullsized":"2024-09-22T03:51:25.967617+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1385,"log_dups_size":0,"ondisk_log_size":1385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45154304,"num_objects":689,"num_object_clones":0,"num_object_copies":2067,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1385,"num_write_kb":66368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T03:51:25.110025+0000","last_change":"2024-09-22T03:49:17.032989+0000","last_active":"2024-09-22T03:51:25.110025+0000","last_peered":"2024-09-22T03:51:25.110025+0000","last_clean":"2024-09-22T03:51:25.110025+0000","last_became_active":"2024-09-22T03:49:15.079260+0000","last_became_peered":"2024-09-22T03:49:15.079260+0000","last_unstale":"2024-09-22T03:51:25.110025+0000","last_undegraded":"2024-09-22T03:51:25.110025+0000","last_fullsized":"2024-09-22T03:51:25.110025+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"32'1349","reported_seq":1400,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T03:51:26.026941+0000","last_change":"2024-09-22T03:49:25.275215+0000","last_active":"2024-09-22T03:51:26.026941+0000","last_peered":"2024-09-22T03:51:26.026941+0000","last_clean":"2024-09-22T03:51:26.026941+0000","last_became_active":"2024-09-22T03:49:25.260843+0000","last_became_peered":"2024-09-22T03:49:25.260843+0000","last_unstale":"2024-09-22T03:51:26.026941+0000","last_undegraded":"2024-09-22T03:51:26.026941+0000","last_fullsized":"2024-09-22T03:51:26.026941+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1349,"log_dups_size":0,"ondisk_log_size":1349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45678592,"num_objects":697,"num_object_clones":0,"num_object_copies":2091,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1349,"num_write_kb":65472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T03:51:25.114866+0000","last_change":"2024-09-22T03:49:17.036402+0000","last_active":"2024-09-22T03:51:25.114866+0000","last_peered":"2024-09-22T03:51:25.114866+0000","last_clean":"2024-09-22T03:51:25.114866+0000","last_became_active":"2024-09-22T03:49:15.108430+0000","last_became_peered":"2024-09-22T03:49:15.108430+0000","last_unstale":"2024-09-22T03:51:25.114866+0000","last_undegraded":"2024-09-22T03:51:25.114866+0000","last_fullsized":"2024-09-22T03:51:25.114866+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"31'1384","reported_seq":1432,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-22T03:51:24.864053+0000","last_change":"2024-09-22T03:49:25.211493+0000","last_active":"2024-09-22T03:51:24.864053+0000","last_peered":"2024-09-22T03:51:24.864053+0000","last_clean":"2024-09-22T03:51:24.864053+0000","last_became_active":"2024-09-22T03:49:25.194855+0000","last_became_peered":"2024-09-22T03:49:25.194855+0000","last_unstale":"2024-09-22T03:51:24.864053+0000","last_undegraded":"2024-09-22T03:51:24.864053+0000","last_fullsized":"2024-09-22T03:51:24.864053+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1384,"log_dups_size":0,"ondisk_log_size":1384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45613056,"num_objects":696,"num_object_clones":0,"num_object_copies":2088,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1384,"num_write_kb":66560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-22T03:51:10.726537+0000","last_change":"2024-09-22T03:49:17.029128+0000","last_active":"2024-09-22T03:51:10.726537+0000","last_peered":"2024-09-22T03:51:10.726537+0000","last_clean":"2024-09-22T03:51:10.726537+0000","last_became_active":"2024-09-22T03:49:15.113396+0000","last_became_peered":"2024-09-22T03:49:15.113396+0000","last_unstale":"2024-09-22T03:51:10.726537+0000","last_undegraded":"2024-09-22T03:51:10.726537+0000","last_fullsized":"2024-09-22T03:51:10.726537+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":730791960,"num_objects":11152,"num_object_clones":0,"num_object_copies":33456,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":21968,"num_write_kb":1059777,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":137080832,"data_stored":2193096776,"data_compressed":104139965,"data_compressed_allocated":137068544,"data_compressed_original":2193096704,"omap_allocated":0,"internal_metadata":0},"log_size":21968,"ondisk_log_size":21968,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949673094,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":85560,"kb_used_data":36520,"kb_used_omap":0,"kb_used_meta":49024,"kb_avail":94286280,"statfs":{"total":96636764160,"available":96549150720,"internally_reserved":0,"allocated":37396480,"data_stored":593650142,"data_compressed":28187431,"data_compressed_allocated":37101568,"data_compressed_original":593543168,"omap_allocated":0,"internal_metadata":50200576},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654705798,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":73612,"kb_used_data":34296,"kb_used_omap":0,"kb_used_meta":39296,"kb_avail":94298228,"statfs":{"total":96636764160,"available":96561385472,"internally_reserved":0,"allocated":35119104,"data_stored":557732597,"data_compressed":26480007,"data_compressed_allocated":34852864,"data_compressed_original":557645824,"omap_allocated":0,"internal_metadata":40239104},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705798,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":59520,"kb_used_data":28528,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94312320,"statfs":{"total":96636764160,"available":96575815680,"internally_reserved":0,"allocated":29212672,"data_stored":462902525,"data_compressed":21978992,"data_compressed_allocated":28930048,"data_compressed_original":462798848,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705798,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":64328,"kb_used_data":37492,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94307512,"statfs":{"total":96636764160,"available":96570892288,"internally_reserved":0,"allocated":38391808,"data_stored":609768706,"data_compressed":28952983,"data_compressed_allocated":38109184,"data_compressed_original":609665024,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":37593088,"data_stored":601423896,"data_compressed":28558823,"data_compressed_allocated":37588992,"data_compressed_original":601423872,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":36618240,"data_stored":585826328,"data_compressed":27818167,"data_compressed_allocated":36614144,"data_compressed_original":585826304,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28483584,"data_stored":455737344,"data_compressed":21640848,"data_compressed_allocated":28483584,"data_compressed_original":455737344,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":34385920,"data_stored":550109208,"data_compressed":26122127,"data_compressed_allocated":34381824,"data_compressed_original":550109184,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:51:28.649 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:51:28.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:51:28.813+0000 7fc51eed1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:28.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:51:28.823+0000 7fc51eed1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:29.227 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:51:29.227 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-22T03:51:29.247 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":98,"stamp":"2024-09-22T03:51:28.991222+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":731382347,"num_objects":11156,"num_object_clones":0,"num_object_copies":33468,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":22049,"num_write_kb":1060885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":22023,"ondisk_log_size":22023,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":283020,"kb_used_data":136836,"kb_used_omap":0,"kb_used_meta":146112,"kb_avail":377204340,"statfs":{"total":386547056640,"available":386257244160,"internally_reserved":0,"allocated":140120064,"data_stored":2224053970,"data_compressed":105599413,"data_compressed_allocated":138993664,"data_compressed_original":2223652864,"omap_allocated":0,"internal_metadata":149618688},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-61210624,"num_objects":-934,"num_object_clones":0,"num_object_copies":-2802,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":934,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000867"},"pg_stats":[{"pgid":"3.f","version":"31'1387","reported_seq":1435,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-22T03:51:24.759157+0000","last_change":"2024-09-22T03:49:25.167073+0000","last_active":"2024-09-22T03:51:24.759157+0000","last_peered":"2024-09-22T03:51:24.759157+0000","last_clean":"2024-09-22T03:51:24.759157+0000","last_became_active":"2024-09-22T03:49:25.159818+0000","last_became_peered":"2024-09-22T03:49:25.159818+0000","last_unstale":"2024-09-22T03:51:24.759157+0000","last_undegraded":"2024-09-22T03:51:24.759157+0000","last_fullsized":"2024-09-22T03:51:24.759157+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1387,"log_dups_size":0,"ondisk_log_size":1387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46333952,"num_objects":707,"num_object_clones":0,"num_object_copies":2121,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1387,"num_write_kb":67008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"32'1391","reported_seq":1442,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T03:51:25.986799+0000","last_change":"2024-09-22T03:49:25.238720+0000","last_active":"2024-09-22T03:51:25.986799+0000","last_peered":"2024-09-22T03:51:25.986799+0000","last_clean":"2024-09-22T03:51:25.986799+0000","last_became_active":"2024-09-22T03:49:25.229005+0000","last_became_peered":"2024-09-22T03:49:25.229005+0000","last_unstale":"2024-09-22T03:51:25.986799+0000","last_undegraded":"2024-09-22T03:51:25.986799+0000","last_fullsized":"2024-09-22T03:51:25.986799+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1391,"log_dups_size":0,"ondisk_log_size":1391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47120384,"num_objects":719,"num_object_clones":0,"num_object_copies":2157,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1391,"num_write_kb":67520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"31'1402","reported_seq":1451,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-22T03:51:24.855044+0000","last_change":"2024-09-22T03:49:25.173605+0000","last_active":"2024-09-22T03:51:24.855044+0000","last_peered":"2024-09-22T03:51:24.855044+0000","last_clean":"2024-09-22T03:51:24.855044+0000","last_became_active":"2024-09-22T03:49:25.165491+0000","last_became_peered":"2024-09-22T03:49:25.165491+0000","last_unstale":"2024-09-22T03:51:24.855044+0000","last_undegraded":"2024-09-22T03:51:24.855044+0000","last_fullsized":"2024-09-22T03:51:24.855044+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1402,"log_dups_size":0,"ondisk_log_size":1402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47775768,"num_objects":730,"num_object_clones":0,"num_object_copies":2190,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1402,"num_write_kb":68161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"31'1315","reported_seq":1363,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-22T03:51:24.828930+0000","last_change":"2024-09-22T03:49:25.207920+0000","last_active":"2024-09-22T03:51:24.828930+0000","last_peered":"2024-09-22T03:51:24.828930+0000","last_clean":"2024-09-22T03:51:24.828930+0000","last_became_active":"2024-09-22T03:49:25.198168+0000","last_became_peered":"2024-09-22T03:49:25.198168+0000","last_unstale":"2024-09-22T03:51:24.828930+0000","last_undegraded":"2024-09-22T03:51:24.828930+0000","last_fullsized":"2024-09-22T03:51:24.828930+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1315,"log_dups_size":0,"ondisk_log_size":1315,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45154304,"num_objects":689,"num_object_clones":0,"num_object_copies":2067,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1315,"num_write_kb":64128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"32'1366","reported_seq":1417,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T03:51:25.977176+0000","last_change":"2024-09-22T03:49:25.280543+0000","last_active":"2024-09-22T03:51:25.977176+0000","last_peered":"2024-09-22T03:51:25.977176+0000","last_clean":"2024-09-22T03:51:25.977176+0000","last_became_active":"2024-09-22T03:49:25.268731+0000","last_became_peered":"2024-09-22T03:49:25.268731+0000","last_unstale":"2024-09-22T03:51:25.977176+0000","last_undegraded":"2024-09-22T03:51:25.977176+0000","last_fullsized":"2024-09-22T03:51:25.977176+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1366,"log_dups_size":0,"ondisk_log_size":1366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45481984,"num_objects":694,"num_object_clones":0,"num_object_copies":2082,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1366,"num_write_kb":65920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"31'1356","reported_seq":1404,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-22T03:51:24.866641+0000","last_change":"2024-09-22T03:49:25.206225+0000","last_active":"2024-09-22T03:51:24.866641+0000","last_peered":"2024-09-22T03:51:24.866641+0000","last_clean":"2024-09-22T03:51:24.866641+0000","last_became_active":"2024-09-22T03:49:25.201227+0000","last_became_peered":"2024-09-22T03:49:25.201227+0000","last_unstale":"2024-09-22T03:51:24.866641+0000","last_undegraded":"2024-09-22T03:51:24.866641+0000","last_fullsized":"2024-09-22T03:51:24.866641+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1356,"log_dups_size":0,"ondisk_log_size":1356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44957696,"num_objects":686,"num_object_clones":0,"num_object_copies":2058,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1356,"num_write_kb":65344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"31'1403","reported_seq":1451,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-22T03:51:24.879759+0000","last_change":"2024-09-22T03:49:25.212585+0000","last_active":"2024-09-22T03:51:24.879759+0000","last_peered":"2024-09-22T03:51:24.879759+0000","last_clean":"2024-09-22T03:51:24.879759+0000","last_became_active":"2024-09-22T03:49:25.203356+0000","last_became_peered":"2024-09-22T03:49:25.203356+0000","last_unstale":"2024-09-22T03:51:24.879759+0000","last_undegraded":"2024-09-22T03:51:24.879759+0000","last_fullsized":"2024-09-22T03:51:24.879759+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1403,"log_dups_size":0,"ondisk_log_size":1403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45154304,"num_objects":689,"num_object_clones":0,"num_object_copies":2067,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1403,"num_write_kb":66944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"31'1382","reported_seq":1430,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-22T03:51:24.769525+0000","last_change":"2024-09-22T03:49:25.177465+0000","last_active":"2024-09-22T03:51:24.769525+0000","last_peered":"2024-09-22T03:51:24.769525+0000","last_clean":"2024-09-22T03:51:24.769525+0000","last_became_active":"2024-09-22T03:49:25.170026+0000","last_became_peered":"2024-09-22T03:49:25.170026+0000","last_unstale":"2024-09-22T03:51:24.769525+0000","last_undegraded":"2024-09-22T03:51:24.769525+0000","last_fullsized":"2024-09-22T03:51:24.769525+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1382,"log_dups_size":0,"ondisk_log_size":1382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47316992,"num_objects":722,"num_object_clones":0,"num_object_copies":2166,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1382,"num_write_kb":67328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":139,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T03:51:25.107442+0000","last_change":"2024-09-22T03:49:12.034704+0000","last_active":"2024-09-22T03:51:25.107442+0000","last_peered":"2024-09-22T03:51:25.107442+0000","last_clean":"2024-09-22T03:51:25.107442+0000","last_became_active":"2024-09-22T03:49:12.027470+0000","last_became_peered":"2024-09-22T03:49:12.027470+0000","last_unstale":"2024-09-22T03:51:25.107442+0000","last_undegraded":"2024-09-22T03:51:25.107442+0000","last_fullsized":"2024-09-22T03:51:25.107442+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_clean_scrub_stamp":"2024-09-22T03:49:10.979949+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":62,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-22T03:51:10.731317+0000","last_change":"2024-09-22T03:49:17.031458+0000","last_active":"2024-09-22T03:51:10.731317+0000","last_peered":"2024-09-22T03:51:10.731317+0000","last_clean":"2024-09-22T03:51:10.731317+0000","last_became_active":"2024-09-22T03:49:15.125490+0000","last_became_peered":"2024-09-22T03:49:15.125490+0000","last_unstale":"2024-09-22T03:51:10.731317+0000","last_undegraded":"2024-09-22T03:51:10.731317+0000","last_fullsized":"2024-09-22T03:51:10.731317+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"31'1343","reported_seq":1391,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-22T03:51:24.980963+0000","last_change":"2024-09-22T03:49:25.226827+0000","last_active":"2024-09-22T03:51:24.980963+0000","last_peered":"2024-09-22T03:51:24.980963+0000","last_clean":"2024-09-22T03:51:24.980963+0000","last_became_active":"2024-09-22T03:49:25.218579+0000","last_became_peered":"2024-09-22T03:49:25.218579+0000","last_unstale":"2024-09-22T03:51:24.980963+0000","last_undegraded":"2024-09-22T03:51:24.980963+0000","last_fullsized":"2024-09-22T03:51:24.980963+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1343,"log_dups_size":0,"ondisk_log_size":1343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42401792,"num_objects":647,"num_object_clones":0,"num_object_copies":1941,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1343,"num_write_kb":63680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-22T03:51:10.728573+0000","last_change":"2024-09-22T03:49:17.029339+0000","last_active":"2024-09-22T03:51:10.728573+0000","last_peered":"2024-09-22T03:51:10.728573+0000","last_clean":"2024-09-22T03:51:10.728573+0000","last_became_active":"2024-09-22T03:49:15.097304+0000","last_became_peered":"2024-09-22T03:49:15.097304+0000","last_unstale":"2024-09-22T03:51:10.728573+0000","last_undegraded":"2024-09-22T03:51:10.728573+0000","last_fullsized":"2024-09-22T03:51:10.728573+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"31'1360","reported_seq":1408,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-22T03:51:24.815442+0000","last_change":"2024-09-22T03:49:25.208298+0000","last_active":"2024-09-22T03:51:24.815442+0000","last_peered":"2024-09-22T03:51:24.815442+0000","last_clean":"2024-09-22T03:51:24.815442+0000","last_became_active":"2024-09-22T03:49:25.193750+0000","last_became_peered":"2024-09-22T03:49:25.193750+0000","last_unstale":"2024-09-22T03:51:24.815442+0000","last_undegraded":"2024-09-22T03:51:24.815442+0000","last_fullsized":"2024-09-22T03:51:24.815442+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1360,"log_dups_size":0,"ondisk_log_size":1360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45613056,"num_objects":696,"num_object_clones":0,"num_object_copies":2088,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1360,"num_write_kb":65792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-22T03:51:10.745463+0000","last_change":"2024-09-22T03:49:17.029349+0000","last_active":"2024-09-22T03:51:10.745463+0000","last_peered":"2024-09-22T03:51:10.745463+0000","last_clean":"2024-09-22T03:51:10.745463+0000","last_became_active":"2024-09-22T03:49:15.094890+0000","last_became_peered":"2024-09-22T03:49:15.094890+0000","last_unstale":"2024-09-22T03:51:10.745463+0000","last_undegraded":"2024-09-22T03:51:10.745463+0000","last_fullsized":"2024-09-22T03:51:10.745463+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"32'1447","reported_seq":1498,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T03:51:26.047917+0000","last_change":"2024-09-22T03:49:25.226551+0000","last_active":"2024-09-22T03:51:26.047917+0000","last_peered":"2024-09-22T03:51:26.047917+0000","last_clean":"2024-09-22T03:51:26.047917+0000","last_became_active":"2024-09-22T03:49:25.213989+0000","last_became_peered":"2024-09-22T03:49:25.213989+0000","last_unstale":"2024-09-22T03:51:26.047917+0000","last_undegraded":"2024-09-22T03:51:26.047917+0000","last_fullsized":"2024-09-22T03:51:26.047917+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1447,"log_dups_size":0,"ondisk_log_size":1447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45285376,"num_objects":691,"num_object_clones":0,"num_object_copies":2073,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1447,"num_write_kb":68416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":63,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-22T03:51:10.732680+0000","last_change":"2024-09-22T03:49:17.031466+0000","last_active":"2024-09-22T03:51:10.732680+0000","last_peered":"2024-09-22T03:51:10.732680+0000","last_clean":"2024-09-22T03:51:10.732680+0000","last_became_active":"2024-09-22T03:49:15.098420+0000","last_became_peered":"2024-09-22T03:49:15.098420+0000","last_unstale":"2024-09-22T03:51:10.732680+0000","last_undegraded":"2024-09-22T03:51:10.732680+0000","last_fullsized":"2024-09-22T03:51:10.732680+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"31'1337","reported_seq":1385,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-22T03:51:24.907917+0000","last_change":"2024-09-22T03:49:25.163198+0000","last_active":"2024-09-22T03:51:24.907917+0000","last_peered":"2024-09-22T03:51:24.907917+0000","last_clean":"2024-09-22T03:51:24.907917+0000","last_became_active":"2024-09-22T03:49:25.145723+0000","last_became_peered":"2024-09-22T03:49:25.145723+0000","last_unstale":"2024-09-22T03:51:24.907917+0000","last_undegraded":"2024-09-22T03:51:24.907917+0000","last_fullsized":"2024-09-22T03:51:24.907917+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1337,"log_dups_size":0,"ondisk_log_size":1337,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44892160,"num_objects":685,"num_object_clones":0,"num_object_copies":2055,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1337,"num_write_kb":64704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"31'1361","reported_seq":1409,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-22T03:51:24.895604+0000","last_change":"2024-09-22T03:49:25.168751+0000","last_active":"2024-09-22T03:51:24.895604+0000","last_peered":"2024-09-22T03:51:24.895604+0000","last_clean":"2024-09-22T03:51:24.895604+0000","last_became_active":"2024-09-22T03:49:25.160072+0000","last_became_peered":"2024-09-22T03:49:25.160072+0000","last_unstale":"2024-09-22T03:51:24.895604+0000","last_undegraded":"2024-09-22T03:51:24.895604+0000","last_fullsized":"2024-09-22T03:51:24.895604+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1361,"log_dups_size":0,"ondisk_log_size":1361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46858240,"num_objects":715,"num_object_clones":0,"num_object_copies":2145,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1361,"num_write_kb":66432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T03:51:25.136740+0000","last_change":"2024-09-22T03:49:17.036954+0000","last_active":"2024-09-22T03:51:25.136740+0000","last_peered":"2024-09-22T03:51:25.136740+0000","last_clean":"2024-09-22T03:51:25.136740+0000","last_became_active":"2024-09-22T03:49:15.110506+0000","last_became_peered":"2024-09-22T03:49:15.110506+0000","last_unstale":"2024-09-22T03:51:25.136740+0000","last_undegraded":"2024-09-22T03:51:25.136740+0000","last_fullsized":"2024-09-22T03:51:25.136740+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"32'1385","reported_seq":1436,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T03:51:25.967617+0000","last_change":"2024-09-22T03:49:25.218967+0000","last_active":"2024-09-22T03:51:25.967617+0000","last_peered":"2024-09-22T03:51:25.967617+0000","last_clean":"2024-09-22T03:51:25.967617+0000","last_became_active":"2024-09-22T03:49:25.203726+0000","last_became_peered":"2024-09-22T03:49:25.203726+0000","last_unstale":"2024-09-22T03:51:25.967617+0000","last_undegraded":"2024-09-22T03:51:25.967617+0000","last_fullsized":"2024-09-22T03:51:25.967617+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1385,"log_dups_size":0,"ondisk_log_size":1385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45154304,"num_objects":689,"num_object_clones":0,"num_object_copies":2067,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1385,"num_write_kb":66368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T03:51:25.110025+0000","last_change":"2024-09-22T03:49:17.032989+0000","last_active":"2024-09-22T03:51:25.110025+0000","last_peered":"2024-09-22T03:51:25.110025+0000","last_clean":"2024-09-22T03:51:25.110025+0000","last_became_active":"2024-09-22T03:49:15.079260+0000","last_became_peered":"2024-09-22T03:49:15.079260+0000","last_unstale":"2024-09-22T03:51:25.110025+0000","last_undegraded":"2024-09-22T03:51:25.110025+0000","last_fullsized":"2024-09-22T03:51:25.110025+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"32'1349","reported_seq":1400,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T03:51:26.026941+0000","last_change":"2024-09-22T03:49:25.275215+0000","last_active":"2024-09-22T03:51:26.026941+0000","last_peered":"2024-09-22T03:51:26.026941+0000","last_clean":"2024-09-22T03:51:26.026941+0000","last_became_active":"2024-09-22T03:49:25.260843+0000","last_became_peered":"2024-09-22T03:49:25.260843+0000","last_unstale":"2024-09-22T03:51:26.026941+0000","last_undegraded":"2024-09-22T03:51:26.026941+0000","last_fullsized":"2024-09-22T03:51:26.026941+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1349,"log_dups_size":0,"ondisk_log_size":1349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45678592,"num_objects":697,"num_object_clones":0,"num_object_copies":2091,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1349,"num_write_kb":65472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-22T03:51:25.114866+0000","last_change":"2024-09-22T03:49:17.036402+0000","last_active":"2024-09-22T03:51:25.114866+0000","last_peered":"2024-09-22T03:51:25.114866+0000","last_clean":"2024-09-22T03:51:25.114866+0000","last_became_active":"2024-09-22T03:49:15.108430+0000","last_became_peered":"2024-09-22T03:49:15.108430+0000","last_unstale":"2024-09-22T03:51:25.114866+0000","last_undegraded":"2024-09-22T03:51:25.114866+0000","last_fullsized":"2024-09-22T03:51:25.114866+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"31'1384","reported_seq":1432,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-22T03:51:24.864053+0000","last_change":"2024-09-22T03:49:25.211493+0000","last_active":"2024-09-22T03:51:24.864053+0000","last_peered":"2024-09-22T03:51:24.864053+0000","last_clean":"2024-09-22T03:51:24.864053+0000","last_became_active":"2024-09-22T03:49:25.194855+0000","last_became_peered":"2024-09-22T03:49:25.194855+0000","last_unstale":"2024-09-22T03:51:24.864053+0000","last_undegraded":"2024-09-22T03:51:24.864053+0000","last_fullsized":"2024-09-22T03:51:24.864053+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1384,"log_dups_size":0,"ondisk_log_size":1384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45613056,"num_objects":696,"num_object_clones":0,"num_object_copies":2088,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1384,"num_write_kb":66560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-22T03:51:10.726537+0000","last_change":"2024-09-22T03:49:17.029128+0000","last_active":"2024-09-22T03:51:10.726537+0000","last_peered":"2024-09-22T03:51:10.726537+0000","last_clean":"2024-09-22T03:51:10.726537+0000","last_became_active":"2024-09-22T03:49:15.113396+0000","last_became_peered":"2024-09-22T03:49:15.113396+0000","last_unstale":"2024-09-22T03:51:10.726537+0000","last_undegraded":"2024-09-22T03:51:10.726537+0000","last_fullsized":"2024-09-22T03:51:10.726537+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":730791960,"num_objects":11152,"num_object_clones":0,"num_object_copies":33456,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":21968,"num_write_kb":1059777,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":137080832,"data_stored":2193096776,"data_compressed":104139965,"data_compressed_allocated":137068544,"data_compressed_original":2193096704,"omap_allocated":0,"internal_metadata":0},"log_size":21968,"ondisk_log_size":21968,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949673094,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":85560,"kb_used_data":36520,"kb_used_omap":0,"kb_used_meta":49024,"kb_avail":94286280,"statfs":{"total":96636764160,"available":96549150720,"internally_reserved":0,"allocated":37396480,"data_stored":593650142,"data_compressed":28187431,"data_compressed_allocated":37101568,"data_compressed_original":593543168,"omap_allocated":0,"internal_metadata":50200576},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654705798,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":73612,"kb_used_data":34296,"kb_used_omap":0,"kb_used_meta":39296,"kb_avail":94298228,"statfs":{"total":96636764160,"available":96561385472,"internally_reserved":0,"allocated":35119104,"data_stored":557732597,"data_compressed":26480007,"data_compressed_allocated":34852864,"data_compressed_original":557645824,"omap_allocated":0,"internal_metadata":40239104},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705798,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":59520,"kb_used_data":28528,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94312320,"statfs":{"total":96636764160,"available":96575815680,"internally_reserved":0,"allocated":29212672,"data_stored":462902525,"data_compressed":21978992,"data_compressed_allocated":28930048,"data_compressed_original":462798848,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705798,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":64328,"kb_used_data":37492,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94307512,"statfs":{"total":96636764160,"available":96570892288,"internally_reserved":0,"allocated":38391808,"data_stored":609768706,"data_compressed":28952983,"data_compressed_allocated":38109184,"data_compressed_original":609665024,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":37593088,"data_stored":601423896,"data_compressed":28558823,"data_compressed_allocated":37588992,"data_compressed_original":601423872,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":36618240,"data_stored":585826328,"data_compressed":27818167,"data_compressed_allocated":36614144,"data_compressed_original":585826304,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28483584,"data_stored":455737344,"data_compressed":21640848,"data_compressed_allocated":28483584,"data_compressed_original":455737344,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":34385920,"data_stored":550109208,"data_compressed":26122127,"data_compressed_allocated":34381824,"data_compressed_original":550109184,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:51:29.248 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-22T03:51:29.248 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:51:29.249 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:51:29.249 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:51:29.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:51:29.415+0000 7ff0f4311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:29.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:51:29.428+0000 7ff0f4311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:29.484 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:51:29.485 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:51:29.485 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:51:29.485 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:51:29.485 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:51:29.485 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:51:29.485 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:51:29.485 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:51:29.485 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:51:29.485 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:51:29.485 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:51:29.485 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:51:29.490 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:51:29.490 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:51:29.490 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:51:29.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:51:29.630+0000 7fd3d7eac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:29.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:51:29.644+0000 7fd3d7eac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:29.703 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:51:29.859 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:51:29.859 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:51:29.859 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:51:29.859 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:51:29.860 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:51:29.860 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:51:29.860 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:51:29.860 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:51:29.860 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:51:29.860 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:51:29.860 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:51:29.860 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:51:29.863 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:51:29.863 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:51:29.863 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:51:29.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:51:29.878+0000 7ff43ab91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:29.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:51:29.887+0000 7ff43ab91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:30.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:51:30.036+0000 7f028b46c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:30.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:51:30.050+0000 7f028b46c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:30.083 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:51:30.083 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:51:30.083 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:51:30.083 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:51:30.083 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:51:30.083 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:51:30.083 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:51:30.083 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:51:30.083 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:51:30.083 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:51:30.084 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:51:30.084 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:51:30.086 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:51:30.087 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:51:30.087 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:51:30.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:51:30.268+0000 7f23cf951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:30.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:51:30.281+0000 7f23cf951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:30.310 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:51:30.310 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:51:30.310 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:51:30.310 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:51:30.310 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:51:30.310 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:51:30.310 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:51:30.311 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:51:30.311 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:51:30.311 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:51:30.311 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:51:30.311 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:51:30.314 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:51:30.315 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:51:32.355 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:51:32.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:51:32.524+0000 7f21c4b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:32.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:51:32.534+0000 7f21c4b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:34.912 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:51:35.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:51:35.088+0000 7f9a4c87d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:35.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:51:35.097+0000 7f9a4c87d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:35.315 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:51:35.315 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:51:35.316 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:51:35.316 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:51:35.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:51:35.489+0000 7fd383f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:35.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:51:35.505+0000 7fd383f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:35.575 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:51:35.576 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:51:35.576 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:51:35.576 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:51:35.576 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:51:35.576 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:51:35.576 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:51:35.576 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:51:35.577 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:51:35.577 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:51:35.577 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:51:35.577 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:51:35.578 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:51:35.579 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:51:35.579 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:51:35.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:51:35.739+0000 7f3c1e191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:35.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:51:35.755+0000 7f3c1e191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:35.899 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:51:35.899 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:51:35.899 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:51:35.899 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:51:35.899 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:51:35.899 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:51:35.900 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:51:35.900 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:51:35.900 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:51:35.900 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:51:35.900 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:51:35.900 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:51:35.903 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:51:35.904 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:51:35.904 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:51:36.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:51:36.066+0000 7f9918874640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:36.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:51:36.086+0000 7f9918874640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:36.152 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:51:36.152 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:51:36.152 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:51:36.152 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:51:36.152 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:51:36.152 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:51:36.152 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:51:36.152 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:51:36.152 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:51:36.152 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:51:36.153 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:51:36.153 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:51:36.156 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:51:36.156 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:51:36.157 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:51:36.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:51:36.306+0000 7fefe0f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:36.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:51:36.326+0000 7fefe0f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:36.354 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:51:36.355 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:51:36.355 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:51:36.355 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:51:36.355 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:51:36.355 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:51:36.355 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:51:36.355 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:51:36.355 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:51:36.355 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:51:36.355 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:51:36.355 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:51:36.358 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:51:36.359 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:51:37.666 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:51:37.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:51:37.829+0000 7f7a81846640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:37.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:51:37.840+0000 7f7a81846640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:40.370 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:51:40.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:51:40.529+0000 7f97b0b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:40.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:51:40.543+0000 7f97b0b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:41.359 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:51:41.359 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:51:41.359 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:51:41.360 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:51:41.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:51:41.512+0000 7f2b30391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:41.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:51:41.531+0000 7f2b30391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:41.698 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:51:41.699 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:51:41.699 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:51:41.699 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:51:41.699 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:51:41.699 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:51:41.699 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:51:41.699 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:51:41.699 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:51:41.699 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:51:41.699 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:51:41.699 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:51:41.702 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:51:41.703 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:51:41.703 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:51:41.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:51:41.884+0000 7f9397aa3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:41.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:51:41.905+0000 7f9396841640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:42.097 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:51:42.098 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:51:42.098 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:51:42.098 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:51:42.098 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:51:42.098 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:51:42.098 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:51:42.098 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:51:42.098 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:51:42.098 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:51:42.098 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:51:42.098 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:51:42.102 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:51:42.103 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:51:42.103 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:51:42.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:51:42.251+0000 7fe392991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:42.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:51:42.265+0000 7fe392991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:42.298 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:51:42.298 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:51:42.298 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:51:42.298 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:51:42.298 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:51:42.298 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:51:42.298 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:51:42.298 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:51:42.298 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:51:42.298 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:51:42.298 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:51:42.298 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:51:42.301 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:51:42.302 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:51:42.302 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:51:42.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:51:42.454+0000 7fe336351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:42.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:51:42.467+0000 7fe336351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:42.498 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:51:42.498 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:51:42.498 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:51:42.498 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:51:42.498 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:51:42.498 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:51:42.498 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:51:42.499 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:51:42.499 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:51:42.499 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:51:42.499 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:51:42.499 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:51:42.502 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:51:42.502 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:51:42.929 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:51:43.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:51:43.106+0000 7f47922bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:43.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:51:43.116+0000 7f47922bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:45.514 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:51:45.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:51:45.689+0000 7f8954d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:45.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:51:45.701+0000 7f8954d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:47.503 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:51:47.503 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:51:47.503 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:51:47.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:51:47.683+0000 7f8f776bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:47.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:51:47.699+0000 7f8f776bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:48.104 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:51:48.105 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-22T03:51:48.126 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":107,"stamp":"2024-09-22T03:51:46.995107+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":499188299,"num_objects":7613,"num_object_clones":0,"num_object_copies":22839,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":25592,"num_write_kb":1060885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25566,"ondisk_log_size":25566,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":301764,"kb_used_data":94520,"kb_used_omap":0,"kb_used_meta":207168,"kb_avail":377185596,"statfs":{"total":386547056640,"available":386238050304,"internally_reserved":0,"allocated":96788480,"data_stored":1528831641,"data_compressed":72584205,"data_compressed_allocated":95539200,"data_compressed_original":1528381440,"omap_allocated":0,"internal_metadata":212140032},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-178388992,"num_objects":-2722,"num_object_clones":0,"num_object_copies":-8166,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2722,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002590"},"pg_stats":[{"pgid":"3.f","version":"35'1594","reported_seq":1654,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-22T03:51:44.982860+0000","last_change":"2024-09-22T03:49:25.167073+0000","last_active":"2024-09-22T03:51:44.982860+0000","last_peered":"2024-09-22T03:51:44.982860+0000","last_clean":"2024-09-22T03:51:44.982860+0000","last_became_active":"2024-09-22T03:49:25.159818+0000","last_became_peered":"2024-09-22T03:49:25.159818+0000","last_unstale":"2024-09-22T03:51:44.982860+0000","last_undegraded":"2024-09-22T03:51:44.982860+0000","last_fullsized":"2024-09-22T03:51:44.982860+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1594,"log_dups_size":0,"ondisk_log_size":1594,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32768000,"num_objects":500,"num_object_clones":0,"num_object_copies":1500,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1594,"num_write_kb":67008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"35'1624","reported_seq":1684,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-22T03:51:45.917166+0000","last_change":"2024-09-22T03:49:25.238720+0000","last_active":"2024-09-22T03:51:45.917166+0000","last_peered":"2024-09-22T03:51:45.917166+0000","last_clean":"2024-09-22T03:51:45.917166+0000","last_became_active":"2024-09-22T03:49:25.229005+0000","last_became_peered":"2024-09-22T03:49:25.229005+0000","last_unstale":"2024-09-22T03:51:45.917166+0000","last_undegraded":"2024-09-22T03:51:45.917166+0000","last_fullsized":"2024-09-22T03:51:45.917166+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1624,"log_dups_size":0,"ondisk_log_size":1624,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31850496,"num_objects":486,"num_object_clones":0,"num_object_copies":1458,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1624,"num_write_kb":67520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"35'1637","reported_seq":1698,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-22T03:51:44.943586+0000","last_change":"2024-09-22T03:49:25.173605+0000","last_active":"2024-09-22T03:51:44.943586+0000","last_peered":"2024-09-22T03:51:44.943586+0000","last_clean":"2024-09-22T03:51:44.943586+0000","last_became_active":"2024-09-22T03:49:25.165491+0000","last_became_peered":"2024-09-22T03:49:25.165491+0000","last_unstale":"2024-09-22T03:51:44.943586+0000","last_undegraded":"2024-09-22T03:51:44.943586+0000","last_fullsized":"2024-09-22T03:51:44.943586+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1637,"log_dups_size":0,"ondisk_log_size":1637,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32374808,"num_objects":495,"num_object_clones":0,"num_object_copies":1485,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1637,"num_write_kb":68161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"35'1541","reported_seq":1601,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-22T03:51:44.896361+0000","last_change":"2024-09-22T03:49:25.207920+0000","last_active":"2024-09-22T03:51:44.896361+0000","last_peered":"2024-09-22T03:51:44.896361+0000","last_clean":"2024-09-22T03:51:44.896361+0000","last_became_active":"2024-09-22T03:49:25.198168+0000","last_became_peered":"2024-09-22T03:49:25.198168+0000","last_unstale":"2024-09-22T03:51:44.896361+0000","last_undegraded":"2024-09-22T03:51:44.896361+0000","last_fullsized":"2024-09-22T03:51:44.896361+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1541,"log_dups_size":0,"ondisk_log_size":1541,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30343168,"num_objects":463,"num_object_clones":0,"num_object_copies":1389,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1541,"num_write_kb":64128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"35'1596","reported_seq":1656,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-22T03:51:46.002157+0000","last_change":"2024-09-22T03:49:25.280543+0000","last_active":"2024-09-22T03:51:46.002157+0000","last_peered":"2024-09-22T03:51:46.002157+0000","last_clean":"2024-09-22T03:51:46.002157+0000","last_became_active":"2024-09-22T03:49:25.268731+0000","last_became_peered":"2024-09-22T03:49:25.268731+0000","last_unstale":"2024-09-22T03:51:46.002157+0000","last_undegraded":"2024-09-22T03:51:46.002157+0000","last_fullsized":"2024-09-22T03:51:46.002157+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1596,"log_dups_size":0,"ondisk_log_size":1596,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30408704,"num_objects":464,"num_object_clones":0,"num_object_copies":1392,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1596,"num_write_kb":65920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"35'1567","reported_seq":1627,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-22T03:51:44.698600+0000","last_change":"2024-09-22T03:49:25.206225+0000","last_active":"2024-09-22T03:51:44.698600+0000","last_peered":"2024-09-22T03:51:44.698600+0000","last_clean":"2024-09-22T03:51:44.698600+0000","last_became_active":"2024-09-22T03:49:25.201227+0000","last_became_peered":"2024-09-22T03:49:25.201227+0000","last_unstale":"2024-09-22T03:51:44.698600+0000","last_undegraded":"2024-09-22T03:51:44.698600+0000","last_fullsized":"2024-09-22T03:51:44.698600+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1567,"log_dups_size":0,"ondisk_log_size":1567,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31129600,"num_objects":475,"num_object_clones":0,"num_object_copies":1425,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1567,"num_write_kb":65344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"35'1630","reported_seq":1690,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-22T03:51:44.934131+0000","last_change":"2024-09-22T03:49:25.212585+0000","last_active":"2024-09-22T03:51:44.934131+0000","last_peered":"2024-09-22T03:51:44.934131+0000","last_clean":"2024-09-22T03:51:44.934131+0000","last_became_active":"2024-09-22T03:49:25.203356+0000","last_became_peered":"2024-09-22T03:49:25.203356+0000","last_unstale":"2024-09-22T03:51:44.934131+0000","last_undegraded":"2024-09-22T03:51:44.934131+0000","last_fullsized":"2024-09-22T03:51:44.934131+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1630,"log_dups_size":0,"ondisk_log_size":1630,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30277632,"num_objects":462,"num_object_clones":0,"num_object_copies":1386,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1630,"num_write_kb":66944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"35'1599","reported_seq":1659,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-22T03:51:44.802387+0000","last_change":"2024-09-22T03:49:25.177465+0000","last_active":"2024-09-22T03:51:44.802387+0000","last_peered":"2024-09-22T03:51:44.802387+0000","last_clean":"2024-09-22T03:51:44.802387+0000","last_became_active":"2024-09-22T03:49:25.170026+0000","last_became_peered":"2024-09-22T03:49:25.170026+0000","last_unstale":"2024-09-22T03:51:44.802387+0000","last_undegraded":"2024-09-22T03:51:44.802387+0000","last_fullsized":"2024-09-22T03:51:44.802387+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1599,"log_dups_size":0,"ondisk_log_size":1599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33095680,"num_objects":505,"num_object_clones":0,"num_object_copies":1515,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1599,"num_write_kb":67328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":148,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-22T03:51:28.139566+0000","last_change":"2024-09-22T03:49:12.034704+0000","last_active":"2024-09-22T03:51:28.139566+0000","last_peered":"2024-09-22T03:51:28.139566+0000","last_clean":"2024-09-22T03:51:28.139566+0000","last_became_active":"2024-09-22T03:49:12.027470+0000","last_became_peered":"2024-09-22T03:49:12.027470+0000","last_unstale":"2024-09-22T03:51:28.139566+0000","last_undegraded":"2024-09-22T03:51:28.139566+0000","last_fullsized":"2024-09-22T03:51:28.139566+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_clean_scrub_stamp":"2024-09-22T03:49:10.979949+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":74,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-22T03:51:28.118153+0000","last_change":"2024-09-22T03:49:17.031458+0000","last_active":"2024-09-22T03:51:28.118153+0000","last_peered":"2024-09-22T03:51:28.118153+0000","last_clean":"2024-09-22T03:51:28.118153+0000","last_became_active":"2024-09-22T03:49:15.125490+0000","last_became_peered":"2024-09-22T03:49:15.125490+0000","last_unstale":"2024-09-22T03:51:28.118153+0000","last_undegraded":"2024-09-22T03:51:28.118153+0000","last_fullsized":"2024-09-22T03:51:28.118153+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"35'1534","reported_seq":1594,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-22T03:51:44.957491+0000","last_change":"2024-09-22T03:49:25.226827+0000","last_active":"2024-09-22T03:51:44.957491+0000","last_peered":"2024-09-22T03:51:44.957491+0000","last_clean":"2024-09-22T03:51:44.957491+0000","last_became_active":"2024-09-22T03:49:25.218579+0000","last_became_peered":"2024-09-22T03:49:25.218579+0000","last_unstale":"2024-09-22T03:51:44.957491+0000","last_undegraded":"2024-09-22T03:51:44.957491+0000","last_fullsized":"2024-09-22T03:51:44.957491+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1534,"log_dups_size":0,"ondisk_log_size":1534,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29884416,"num_objects":456,"num_object_clones":0,"num_object_copies":1368,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1534,"num_write_kb":63680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":73,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-22T03:51:28.113105+0000","last_change":"2024-09-22T03:49:17.029339+0000","last_active":"2024-09-22T03:51:28.113105+0000","last_peered":"2024-09-22T03:51:28.113105+0000","last_clean":"2024-09-22T03:51:28.113105+0000","last_became_active":"2024-09-22T03:49:15.097304+0000","last_became_peered":"2024-09-22T03:49:15.097304+0000","last_unstale":"2024-09-22T03:51:28.113105+0000","last_undegraded":"2024-09-22T03:51:28.113105+0000","last_fullsized":"2024-09-22T03:51:28.113105+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"35'1585","reported_seq":1645,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-22T03:51:45.027461+0000","last_change":"2024-09-22T03:49:25.208298+0000","last_active":"2024-09-22T03:51:45.027461+0000","last_peered":"2024-09-22T03:51:45.027461+0000","last_clean":"2024-09-22T03:51:45.027461+0000","last_became_active":"2024-09-22T03:49:25.193750+0000","last_became_peered":"2024-09-22T03:49:25.193750+0000","last_unstale":"2024-09-22T03:51:45.027461+0000","last_undegraded":"2024-09-22T03:51:45.027461+0000","last_fullsized":"2024-09-22T03:51:45.027461+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1585,"log_dups_size":0,"ondisk_log_size":1585,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30867456,"num_objects":471,"num_object_clones":0,"num_object_copies":1413,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1585,"num_write_kb":65792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":73,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-22T03:51:28.124201+0000","last_change":"2024-09-22T03:49:17.029349+0000","last_active":"2024-09-22T03:51:28.124201+0000","last_peered":"2024-09-22T03:51:28.124201+0000","last_clean":"2024-09-22T03:51:28.124201+0000","last_became_active":"2024-09-22T03:49:15.094890+0000","last_became_peered":"2024-09-22T03:49:15.094890+0000","last_unstale":"2024-09-22T03:51:28.124201+0000","last_undegraded":"2024-09-22T03:51:28.124201+0000","last_fullsized":"2024-09-22T03:51:28.124201+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"35'1681","reported_seq":1741,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-22T03:51:46.001611+0000","last_change":"2024-09-22T03:49:25.226551+0000","last_active":"2024-09-22T03:51:46.001611+0000","last_peered":"2024-09-22T03:51:46.001611+0000","last_clean":"2024-09-22T03:51:46.001611+0000","last_became_active":"2024-09-22T03:49:25.213989+0000","last_became_peered":"2024-09-22T03:49:25.213989+0000","last_unstale":"2024-09-22T03:51:46.001611+0000","last_undegraded":"2024-09-22T03:51:46.001611+0000","last_fullsized":"2024-09-22T03:51:46.001611+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1681,"log_dups_size":0,"ondisk_log_size":1681,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29949952,"num_objects":457,"num_object_clones":0,"num_object_copies":1371,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1681,"num_write_kb":68416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":75,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-22T03:51:28.122820+0000","last_change":"2024-09-22T03:49:17.031466+0000","last_active":"2024-09-22T03:51:28.122820+0000","last_peered":"2024-09-22T03:51:28.122820+0000","last_clean":"2024-09-22T03:51:28.122820+0000","last_became_active":"2024-09-22T03:49:15.098420+0000","last_became_peered":"2024-09-22T03:49:15.098420+0000","last_unstale":"2024-09-22T03:51:28.122820+0000","last_undegraded":"2024-09-22T03:51:28.122820+0000","last_fullsized":"2024-09-22T03:51:28.122820+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"35'1567","reported_seq":1627,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-22T03:51:45.013484+0000","last_change":"2024-09-22T03:49:25.163198+0000","last_active":"2024-09-22T03:51:45.013484+0000","last_peered":"2024-09-22T03:51:45.013484+0000","last_clean":"2024-09-22T03:51:45.013484+0000","last_became_active":"2024-09-22T03:49:25.145723+0000","last_became_peered":"2024-09-22T03:49:25.145723+0000","last_unstale":"2024-09-22T03:51:45.013484+0000","last_undegraded":"2024-09-22T03:51:45.013484+0000","last_fullsized":"2024-09-22T03:51:45.013484+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1567,"log_dups_size":0,"ondisk_log_size":1567,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29818880,"num_objects":455,"num_object_clones":0,"num_object_copies":1365,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1567,"num_write_kb":64704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"35'1584","reported_seq":1644,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-22T03:51:44.754337+0000","last_change":"2024-09-22T03:49:25.168751+0000","last_active":"2024-09-22T03:51:44.754337+0000","last_peered":"2024-09-22T03:51:44.754337+0000","last_clean":"2024-09-22T03:51:44.754337+0000","last_became_active":"2024-09-22T03:49:25.160072+0000","last_became_peered":"2024-09-22T03:49:25.160072+0000","last_unstale":"2024-09-22T03:51:44.754337+0000","last_undegraded":"2024-09-22T03:51:44.754337+0000","last_fullsized":"2024-09-22T03:51:44.754337+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1584,"log_dups_size":0,"ondisk_log_size":1584,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32243712,"num_objects":492,"num_object_clones":0,"num_object_copies":1476,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1584,"num_write_kb":66432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":73,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-22T03:51:28.133794+0000","last_change":"2024-09-22T03:49:17.036954+0000","last_active":"2024-09-22T03:51:28.133794+0000","last_peered":"2024-09-22T03:51:28.133794+0000","last_clean":"2024-09-22T03:51:28.133794+0000","last_became_active":"2024-09-22T03:49:15.110506+0000","last_became_peered":"2024-09-22T03:49:15.110506+0000","last_unstale":"2024-09-22T03:51:28.133794+0000","last_undegraded":"2024-09-22T03:51:28.133794+0000","last_fullsized":"2024-09-22T03:51:28.133794+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"35'1597","reported_seq":1657,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-22T03:51:46.064664+0000","last_change":"2024-09-22T03:49:25.218967+0000","last_active":"2024-09-22T03:51:46.064664+0000","last_peered":"2024-09-22T03:51:46.064664+0000","last_clean":"2024-09-22T03:51:46.064664+0000","last_became_active":"2024-09-22T03:49:25.203726+0000","last_became_peered":"2024-09-22T03:49:25.203726+0000","last_unstale":"2024-09-22T03:51:46.064664+0000","last_undegraded":"2024-09-22T03:51:46.064664+0000","last_fullsized":"2024-09-22T03:51:46.064664+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1597,"log_dups_size":0,"ondisk_log_size":1597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31260672,"num_objects":477,"num_object_clones":0,"num_object_copies":1431,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1597,"num_write_kb":66368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":73,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-22T03:51:28.130681+0000","last_change":"2024-09-22T03:49:17.032989+0000","last_active":"2024-09-22T03:51:28.130681+0000","last_peered":"2024-09-22T03:51:28.130681+0000","last_clean":"2024-09-22T03:51:28.130681+0000","last_became_active":"2024-09-22T03:49:15.079260+0000","last_became_peered":"2024-09-22T03:49:15.079260+0000","last_unstale":"2024-09-22T03:51:28.130681+0000","last_undegraded":"2024-09-22T03:51:28.130681+0000","last_fullsized":"2024-09-22T03:51:28.130681+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"35'1578","reported_seq":1638,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-22T03:51:46.031285+0000","last_change":"2024-09-22T03:49:25.275215+0000","last_active":"2024-09-22T03:51:46.031285+0000","last_peered":"2024-09-22T03:51:46.031285+0000","last_clean":"2024-09-22T03:51:46.031285+0000","last_became_active":"2024-09-22T03:49:25.260843+0000","last_became_peered":"2024-09-22T03:49:25.260843+0000","last_unstale":"2024-09-22T03:51:46.031285+0000","last_undegraded":"2024-09-22T03:51:46.031285+0000","last_fullsized":"2024-09-22T03:51:46.031285+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1578,"log_dups_size":0,"ondisk_log_size":1578,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30670848,"num_objects":468,"num_object_clones":0,"num_object_copies":1404,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1578,"num_write_kb":65472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":73,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-22T03:51:28.140562+0000","last_change":"2024-09-22T03:49:17.036402+0000","last_active":"2024-09-22T03:51:28.140562+0000","last_peered":"2024-09-22T03:51:28.140562+0000","last_clean":"2024-09-22T03:51:28.140562+0000","last_became_active":"2024-09-22T03:49:15.108430+0000","last_became_peered":"2024-09-22T03:49:15.108430+0000","last_unstale":"2024-09-22T03:51:28.140562+0000","last_undegraded":"2024-09-22T03:51:28.140562+0000","last_fullsized":"2024-09-22T03:51:28.140562+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"35'1597","reported_seq":1657,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-22T03:51:44.956690+0000","last_change":"2024-09-22T03:49:25.211493+0000","last_active":"2024-09-22T03:51:44.956690+0000","last_peered":"2024-09-22T03:51:44.956690+0000","last_clean":"2024-09-22T03:51:44.956690+0000","last_became_active":"2024-09-22T03:49:25.194855+0000","last_became_peered":"2024-09-22T03:49:25.194855+0000","last_unstale":"2024-09-22T03:51:44.956690+0000","last_undegraded":"2024-09-22T03:51:44.956690+0000","last_fullsized":"2024-09-22T03:51:44.956690+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1597,"log_dups_size":0,"ondisk_log_size":1597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31653888,"num_objects":483,"num_object_clones":0,"num_object_copies":1449,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1597,"num_write_kb":66560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":73,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-22T03:51:28.115226+0000","last_change":"2024-09-22T03:49:17.029128+0000","last_active":"2024-09-22T03:51:28.115226+0000","last_peered":"2024-09-22T03:51:28.115226+0000","last_clean":"2024-09-22T03:51:28.115226+0000","last_became_active":"2024-09-22T03:49:15.113396+0000","last_became_peered":"2024-09-22T03:49:15.113396+0000","last_unstale":"2024-09-22T03:51:28.115226+0000","last_undegraded":"2024-09-22T03:51:28.115226+0000","last_fullsized":"2024-09-22T03:51:28.115226+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":498597912,"num_objects":7609,"num_object_clones":0,"num_object_copies":22827,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":25511,"num_write_kb":1059777,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":93691904,"data_stored":1498873928,"data_compressed":71174549,"data_compressed_allocated":93679616,"data_compressed_original":1498873856,"omap_allocated":0,"internal_metadata":0},"log_size":25511,"ondisk_log_size":25511,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949673114,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":82372,"kb_used_data":25008,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94289468,"statfs":{"total":96636764160,"available":96552415232,"internally_reserved":0,"allocated":25608192,"data_stored":404654137,"data_compressed":19212423,"data_compressed_allocated":25288704,"data_compressed_original":404537344,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654705818,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":77004,"kb_used_data":23804,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94294836,"statfs":{"total":96636764160,"available":96557912064,"internally_reserved":0,"allocated":24375296,"data_stored":385320473,"data_compressed":18292335,"data_compressed_allocated":24076288,"data_compressed_original":385220608,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705818,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":59100,"kb_used_data":19784,"kb_used_omap":0,"kb_used_meta":39296,"kb_avail":94312740,"statfs":{"total":96636764160,"available":96576245760,"internally_reserved":0,"allocated":20258816,"data_stored":319129633,"data_compressed":15151264,"data_compressed_allocated":19943424,"data_compressed_original":319012864,"omap_allocated":0,"internal_metadata":40239104},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705818,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":83288,"kb_used_data":25924,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94288552,"statfs":{"total":96636764160,"available":96551477248,"internally_reserved":0,"allocated":26546176,"data_stored":419727398,"data_compressed":19928183,"data_compressed_allocated":26230784,"data_compressed_original":419610624,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":25710592,"data_stored":411303960,"data_compressed":19530911,"data_compressed_allocated":25706496,"data_compressed_original":411303936,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24838144,"data_stored":397344792,"data_compressed":18868055,"data_compressed_allocated":24834048,"data_compressed_original":397344768,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":19509248,"data_stored":312147968,"data_compressed":14822456,"data_compressed_allocated":19509248,"data_compressed_original":312147968,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":23633920,"data_stored":378077208,"data_compressed":17953127,"data_compressed_allocated":23629824,"data_compressed_original":378077184,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:51:48.196 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:51:48.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:51:48.352+0000 7f38c2951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:48.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:51:48.364+0000 7f38c2951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:50.888 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:51:51.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:51:51.045+0000 7f06a4391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:51.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:51:51.056+0000 7f06a4391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:53.128 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:51:53.128 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:51:53.128 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:51:53.129 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:51:53.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:51:53.297+0000 7f8eed8d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:53.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:51:53.312+0000 7f8eed8d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:53.462 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:51:53.463 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:51:53.463 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:51:53.463 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:51:53.463 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:51:53.463 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:51:53.463 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:51:53.463 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:51:53.463 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:51:53.463 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:51:53.463 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:51:53.463 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:51:53.467 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:51:53.467 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:51:53.467 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:51:53.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:51:53.614+0000 7fe08fd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:53.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:51:53.633+0000 7fe08fd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:53.658 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:51:53.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:51:53.807+0000 7f5d60a74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:53.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:51:53.819+0000 7f5d60a74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:53.836 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:51:53.836 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:51:53.836 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:51:53.836 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:51:53.836 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:51:53.836 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:51:53.836 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:51:53.836 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:51:53.836 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:51:53.837 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:51:53.837 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:51:53.837 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:51:53.840 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:51:53.841 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:51:53.841 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:51:54.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:51:53.999+0000 7fbdc0591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:54.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:51:54.015+0000 7fbdc0591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:54.086 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:51:54.087 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:51:54.087 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:51:54.087 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:51:54.087 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:51:54.087 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:51:54.087 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:51:54.087 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:51:54.087 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:51:54.087 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:51:54.087 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:51:54.087 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:51:54.091 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:51:54.091 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:51:54.092 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:51:54.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:51:54.241+0000 7f728fb08640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:54.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:51:54.259+0000 7f728fb08640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:54.288 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:51:54.288 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:51:54.288 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:51:54.288 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:51:54.288 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:51:54.288 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:51:54.288 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:51:54.288 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:51:54.288 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:51:54.288 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:51:54.288 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:51:54.288 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:51:54.292 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:51:54.292 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:51:56.231 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:51:56.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:51:56.396+0000 7f65fb311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:56.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:51:56.407+0000 7f65fb311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:59.004 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:51:59.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:51:59.165+0000 7f4efaed1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:59.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:51:59.175+0000 7f4efaed1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:59.293 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:51:59.293 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:51:59.293 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:51:59.294 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:51:59.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:51:59.472+0000 7fb6add91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:59.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:51:59.483+0000 7fb6add91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:59.507 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:51:59.507 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:51:59.507 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:51:59.507 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:51:59.507 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:51:59.507 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:51:59.508 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:51:59.508 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:51:59.508 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:51:59.508 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:51:59.508 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:51:59.508 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:51:59.510 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:51:59.510 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:51:59.510 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:51:59.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:51:59.673+0000 7f50f2cc8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:59.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:51:59.689+0000 7f50f2cc8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:59.734 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:51:59.734 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:51:59.734 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:51:59.734 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:51:59.734 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:51:59.734 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:51:59.734 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:51:59.735 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:51:59.735 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:51:59.735 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:51:59.735 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:51:59.735 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:51:59.738 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:51:59.739 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:51:59.739 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:51:59.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:51:59.904+0000 7f6575274640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:59.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:51:59.927+0000 7f6575274640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:51:59.990 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:51:59.990 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:51:59.990 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:51:59.990 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:51:59.990 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:51:59.990 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:51:59.991 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:51:59.991 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:51:59.991 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:51:59.991 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:51:59.991 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:51:59.991 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:51:59.995 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:51:59.995 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:51:59.995 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:52:00.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:52:00.151+0000 7fbbdf4c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:52:00.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:52:00.164+0000 7fbbdf4c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:52:00.198 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:52:00.198 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:52:00.198 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:52:00.198 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:52:00.198 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:52:00.198 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:52:00.198 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:52:00.198 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:52:00.198 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:52:00.198 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:52:00.198 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:52:00.198 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:52:00.203 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:52:00.203 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:52:01.535 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:52:01.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:52:01.702+0000 7fbfb9391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:52:01.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:52:01.711+0000 7fbfb9391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:52:04.242 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:52:04.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:52:04.387+0000 7f952e191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:52:04.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:52:04.396+0000 7f952e191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:52:05.204 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:52:05.204 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:52:05.204 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:52:05.204 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:52:05.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:52:05.348+0000 7fbbbb551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:52:05.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:52:05.367+0000 7fbbbb551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:52:05.499 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:52:05.499 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:52:05.500 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:52:05.500 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:52:05.500 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:52:05.500 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:52:05.500 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:52:05.500 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:52:05.500 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:52:05.500 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:52:05.500 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:52:05.500 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:52:05.503 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:52:05.503 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:52:05.503 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:52:05.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:52:05.650+0000 7fb203e97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:52:05.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:52:05.668+0000 7fb203e97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:52:05.892 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:52:05.892 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:52:05.892 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:52:05.892 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:52:05.892 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:52:05.892 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:52:05.893 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:52:05.893 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:52:05.893 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:52:05.893 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:52:05.893 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:52:05.893 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:52:05.896 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:52:05.896 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:52:05.896 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:52:06.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:52:06.061+0000 7fcc78d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:52:06.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:52:06.079+0000 7fcc78d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:52:06.120 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:52:06.120 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:52:06.120 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:52:06.120 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:52:06.121 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:52:06.121 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:52:06.121 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:52:06.121 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:52:06.121 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:52:06.121 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:52:06.121 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:52:06.121 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:52:06.125 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:52:06.126 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:52:06.126 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:52:06.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:52:06.270+0000 7f4d06b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:52:06.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:52:06.284+0000 7f4d06b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:52:06.310 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:52:06.311 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:52:06.311 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:52:06.311 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:52:06.311 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:52:06.311 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:52:06.311 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:52:06.311 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:52:06.311 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:52:06.311 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:52:06.311 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:52:06.311 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:52:06.315 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:52:06.315 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:52:07.103 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:52:07.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:52:07.260+0000 7f9427791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:52:07.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:52:07.271+0000 7f9427791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:52:09.898 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:52:10.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:52:10.045+0000 7f5caa888640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:52:10.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:52:10.056+0000 7f5ca9626640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:52:11.316 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:52:11.316 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:52:11.316 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:52:11.316 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:52:11.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:52:11.487+0000 7fdd050ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:52:11.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:52:11.502+0000 7fdd050ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:52:11.805 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:52:11.806 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:52:11.806 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:52:11.806 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:52:11.806 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:52:11.806 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:52:11.806 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:52:11.806 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:52:11.806 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:52:11.806 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:52:11.806 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:52:11.806 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:52:11.810 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:52:11.810 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:52:11.810 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:52:11.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:52:11.984+0000 7fe980ea3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:52:11.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:52:11.997+0000 7fe980ea3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:52:12.254 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:52:12.254 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:52:12.254 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:52:12.254 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:52:12.254 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:52:12.254 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:52:12.254 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:52:12.254 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:52:12.255 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:52:12.255 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:52:12.255 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:52:12.255 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:52:12.259 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:52:12.260 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:52:12.260 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:52:12.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:52:12.414+0000 7f56d167f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:52:12.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:52:12.433+0000 7f56cbfff640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:52:12.467 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:52:12.467 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:52:12.467 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:52:12.468 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:52:12.468 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:52:12.468 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:52:12.468 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:52:12.468 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:52:12.468 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:52:12.468 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:52:12.468 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:52:12.468 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:52:12.473 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:52:12.473 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:52:12.473 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:52:12.542 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:52:12.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:52:12.631+0000 7fba70191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:52:12.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:52:12.650+0000 7fba70191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:52:12.700 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:52:12.702 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:52:12.702 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:52:12.702 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:52:12.702 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:52:12.702 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:52:12.702 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:52:12.702 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:52:12.702 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:52:12.702 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:52:12.703 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:52:12.703 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:52:12.709 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:52:12.709 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:52:12.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:52:12.711+0000 7f7f96d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:52:12.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:52:12.722+0000 7f7f96d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:52:15.117 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:52:15.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:52:15.268+0000 7ff934511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:52:15.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:52:15.278+0000 7ff934511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:52:17.710 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:52:17.710 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:52:17.710 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:52:17.711 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:52:17.745 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:52:17.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:52:17.874+0000 7f4a5dc5c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:52:17.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:52:17.894+0000 7f4a5dc5c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:52:17.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:52:17.910+0000 7f9403191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:52:17.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:52:17.926+0000 7f9403191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:52:18.236 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:52:18.237 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:52:18.237 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:52:18.237 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:52:18.237 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:52:18.237 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:52:18.237 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:52:18.237 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:52:18.237 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:52:18.237 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:52:18.237 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:52:18.237 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:52:18.240 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:52:18.241 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:52:18.241 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:52:18.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:52:18.415+0000 7ff627d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:52:18.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:52:18.434+0000 7ff627d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:52:18.612 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:52:18.613 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:52:18.613 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:52:18.613 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:52:18.613 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:52:18.613 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:52:18.613 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:52:18.613 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:52:18.613 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:52:18.613 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:52:18.613 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:52:18.613 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:52:18.616 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:52:18.616 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:52:18.617 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:52:18.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:52:18.802+0000 7f2ccc551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:52:18.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:52:18.814+0000 7f2ccc551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:52:18.871 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:52:18.871 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:52:18.871 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:52:18.871 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:52:18.871 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:52:18.871 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:52:18.871 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:52:18.871 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:52:18.871 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:52:18.871 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:52:18.871 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:52:18.871 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:52:18.877 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:52:18.878 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:52:18.878 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:52:19.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:52:19.031+0000 7f360f6bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:52:19.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:52:19.049+0000 7f360f6bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:52:19.094 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:52:19.094 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:52:19.094 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:52:19.094 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:52:19.095 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:52:19.095 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:52:19.095 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:52:19.095 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:52:19.095 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:52:19.095 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:52:19.095 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:52:19.095 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:52:19.099 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:52:19.099 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:52:20.392 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:52:20.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:52:20.527+0000 7f9dd0191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:52:20.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:52:20.535+0000 7f9dd0191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:52:23.070 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:52:23.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:52:23.246+0000 7f2991791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:52:23.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:52:23.255+0000 7f2991791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:52:24.100 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:52:24.101 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:52:24.101 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:52:24.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:52:24.278+0000 7fbb850d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:52:24.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:52:24.292+0000 7fbb850d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:52:24.647 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:52:24.647 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-22T03:52:24.667 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":125,"stamp":"2024-09-22T03:52:23.002594+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":105579083,"num_objects":1607,"num_object_clones":0,"num_object_copies":4821,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":31598,"num_write_kb":1060885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":31572,"ondisk_log_size":31572,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":222188,"kb_used_data":21856,"kb_used_omap":0,"kb_used_meta":200256,"kb_avail":377265172,"statfs":{"total":386547056640,"available":386319536128,"internally_reserved":0,"allocated":22380544,"data_stored":338304665,"data_compressed":16051616,"data_compressed_allocated":21131264,"data_compressed_original":337854464,"omap_allocated":0,"internal_metadata":205062144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-126418944,"num_objects":-1929,"num_object_clones":0,"num_object_copies":-5787,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1929,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002666"},"pg_stats":[{"pgid":"3.f","version":"35'1986","reported_seq":2046,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-22T03:52:19.855689+0000","last_change":"2024-09-22T03:49:25.167073+0000","last_active":"2024-09-22T03:52:19.855689+0000","last_peered":"2024-09-22T03:52:19.855689+0000","last_clean":"2024-09-22T03:52:19.855689+0000","last_became_active":"2024-09-22T03:49:25.159818+0000","last_became_peered":"2024-09-22T03:49:25.159818+0000","last_unstale":"2024-09-22T03:52:19.855689+0000","last_undegraded":"2024-09-22T03:52:19.855689+0000","last_fullsized":"2024-09-22T03:52:19.855689+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1986,"log_dups_size":0,"ondisk_log_size":1986,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7077888,"num_objects":108,"num_object_clones":0,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1986,"num_write_kb":67008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"35'2008","reported_seq":2068,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-22T03:52:20.532934+0000","last_change":"2024-09-22T03:49:25.238720+0000","last_active":"2024-09-22T03:52:20.532934+0000","last_peered":"2024-09-22T03:52:20.532934+0000","last_clean":"2024-09-22T03:52:20.532934+0000","last_became_active":"2024-09-22T03:49:25.229005+0000","last_became_peered":"2024-09-22T03:49:25.229005+0000","last_unstale":"2024-09-22T03:52:20.532934+0000","last_undegraded":"2024-09-22T03:52:20.532934+0000","last_fullsized":"2024-09-22T03:52:20.532934+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":2008,"log_dups_size":0,"ondisk_log_size":2008,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6684672,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2008,"num_write_kb":67520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"35'2028","reported_seq":2089,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-22T03:52:20.000126+0000","last_change":"2024-09-22T03:49:25.173605+0000","last_active":"2024-09-22T03:52:20.000126+0000","last_peered":"2024-09-22T03:52:20.000126+0000","last_clean":"2024-09-22T03:52:20.000126+0000","last_became_active":"2024-09-22T03:49:25.165491+0000","last_became_peered":"2024-09-22T03:49:25.165491+0000","last_unstale":"2024-09-22T03:52:20.000126+0000","last_undegraded":"2024-09-22T03:52:20.000126+0000","last_fullsized":"2024-09-22T03:52:20.000126+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":2028,"log_dups_size":0,"ondisk_log_size":2028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6750232,"num_objects":104,"num_object_clones":0,"num_object_copies":312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2028,"num_write_kb":68161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"35'1919","reported_seq":1979,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-22T03:52:19.870956+0000","last_change":"2024-09-22T03:49:25.207920+0000","last_active":"2024-09-22T03:52:19.870956+0000","last_peered":"2024-09-22T03:52:19.870956+0000","last_clean":"2024-09-22T03:52:19.870956+0000","last_became_active":"2024-09-22T03:49:25.198168+0000","last_became_peered":"2024-09-22T03:49:25.198168+0000","last_unstale":"2024-09-22T03:52:19.870956+0000","last_undegraded":"2024-09-22T03:52:19.870956+0000","last_fullsized":"2024-09-22T03:52:19.870956+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1919,"log_dups_size":0,"ondisk_log_size":1919,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5570560,"num_objects":85,"num_object_clones":0,"num_object_copies":255,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1919,"num_write_kb":64128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"35'1968","reported_seq":2028,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-22T03:52:20.970669+0000","last_change":"2024-09-22T03:49:25.280543+0000","last_active":"2024-09-22T03:52:20.970669+0000","last_peered":"2024-09-22T03:52:20.970669+0000","last_clean":"2024-09-22T03:52:20.970669+0000","last_became_active":"2024-09-22T03:49:25.268731+0000","last_became_peered":"2024-09-22T03:49:25.268731+0000","last_unstale":"2024-09-22T03:52:20.970669+0000","last_undegraded":"2024-09-22T03:52:20.970669+0000","last_fullsized":"2024-09-22T03:52:20.970669+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1968,"log_dups_size":0,"ondisk_log_size":1968,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6029312,"num_objects":92,"num_object_clones":0,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1968,"num_write_kb":65920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"35'1950","reported_seq":2010,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-22T03:52:19.978527+0000","last_change":"2024-09-22T03:49:25.206225+0000","last_active":"2024-09-22T03:52:19.978527+0000","last_peered":"2024-09-22T03:52:19.978527+0000","last_clean":"2024-09-22T03:52:19.978527+0000","last_became_active":"2024-09-22T03:49:25.201227+0000","last_became_peered":"2024-09-22T03:49:25.201227+0000","last_unstale":"2024-09-22T03:52:19.978527+0000","last_undegraded":"2024-09-22T03:52:19.978527+0000","last_fullsized":"2024-09-22T03:52:19.978527+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1950,"log_dups_size":0,"ondisk_log_size":1950,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6029312,"num_objects":92,"num_object_clones":0,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1950,"num_write_kb":65344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"35'1993","reported_seq":2053,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-22T03:52:19.810702+0000","last_change":"2024-09-22T03:49:25.212585+0000","last_active":"2024-09-22T03:52:19.810702+0000","last_peered":"2024-09-22T03:52:19.810702+0000","last_clean":"2024-09-22T03:52:19.810702+0000","last_became_active":"2024-09-22T03:49:25.203356+0000","last_became_peered":"2024-09-22T03:49:25.203356+0000","last_unstale":"2024-09-22T03:52:19.810702+0000","last_undegraded":"2024-09-22T03:52:19.810702+0000","last_fullsized":"2024-09-22T03:52:19.810702+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1993,"log_dups_size":0,"ondisk_log_size":1993,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6488064,"num_objects":99,"num_object_clones":0,"num_object_copies":297,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1993,"num_write_kb":66944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"35'1986","reported_seq":2046,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-22T03:52:19.955979+0000","last_change":"2024-09-22T03:49:25.177465+0000","last_active":"2024-09-22T03:52:19.955979+0000","last_peered":"2024-09-22T03:52:19.955979+0000","last_clean":"2024-09-22T03:52:19.955979+0000","last_became_active":"2024-09-22T03:49:25.170026+0000","last_became_peered":"2024-09-22T03:49:25.170026+0000","last_unstale":"2024-09-22T03:52:19.955979+0000","last_undegraded":"2024-09-22T03:52:19.955979+0000","last_fullsized":"2024-09-22T03:52:19.955979+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1986,"log_dups_size":0,"ondisk_log_size":1986,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7733248,"num_objects":118,"num_object_clones":0,"num_object_copies":354,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1986,"num_write_kb":67328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":148,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-22T03:51:28.139566+0000","last_change":"2024-09-22T03:49:12.034704+0000","last_active":"2024-09-22T03:51:28.139566+0000","last_peered":"2024-09-22T03:51:28.139566+0000","last_clean":"2024-09-22T03:51:28.139566+0000","last_became_active":"2024-09-22T03:49:12.027470+0000","last_became_peered":"2024-09-22T03:49:12.027470+0000","last_unstale":"2024-09-22T03:51:28.139566+0000","last_undegraded":"2024-09-22T03:51:28.139566+0000","last_fullsized":"2024-09-22T03:51:28.139566+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_clean_scrub_stamp":"2024-09-22T03:49:10.979949+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":74,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-22T03:51:28.118153+0000","last_change":"2024-09-22T03:49:17.031458+0000","last_active":"2024-09-22T03:51:28.118153+0000","last_peered":"2024-09-22T03:51:28.118153+0000","last_clean":"2024-09-22T03:51:28.118153+0000","last_became_active":"2024-09-22T03:49:15.125490+0000","last_became_peered":"2024-09-22T03:49:15.125490+0000","last_unstale":"2024-09-22T03:51:28.118153+0000","last_undegraded":"2024-09-22T03:51:28.118153+0000","last_fullsized":"2024-09-22T03:51:28.118153+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"35'1885","reported_seq":1945,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-22T03:52:19.783481+0000","last_change":"2024-09-22T03:49:25.226827+0000","last_active":"2024-09-22T03:52:19.783481+0000","last_peered":"2024-09-22T03:52:19.783481+0000","last_clean":"2024-09-22T03:52:19.783481+0000","last_became_active":"2024-09-22T03:49:25.218579+0000","last_became_peered":"2024-09-22T03:49:25.218579+0000","last_unstale":"2024-09-22T03:52:19.783481+0000","last_undegraded":"2024-09-22T03:52:19.783481+0000","last_fullsized":"2024-09-22T03:52:19.783481+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1885,"log_dups_size":0,"ondisk_log_size":1885,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6881280,"num_objects":105,"num_object_clones":0,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1885,"num_write_kb":63680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":73,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-22T03:51:28.113105+0000","last_change":"2024-09-22T03:49:17.029339+0000","last_active":"2024-09-22T03:51:28.113105+0000","last_peered":"2024-09-22T03:51:28.113105+0000","last_clean":"2024-09-22T03:51:28.113105+0000","last_became_active":"2024-09-22T03:49:15.097304+0000","last_became_peered":"2024-09-22T03:49:15.097304+0000","last_unstale":"2024-09-22T03:51:28.113105+0000","last_undegraded":"2024-09-22T03:51:28.113105+0000","last_fullsized":"2024-09-22T03:51:28.113105+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"35'1950","reported_seq":2010,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-22T03:52:19.615435+0000","last_change":"2024-09-22T03:49:25.208298+0000","last_active":"2024-09-22T03:52:19.615435+0000","last_peered":"2024-09-22T03:52:19.615435+0000","last_clean":"2024-09-22T03:52:19.615435+0000","last_became_active":"2024-09-22T03:49:25.193750+0000","last_became_peered":"2024-09-22T03:49:25.193750+0000","last_unstale":"2024-09-22T03:52:19.615435+0000","last_undegraded":"2024-09-22T03:52:19.615435+0000","last_fullsized":"2024-09-22T03:52:19.615435+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1950,"log_dups_size":0,"ondisk_log_size":1950,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6946816,"num_objects":106,"num_object_clones":0,"num_object_copies":318,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1950,"num_write_kb":65792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":73,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-22T03:51:28.124201+0000","last_change":"2024-09-22T03:49:17.029349+0000","last_active":"2024-09-22T03:51:28.124201+0000","last_peered":"2024-09-22T03:51:28.124201+0000","last_clean":"2024-09-22T03:51:28.124201+0000","last_became_active":"2024-09-22T03:49:15.094890+0000","last_became_peered":"2024-09-22T03:49:15.094890+0000","last_unstale":"2024-09-22T03:51:28.124201+0000","last_undegraded":"2024-09-22T03:51:28.124201+0000","last_fullsized":"2024-09-22T03:51:28.124201+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"35'2058","reported_seq":2118,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-22T03:52:20.862574+0000","last_change":"2024-09-22T03:49:25.226551+0000","last_active":"2024-09-22T03:52:20.862574+0000","last_peered":"2024-09-22T03:52:20.862574+0000","last_clean":"2024-09-22T03:52:20.862574+0000","last_became_active":"2024-09-22T03:49:25.213989+0000","last_became_peered":"2024-09-22T03:49:25.213989+0000","last_unstale":"2024-09-22T03:52:20.862574+0000","last_undegraded":"2024-09-22T03:52:20.862574+0000","last_fullsized":"2024-09-22T03:52:20.862574+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":2058,"log_dups_size":0,"ondisk_log_size":2058,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":80,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2058,"num_write_kb":68416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":75,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-22T03:51:28.122820+0000","last_change":"2024-09-22T03:49:17.031466+0000","last_active":"2024-09-22T03:51:28.122820+0000","last_peered":"2024-09-22T03:51:28.122820+0000","last_clean":"2024-09-22T03:51:28.122820+0000","last_became_active":"2024-09-22T03:49:15.098420+0000","last_became_peered":"2024-09-22T03:49:15.098420+0000","last_unstale":"2024-09-22T03:51:28.122820+0000","last_undegraded":"2024-09-22T03:51:28.122820+0000","last_fullsized":"2024-09-22T03:51:28.122820+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"35'1926","reported_seq":1986,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-22T03:52:19.788609+0000","last_change":"2024-09-22T03:49:25.163198+0000","last_active":"2024-09-22T03:52:19.788609+0000","last_peered":"2024-09-22T03:52:19.788609+0000","last_clean":"2024-09-22T03:52:19.788609+0000","last_became_active":"2024-09-22T03:49:25.145723+0000","last_became_peered":"2024-09-22T03:49:25.145723+0000","last_unstale":"2024-09-22T03:52:19.788609+0000","last_undegraded":"2024-09-22T03:52:19.788609+0000","last_fullsized":"2024-09-22T03:52:19.788609+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1926,"log_dups_size":0,"ondisk_log_size":1926,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":96,"num_object_clones":0,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1926,"num_write_kb":64704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"35'1978","reported_seq":2038,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-22T03:52:19.365582+0000","last_change":"2024-09-22T03:49:25.168751+0000","last_active":"2024-09-22T03:52:19.365582+0000","last_peered":"2024-09-22T03:52:19.365582+0000","last_clean":"2024-09-22T03:52:19.365582+0000","last_became_active":"2024-09-22T03:49:25.160072+0000","last_became_peered":"2024-09-22T03:49:25.160072+0000","last_unstale":"2024-09-22T03:52:19.365582+0000","last_undegraded":"2024-09-22T03:52:19.365582+0000","last_fullsized":"2024-09-22T03:52:19.365582+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1978,"log_dups_size":0,"ondisk_log_size":1978,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6422528,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1978,"num_write_kb":66432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":73,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-22T03:51:28.133794+0000","last_change":"2024-09-22T03:49:17.036954+0000","last_active":"2024-09-22T03:51:28.133794+0000","last_peered":"2024-09-22T03:51:28.133794+0000","last_clean":"2024-09-22T03:51:28.133794+0000","last_became_active":"2024-09-22T03:49:15.110506+0000","last_became_peered":"2024-09-22T03:49:15.110506+0000","last_unstale":"2024-09-22T03:51:28.133794+0000","last_undegraded":"2024-09-22T03:51:28.133794+0000","last_fullsized":"2024-09-22T03:51:28.133794+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"35'1972","reported_seq":2032,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-22T03:52:21.044352+0000","last_change":"2024-09-22T03:49:25.218967+0000","last_active":"2024-09-22T03:52:21.044352+0000","last_peered":"2024-09-22T03:52:21.044352+0000","last_clean":"2024-09-22T03:52:21.044352+0000","last_became_active":"2024-09-22T03:49:25.203726+0000","last_became_peered":"2024-09-22T03:49:25.203726+0000","last_unstale":"2024-09-22T03:52:21.044352+0000","last_undegraded":"2024-09-22T03:52:21.044352+0000","last_fullsized":"2024-09-22T03:52:21.044352+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1972,"log_dups_size":0,"ondisk_log_size":1972,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6684672,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1972,"num_write_kb":66368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":73,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-22T03:51:28.130681+0000","last_change":"2024-09-22T03:49:17.032989+0000","last_active":"2024-09-22T03:51:28.130681+0000","last_peered":"2024-09-22T03:51:28.130681+0000","last_clean":"2024-09-22T03:51:28.130681+0000","last_became_active":"2024-09-22T03:49:15.079260+0000","last_became_peered":"2024-09-22T03:49:15.079260+0000","last_unstale":"2024-09-22T03:51:28.130681+0000","last_undegraded":"2024-09-22T03:51:28.130681+0000","last_fullsized":"2024-09-22T03:51:28.130681+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"35'1944","reported_seq":2004,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-22T03:52:20.911823+0000","last_change":"2024-09-22T03:49:25.275215+0000","last_active":"2024-09-22T03:52:20.911823+0000","last_peered":"2024-09-22T03:52:20.911823+0000","last_clean":"2024-09-22T03:52:20.911823+0000","last_became_active":"2024-09-22T03:49:25.260843+0000","last_became_peered":"2024-09-22T03:49:25.260843+0000","last_unstale":"2024-09-22T03:52:20.911823+0000","last_undegraded":"2024-09-22T03:52:20.911823+0000","last_fullsized":"2024-09-22T03:52:20.911823+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1944,"log_dups_size":0,"ondisk_log_size":1944,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6684672,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1944,"num_write_kb":65472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":73,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-22T03:51:28.140562+0000","last_change":"2024-09-22T03:49:17.036402+0000","last_active":"2024-09-22T03:51:28.140562+0000","last_peered":"2024-09-22T03:51:28.140562+0000","last_clean":"2024-09-22T03:51:28.140562+0000","last_became_active":"2024-09-22T03:49:15.108430+0000","last_became_peered":"2024-09-22T03:49:15.108430+0000","last_unstale":"2024-09-22T03:51:28.140562+0000","last_undegraded":"2024-09-22T03:51:28.140562+0000","last_fullsized":"2024-09-22T03:51:28.140562+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"35'1966","reported_seq":2026,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-22T03:52:19.759545+0000","last_change":"2024-09-22T03:49:25.211493+0000","last_active":"2024-09-22T03:52:19.759545+0000","last_peered":"2024-09-22T03:52:19.759545+0000","last_clean":"2024-09-22T03:52:19.759545+0000","last_became_active":"2024-09-22T03:49:25.194855+0000","last_became_peered":"2024-09-22T03:49:25.194855+0000","last_unstale":"2024-09-22T03:52:19.759545+0000","last_undegraded":"2024-09-22T03:52:19.759545+0000","last_fullsized":"2024-09-22T03:52:19.759545+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1966,"log_dups_size":0,"ondisk_log_size":1966,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7471104,"num_objects":114,"num_object_clones":0,"num_object_copies":342,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1966,"num_write_kb":66560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":73,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-22T03:51:28.115226+0000","last_change":"2024-09-22T03:49:17.029128+0000","last_active":"2024-09-22T03:51:28.115226+0000","last_peered":"2024-09-22T03:51:28.115226+0000","last_clean":"2024-09-22T03:51:28.115226+0000","last_became_active":"2024-09-22T03:49:15.113396+0000","last_became_peered":"2024-09-22T03:49:15.113396+0000","last_unstale":"2024-09-22T03:51:28.115226+0000","last_undegraded":"2024-09-22T03:51:28.115226+0000","last_fullsized":"2024-09-22T03:51:28.115226+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":104988696,"num_objects":1603,"num_object_clones":0,"num_object_copies":4809,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":31517,"num_write_kb":1059777,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":19775488,"data_stored":316211272,"data_compressed":15015400,"data_compressed_allocated":19763200,"data_compressed_original":316211200,"omap_allocated":0,"internal_metadata":0},"log_size":31517,"ondisk_log_size":31517,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949673149,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":50368,"kb_used_data":5484,"kb_used_omap":0,"kb_used_meta":44864,"kb_avail":94321472,"statfs":{"total":96636764160,"available":96585187328,"internally_reserved":0,"allocated":5615616,"data_stored":84772921,"data_compressed":4022752,"data_compressed_allocated":5296128,"data_compressed_original":84656128,"omap_allocated":0,"internal_metadata":45940736},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654705853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":58836,"kb_used_data":5636,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94313004,"statfs":{"total":96636764160,"available":96576516096,"internally_reserved":0,"allocated":5771264,"data_stored":87655961,"data_compressed":4157632,"data_compressed_allocated":5472256,"data_compressed_original":87556096,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":62032,"kb_used_data":4672,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94309808,"statfs":{"total":96636764160,"available":96573243392,"internally_reserved":0,"allocated":4784128,"data_stored":71534625,"data_compressed":3394128,"data_compressed_allocated":4468736,"data_compressed_original":71417856,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":50952,"kb_used_data":6064,"kb_used_omap":0,"kb_used_meta":44864,"kb_avail":94320888,"statfs":{"total":96636764160,"available":96584589312,"internally_reserved":0,"allocated":6209536,"data_stored":94341158,"data_compressed":4477104,"data_compressed_allocated":5894144,"data_compressed_original":94224384,"omap_allocated":0,"internal_metadata":45940736},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5545984,"data_stored":88670232,"data_compressed":4210536,"data_compressed_allocated":5541888,"data_compressed_original":88670208,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4952064,"data_stored":79167512,"data_compressed":3759296,"data_compressed_allocated":4947968,"data_compressed_original":79167488,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4173824,"data_stored":66781184,"data_compressed":3171128,"data_compressed_allocated":4173824,"data_compressed_original":66781184,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":5103616,"data_stored":81592344,"data_compressed":3874440,"data_compressed_allocated":5099520,"data_compressed_original":81592320,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:52:25.576 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:52:25.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:52:25.738+0000 7fe807511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:52:25.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:52:25.747+0000 7fe807511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:52:28.214 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:52:28.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:52:28.379+0000 7ff204efd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:52:28.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:52:28.390+0000 7ff204efd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:52:29.669 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:52:29.669 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:52:29.669 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:52:29.670 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:52:29.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:52:29.827+0000 7f4568b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:52:29.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:52:29.857+0000 7f4568b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:52:30.061 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:52:30.062 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:52:30.062 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:52:30.062 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:52:30.062 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:52:30.062 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:52:30.062 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:52:30.062 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:52:30.062 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:52:30.062 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:52:30.062 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:52:30.062 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:52:30.066 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:52:30.066 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:52:30.066 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:52:30.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:52:30.216+0000 7f76db2d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:52:30.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:52:30.228+0000 7f76db2d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:52:30.230 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Removed 16559 objects 2024-09-22T03:52:30.230 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Clean up completed and total clean up time :93.0579 2024-09-22T03:52:30.248 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:52:30.248 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:52:30.248 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:52:30.248 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:52:30.248 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:52:30.249 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:52:30.249 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:52:30.249 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:52:30.249 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:52:30.249 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:52:30.249 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:52:30.249 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:52:30.253 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:52:30.253 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:52:30.253 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:52:30.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:52:30.361+0000 7f0282191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:52:30.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:52:30.371+0000 7f0282191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:52:30.388 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:52:30.388 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:52:30.388 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:52:30.388 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:52:30.388 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:52:30.388 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:52:30.389 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:52:30.389 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:52:30.389 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:52:30.389 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:52:30.389 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:52:30.389 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:52:30.391 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:52:30.391 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:52:30.391 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:52:30.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:52:30.500+0000 7f8b1ec9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:52:30.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:52:30.509+0000 7f8b1ec9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:52:30.527 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:52:30.527 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:52:30.527 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:52:30.527 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:52:30.528 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:52:30.528 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:52:30.528 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:52:30.528 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:52:30.528 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:52:30.528 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:52:30.528 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:52:30.528 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:52:30.530 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:52:30.530 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:52:30.960 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:52:31.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:52:31.071+0000 7fa521191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:52:31.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:52:31.078+0000 7fa521191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:52:33.180 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:52:33.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:52:33.303+0000 7fdd7cf91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:52:33.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:52:33.310+0000 7fdd7cf91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:52:35.210 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_0 2024-09-22T03:52:35.211 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_0 unique_pool_0 --yes-i-really-really-mean-it 2024-09-22T03:52:35.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:52:35.328+0000 7f152fd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:52:35.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:52:35.342+0000 7f152fd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:52:35.414 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:52:35.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:52:35.523+0000 7fb0ebcbd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:52:35.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:52:35.529+0000 7fb0ebcbd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:52:35.531 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:52:35.531 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:52:35.531 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:52:35.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:52:35.654+0000 7f4a07751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:52:35.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:52:35.662+0000 7f4a07751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:52:35.866 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:52:35.867 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-22T03:52:35.879 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":131,"stamp":"2024-09-22T03:52:35.005304+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1507915,"num_objects":19,"num_object_clones":0,"num_object_copies":57,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":33186,"num_write_kb":1060885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33160,"ondisk_log_size":33160,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":206992,"kb_used_data":2508,"kb_used_omap":0,"kb_used_meta":204416,"kb_avail":377280368,"statfs":{"total":386547056640,"available":386335096832,"internally_reserved":0,"allocated":2568192,"data_stored":21372545,"data_compressed":1001984,"data_compressed_allocated":1323008,"data_compressed_original":20922368,"omap_allocated":0,"internal_metadata":209321984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-104071168,"num_objects":-1588,"num_object_clones":0,"num_object_copies":-4764,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1588,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002709"},"pg_stats":[{"pgid":"3.f","version":"35'2093","reported_seq":2153,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-22T03:52:30.002566+0000","last_change":"2024-09-22T03:49:25.167073+0000","last_active":"2024-09-22T03:52:30.002566+0000","last_peered":"2024-09-22T03:52:30.002566+0000","last_clean":"2024-09-22T03:52:30.002566+0000","last_became_active":"2024-09-22T03:49:25.159818+0000","last_became_peered":"2024-09-22T03:49:25.159818+0000","last_unstale":"2024-09-22T03:52:30.002566+0000","last_undegraded":"2024-09-22T03:52:30.002566+0000","last_fullsized":"2024-09-22T03:52:30.002566+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":2093,"log_dups_size":0,"ondisk_log_size":2093,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65536,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2093,"num_write_kb":67008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"35'2110","reported_seq":2170,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-22T03:52:30.109091+0000","last_change":"2024-09-22T03:49:25.238720+0000","last_active":"2024-09-22T03:52:30.109091+0000","last_peered":"2024-09-22T03:52:30.109091+0000","last_clean":"2024-09-22T03:52:30.109091+0000","last_became_active":"2024-09-22T03:49:25.229005+0000","last_became_peered":"2024-09-22T03:49:25.229005+0000","last_unstale":"2024-09-22T03:52:30.109091+0000","last_undegraded":"2024-09-22T03:52:30.109091+0000","last_fullsized":"2024-09-22T03:52:30.109091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":2110,"log_dups_size":0,"ondisk_log_size":2110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2110,"num_write_kb":67520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"35'2128","reported_seq":2189,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-22T03:52:29.783932+0000","last_change":"2024-09-22T03:49:25.173605+0000","last_active":"2024-09-22T03:52:29.783932+0000","last_peered":"2024-09-22T03:52:29.783932+0000","last_clean":"2024-09-22T03:52:29.783932+0000","last_became_active":"2024-09-22T03:49:25.165491+0000","last_became_peered":"2024-09-22T03:49:25.165491+0000","last_unstale":"2024-09-22T03:52:29.783932+0000","last_undegraded":"2024-09-22T03:52:29.783932+0000","last_fullsized":"2024-09-22T03:52:29.783932+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":2128,"log_dups_size":0,"ondisk_log_size":2128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":196632,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2128,"num_write_kb":68161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"35'2003","reported_seq":2063,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-22T03:52:29.946291+0000","last_change":"2024-09-22T03:49:25.207920+0000","last_active":"2024-09-22T03:52:29.946291+0000","last_peered":"2024-09-22T03:52:29.946291+0000","last_clean":"2024-09-22T03:52:29.946291+0000","last_became_active":"2024-09-22T03:49:25.198168+0000","last_became_peered":"2024-09-22T03:49:25.198168+0000","last_unstale":"2024-09-22T03:52:29.946291+0000","last_undegraded":"2024-09-22T03:52:29.946291+0000","last_fullsized":"2024-09-22T03:52:29.946291+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":2003,"log_dups_size":0,"ondisk_log_size":2003,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65536,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2003,"num_write_kb":64128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"35'2060","reported_seq":2120,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-22T03:52:29.993193+0000","last_change":"2024-09-22T03:49:25.280543+0000","last_active":"2024-09-22T03:52:29.993193+0000","last_peered":"2024-09-22T03:52:29.993193+0000","last_clean":"2024-09-22T03:52:29.993193+0000","last_became_active":"2024-09-22T03:49:25.268731+0000","last_became_peered":"2024-09-22T03:49:25.268731+0000","last_unstale":"2024-09-22T03:52:29.993193+0000","last_undegraded":"2024-09-22T03:52:29.993193+0000","last_fullsized":"2024-09-22T03:52:29.993193+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":2060,"log_dups_size":0,"ondisk_log_size":2060,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2060,"num_write_kb":65920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"35'2040","reported_seq":2100,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-22T03:52:29.895713+0000","last_change":"2024-09-22T03:49:25.206225+0000","last_active":"2024-09-22T03:52:29.895713+0000","last_peered":"2024-09-22T03:52:29.895713+0000","last_clean":"2024-09-22T03:52:29.895713+0000","last_became_active":"2024-09-22T03:49:25.201227+0000","last_became_peered":"2024-09-22T03:49:25.201227+0000","last_unstale":"2024-09-22T03:52:29.895713+0000","last_undegraded":"2024-09-22T03:52:29.895713+0000","last_fullsized":"2024-09-22T03:52:29.895713+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":2040,"log_dups_size":0,"ondisk_log_size":2040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131072,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2040,"num_write_kb":65344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"35'2092","reported_seq":2152,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-22T03:52:29.683236+0000","last_change":"2024-09-22T03:49:25.212585+0000","last_active":"2024-09-22T03:52:29.683236+0000","last_peered":"2024-09-22T03:52:29.683236+0000","last_clean":"2024-09-22T03:52:29.683236+0000","last_became_active":"2024-09-22T03:49:25.203356+0000","last_became_peered":"2024-09-22T03:49:25.203356+0000","last_unstale":"2024-09-22T03:52:29.683236+0000","last_undegraded":"2024-09-22T03:52:29.683236+0000","last_fullsized":"2024-09-22T03:52:29.683236+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":2092,"log_dups_size":0,"ondisk_log_size":2092,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2092,"num_write_kb":66944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"35'2103","reported_seq":2163,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-22T03:52:29.863181+0000","last_change":"2024-09-22T03:49:25.177465+0000","last_active":"2024-09-22T03:52:29.863181+0000","last_peered":"2024-09-22T03:52:29.863181+0000","last_clean":"2024-09-22T03:52:29.863181+0000","last_became_active":"2024-09-22T03:49:25.170026+0000","last_became_peered":"2024-09-22T03:49:25.170026+0000","last_unstale":"2024-09-22T03:52:29.863181+0000","last_undegraded":"2024-09-22T03:52:29.863181+0000","last_fullsized":"2024-09-22T03:52:29.863181+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":2103,"log_dups_size":0,"ondisk_log_size":2103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65536,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2103,"num_write_kb":67328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":148,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-22T03:51:28.139566+0000","last_change":"2024-09-22T03:49:12.034704+0000","last_active":"2024-09-22T03:51:28.139566+0000","last_peered":"2024-09-22T03:51:28.139566+0000","last_clean":"2024-09-22T03:51:28.139566+0000","last_became_active":"2024-09-22T03:49:12.027470+0000","last_became_peered":"2024-09-22T03:49:12.027470+0000","last_unstale":"2024-09-22T03:51:28.139566+0000","last_undegraded":"2024-09-22T03:51:28.139566+0000","last_fullsized":"2024-09-22T03:51:28.139566+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_clean_scrub_stamp":"2024-09-22T03:49:10.979949+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":74,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-22T03:51:28.118153+0000","last_change":"2024-09-22T03:49:17.031458+0000","last_active":"2024-09-22T03:51:28.118153+0000","last_peered":"2024-09-22T03:51:28.118153+0000","last_clean":"2024-09-22T03:51:28.118153+0000","last_became_active":"2024-09-22T03:49:15.125490+0000","last_became_peered":"2024-09-22T03:49:15.125490+0000","last_unstale":"2024-09-22T03:51:28.118153+0000","last_undegraded":"2024-09-22T03:51:28.118153+0000","last_fullsized":"2024-09-22T03:51:28.118153+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"35'1990","reported_seq":2050,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-22T03:52:30.018159+0000","last_change":"2024-09-22T03:49:25.226827+0000","last_active":"2024-09-22T03:52:30.018159+0000","last_peered":"2024-09-22T03:52:30.018159+0000","last_clean":"2024-09-22T03:52:30.018159+0000","last_became_active":"2024-09-22T03:49:25.218579+0000","last_became_peered":"2024-09-22T03:49:25.218579+0000","last_unstale":"2024-09-22T03:52:30.018159+0000","last_undegraded":"2024-09-22T03:52:30.018159+0000","last_fullsized":"2024-09-22T03:52:30.018159+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":1990,"log_dups_size":0,"ondisk_log_size":1990,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1990,"num_write_kb":63680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":73,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-22T03:51:28.113105+0000","last_change":"2024-09-22T03:49:17.029339+0000","last_active":"2024-09-22T03:51:28.113105+0000","last_peered":"2024-09-22T03:51:28.113105+0000","last_clean":"2024-09-22T03:51:28.113105+0000","last_became_active":"2024-09-22T03:49:15.097304+0000","last_became_peered":"2024-09-22T03:49:15.097304+0000","last_unstale":"2024-09-22T03:51:28.113105+0000","last_undegraded":"2024-09-22T03:51:28.113105+0000","last_fullsized":"2024-09-22T03:51:28.113105+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"35'2055","reported_seq":2115,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-22T03:52:29.906179+0000","last_change":"2024-09-22T03:49:25.208298+0000","last_active":"2024-09-22T03:52:29.906179+0000","last_peered":"2024-09-22T03:52:29.906179+0000","last_clean":"2024-09-22T03:52:29.906179+0000","last_became_active":"2024-09-22T03:49:25.193750+0000","last_became_peered":"2024-09-22T03:49:25.193750+0000","last_unstale":"2024-09-22T03:52:29.906179+0000","last_undegraded":"2024-09-22T03:52:29.906179+0000","last_fullsized":"2024-09-22T03:52:29.906179+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":2055,"log_dups_size":0,"ondisk_log_size":2055,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65536,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2055,"num_write_kb":65792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":73,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-22T03:51:28.124201+0000","last_change":"2024-09-22T03:49:17.029349+0000","last_active":"2024-09-22T03:51:28.124201+0000","last_peered":"2024-09-22T03:51:28.124201+0000","last_clean":"2024-09-22T03:51:28.124201+0000","last_became_active":"2024-09-22T03:49:15.094890+0000","last_became_peered":"2024-09-22T03:49:15.094890+0000","last_unstale":"2024-09-22T03:51:28.124201+0000","last_undegraded":"2024-09-22T03:51:28.124201+0000","last_fullsized":"2024-09-22T03:51:28.124201+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"35'2138","reported_seq":2198,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-22T03:52:30.105487+0000","last_change":"2024-09-22T03:49:25.226551+0000","last_active":"2024-09-22T03:52:30.105487+0000","last_peered":"2024-09-22T03:52:30.105487+0000","last_clean":"2024-09-22T03:52:30.105487+0000","last_became_active":"2024-09-22T03:49:25.213989+0000","last_became_peered":"2024-09-22T03:49:25.213989+0000","last_unstale":"2024-09-22T03:52:30.105487+0000","last_undegraded":"2024-09-22T03:52:30.105487+0000","last_fullsized":"2024-09-22T03:52:30.105487+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":2138,"log_dups_size":0,"ondisk_log_size":2138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2138,"num_write_kb":68416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":75,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-22T03:51:28.122820+0000","last_change":"2024-09-22T03:49:17.031466+0000","last_active":"2024-09-22T03:51:28.122820+0000","last_peered":"2024-09-22T03:51:28.122820+0000","last_clean":"2024-09-22T03:51:28.122820+0000","last_became_active":"2024-09-22T03:49:15.098420+0000","last_became_peered":"2024-09-22T03:49:15.098420+0000","last_unstale":"2024-09-22T03:51:28.122820+0000","last_undegraded":"2024-09-22T03:51:28.122820+0000","last_fullsized":"2024-09-22T03:51:28.122820+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"35'2022","reported_seq":2082,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-22T03:52:29.977173+0000","last_change":"2024-09-22T03:49:25.163198+0000","last_active":"2024-09-22T03:52:29.977173+0000","last_peered":"2024-09-22T03:52:29.977173+0000","last_clean":"2024-09-22T03:52:29.977173+0000","last_became_active":"2024-09-22T03:49:25.145723+0000","last_became_peered":"2024-09-22T03:49:25.145723+0000","last_unstale":"2024-09-22T03:52:29.977173+0000","last_undegraded":"2024-09-22T03:52:29.977173+0000","last_fullsized":"2024-09-22T03:52:29.977173+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":2022,"log_dups_size":0,"ondisk_log_size":2022,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2022,"num_write_kb":64704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"35'2074","reported_seq":2134,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-22T03:52:29.979275+0000","last_change":"2024-09-22T03:49:25.168751+0000","last_active":"2024-09-22T03:52:29.979275+0000","last_peered":"2024-09-22T03:52:29.979275+0000","last_clean":"2024-09-22T03:52:29.979275+0000","last_became_active":"2024-09-22T03:49:25.160072+0000","last_became_peered":"2024-09-22T03:49:25.160072+0000","last_unstale":"2024-09-22T03:52:29.979275+0000","last_undegraded":"2024-09-22T03:52:29.979275+0000","last_fullsized":"2024-09-22T03:52:29.979275+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":2074,"log_dups_size":0,"ondisk_log_size":2074,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131072,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2074,"num_write_kb":66432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":73,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-22T03:51:28.133794+0000","last_change":"2024-09-22T03:49:17.036954+0000","last_active":"2024-09-22T03:51:28.133794+0000","last_peered":"2024-09-22T03:51:28.133794+0000","last_clean":"2024-09-22T03:51:28.133794+0000","last_became_active":"2024-09-22T03:49:15.110506+0000","last_became_peered":"2024-09-22T03:49:15.110506+0000","last_unstale":"2024-09-22T03:51:28.133794+0000","last_undegraded":"2024-09-22T03:51:28.133794+0000","last_fullsized":"2024-09-22T03:51:28.133794+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"35'2074","reported_seq":2134,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-22T03:52:29.932777+0000","last_change":"2024-09-22T03:49:25.218967+0000","last_active":"2024-09-22T03:52:29.932777+0000","last_peered":"2024-09-22T03:52:29.932777+0000","last_clean":"2024-09-22T03:52:29.932777+0000","last_became_active":"2024-09-22T03:49:25.203726+0000","last_became_peered":"2024-09-22T03:49:25.203726+0000","last_unstale":"2024-09-22T03:52:29.932777+0000","last_undegraded":"2024-09-22T03:52:29.932777+0000","last_fullsized":"2024-09-22T03:52:29.932777+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":2074,"log_dups_size":0,"ondisk_log_size":2074,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2074,"num_write_kb":66368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":73,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-22T03:51:28.130681+0000","last_change":"2024-09-22T03:49:17.032989+0000","last_active":"2024-09-22T03:51:28.130681+0000","last_peered":"2024-09-22T03:51:28.130681+0000","last_clean":"2024-09-22T03:51:28.130681+0000","last_became_active":"2024-09-22T03:49:15.079260+0000","last_became_peered":"2024-09-22T03:49:15.079260+0000","last_unstale":"2024-09-22T03:51:28.130681+0000","last_undegraded":"2024-09-22T03:51:28.130681+0000","last_fullsized":"2024-09-22T03:51:28.130681+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"35'2046","reported_seq":2106,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-22T03:52:29.953183+0000","last_change":"2024-09-22T03:49:25.275215+0000","last_active":"2024-09-22T03:52:29.953183+0000","last_peered":"2024-09-22T03:52:29.953183+0000","last_clean":"2024-09-22T03:52:29.953183+0000","last_became_active":"2024-09-22T03:49:25.260843+0000","last_became_peered":"2024-09-22T03:49:25.260843+0000","last_unstale":"2024-09-22T03:52:29.953183+0000","last_undegraded":"2024-09-22T03:52:29.953183+0000","last_fullsized":"2024-09-22T03:52:29.953183+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":2046,"log_dups_size":0,"ondisk_log_size":2046,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2046,"num_write_kb":65472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":73,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-22T03:51:28.140562+0000","last_change":"2024-09-22T03:49:17.036402+0000","last_active":"2024-09-22T03:51:28.140562+0000","last_peered":"2024-09-22T03:51:28.140562+0000","last_clean":"2024-09-22T03:51:28.140562+0000","last_became_active":"2024-09-22T03:49:15.108430+0000","last_became_peered":"2024-09-22T03:49:15.108430+0000","last_unstale":"2024-09-22T03:51:28.140562+0000","last_undegraded":"2024-09-22T03:51:28.140562+0000","last_fullsized":"2024-09-22T03:51:28.140562+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"35'2077","reported_seq":2137,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-22T03:52:29.895712+0000","last_change":"2024-09-22T03:49:25.211493+0000","last_active":"2024-09-22T03:52:29.895712+0000","last_peered":"2024-09-22T03:52:29.895712+0000","last_clean":"2024-09-22T03:52:29.895712+0000","last_became_active":"2024-09-22T03:49:25.194855+0000","last_became_peered":"2024-09-22T03:49:25.194855+0000","last_unstale":"2024-09-22T03:52:29.895712+0000","last_undegraded":"2024-09-22T03:52:29.895712+0000","last_fullsized":"2024-09-22T03:52:29.895712+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:24.029614+0000","last_clean_scrub_stamp":"2024-09-22T03:49:24.029614+0000","objects_scrubbed":0,"log_size":2077,"log_dups_size":0,"ondisk_log_size":2077,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":196608,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2077,"num_write_kb":66560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":73,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-22T03:51:28.115226+0000","last_change":"2024-09-22T03:49:17.029128+0000","last_active":"2024-09-22T03:51:28.115226+0000","last_peered":"2024-09-22T03:51:28.115226+0000","last_clean":"2024-09-22T03:51:28.115226+0000","last_became_active":"2024-09-22T03:49:15.113396+0000","last_became_peered":"2024-09-22T03:49:15.113396+0000","last_unstale":"2024-09-22T03:51:28.115226+0000","last_undegraded":"2024-09-22T03:51:28.115226+0000","last_fullsized":"2024-09-22T03:51:28.115226+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":917528,"num_objects":15,"num_object_clones":0,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":33105,"num_write_kb":1059777,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":184320,"data_stored":2818096,"data_compressed":133816,"data_compressed_allocated":176128,"data_compressed_original":2818048,"omap_allocated":0,"internal_metadata":0},"log_size":33105,"ondisk_log_size":33105,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949673159,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":49388,"kb_used_data":348,"kb_used_omap":0,"kb_used_meta":49024,"kb_avail":94322452,"statfs":{"total":96636764160,"available":96586190848,"internally_reserved":0,"allocated":356352,"data_stored":690209,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":50200576},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654705863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":62248,"kb_used_data":728,"kb_used_omap":0,"kb_used_meta":61504,"kb_avail":94309592,"statfs":{"total":96636764160,"available":96573022208,"internally_reserved":0,"allocated":745472,"data_stored":7243289,"data_compressed":339208,"data_compressed_allocated":446464,"data_compressed_original":7143424,"omap_allocated":0,"internal_metadata":62980096},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":45568,"kb_used_data":688,"kb_used_omap":0,"kb_used_meta":44864,"kb_avail":94326272,"statfs":{"total":96636764160,"available":96590102528,"internally_reserved":0,"allocated":704512,"data_stored":6260769,"data_compressed":294576,"data_compressed_allocated":389120,"data_compressed_original":6144000,"omap_allocated":0,"internal_metadata":45940736},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":49788,"kb_used_data":744,"kb_used_omap":0,"kb_used_meta":49024,"kb_avail":94322052,"statfs":{"total":96636764160,"available":96585781248,"internally_reserved":0,"allocated":761856,"data_stored":7178278,"data_compressed":338144,"data_compressed_allocated":446464,"data_compressed_original":7061504,"omap_allocated":0,"internal_metadata":50200576},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":917528,"data_compressed":43568,"data_compressed_allocated":57344,"data_compressed_original":917504,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":983040,"data_compressed":46680,"data_compressed_allocated":61440,"data_compressed_original":983040,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":917528,"data_compressed":43568,"data_compressed_allocated":57344,"data_compressed_original":917504,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:52:36.061 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'unique_pool_0' removed 2024-09-22T03:52:36.079 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2024-09-22T03:52:36.080 INFO:tasks.radosbench:Beginning radosbench... 2024-09-22T03:52:36.080 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_1 2024-09-22T03:52:36.080 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_1 16 2024-09-22T03:52:36.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:52:36.232+0000 7f3085688640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:52:36.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:52:36.246+0000 7f3085688640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:52:37.066 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'unique_pool_1' created 2024-09-22T03:52:37.086 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_1 rados --yes-i-really-mean-it || true 2024-09-22T03:52:37.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:52:37.218+0000 7f0ac6aa3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:52:37.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:52:37.233+0000 7f0ac6aa3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:52:37.653 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:52:37.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:52:37.761+0000 7f8aaf548640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:52:37.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:52:37.767+0000 7f8aaf548640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:52:38.067 INFO:teuthology.orchestra.run.smithi037.stderr:enabled application 'rados' on pool 'unique_pool_1' 2024-09-22T03:52:39.088 DEBUG:teuthology.orchestra.run.smithi037:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -b 65536 --object-size 65536 -p unique_pool_1 bench 90 write' 2024-09-22T03:52:39.091 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2024-09-22T03:52:39.092 INFO:teuthology.orchestra.run:waiting for 3000 2024-09-22T03:52:39.166 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:hints = 1 2024-09-22T03:52:39.166 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Maintaining 16 concurrent writes of 65536 bytes to objects of size 65536 for up to 90 seconds or 0 objects 2024-09-22T03:52:39.166 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Object prefix: benchmark_data_smithi037_38566 2024-09-22T03:52:39.167 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-22T03:52:39.167 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 0 0 0 0 0 0 - 0 2024-09-22T03:52:39.867 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:52:40.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:52:40.033+0000 7f76fe351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:52:40.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:52:40.043+0000 7f76fe351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:52:40.167 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 1 16 198 182 11.3744 11.375 0.0922002 0.0849598 2024-09-22T03:52:40.881 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:52:40.881 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:52:40.881 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:52:41.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:52:41.023+0000 7fccccf51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:52:41.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:52:41.035+0000 7fccccf51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:52:41.167 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 2 16 369 353 11.0305 10.6875 0.117187 0.0885976 2024-09-22T03:52:41.333 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:52:41.333 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-22T03:52:41.348 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":138,"stamp":"2024-09-22T03:52:41.006548+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":8127027,"num_objects":119,"num_object_clones":0,"num_object_copies":357,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":196,"num_write_kb":8468,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":170,"ondisk_log_size":170,"up":63,"acting":63,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":189660,"kb_used_data":1820,"kb_used_omap":0,"kb_used_meta":187776,"kb_avail":377297700,"statfs":{"total":386547056640,"available":386352844800,"internally_reserved":0,"allocated":1863680,"data_stored":8504226,"data_compressed":388704,"data_compressed_allocated":516096,"data_compressed_original":8011776,"omap_allocated":0,"internal_metadata":192282624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":7536640,"num_objects":115,"num_object_clones":0,"num_object_copies":345,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115,"num_write_kb":7360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.945046"},"pg_stats":[{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-22T03:52:37.061276+0000","last_change":"2024-09-22T03:52:37.061276+0000","last_active":"2024-09-22T03:52:37.061276+0000","last_peered":"2024-09-22T03:52:37.061276+0000","last_clean":"2024-09-22T03:52:37.061276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:52:37.061276+0000","last_undegraded":"2024-09-22T03:52:37.061276+0000","last_fullsized":"2024-09-22T03:52:37.061276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-22T03:52:37.061276+0000","last_change":"2024-09-22T03:52:37.061276+0000","last_active":"2024-09-22T03:52:37.061276+0000","last_peered":"2024-09-22T03:52:37.061276+0000","last_clean":"2024-09-22T03:52:37.061276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:52:37.061276+0000","last_undegraded":"2024-09-22T03:52:37.061276+0000","last_fullsized":"2024-09-22T03:52:37.061276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"39'9","reported_seq":21,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-22T03:52:39.987633+0000","last_change":"2024-09-22T03:52:38.196399+0000","last_active":"2024-09-22T03:52:39.987633+0000","last_peered":"2024-09-22T03:52:39.987633+0000","last_clean":"2024-09-22T03:52:39.987633+0000","last_became_active":"2024-09-22T03:52:38.183573+0000","last_became_peered":"2024-09-22T03:52:38.183573+0000","last_unstale":"2024-09-22T03:52:39.987633+0000","last_undegraded":"2024-09-22T03:52:39.987633+0000","last_fullsized":"2024-09-22T03:52:39.987633+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":589824,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"39'5","reported_seq":17,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-22T03:52:39.670100+0000","last_change":"2024-09-22T03:52:38.241973+0000","last_active":"2024-09-22T03:52:39.670100+0000","last_peered":"2024-09-22T03:52:39.670100+0000","last_clean":"2024-09-22T03:52:39.670100+0000","last_became_active":"2024-09-22T03:52:38.234357+0000","last_became_peered":"2024-09-22T03:52:38.234357+0000","last_unstale":"2024-09-22T03:52:39.670100+0000","last_undegraded":"2024-09-22T03:52:39.670100+0000","last_fullsized":"2024-09-22T03:52:39.670100+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327680,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"39'13","reported_seq":25,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-22T03:52:39.980160+0000","last_change":"2024-09-22T03:52:38.234728+0000","last_active":"2024-09-22T03:52:39.980160+0000","last_peered":"2024-09-22T03:52:39.980160+0000","last_clean":"2024-09-22T03:52:39.980160+0000","last_became_active":"2024-09-22T03:52:38.221861+0000","last_became_peered":"2024-09-22T03:52:38.221861+0000","last_unstale":"2024-09-22T03:52:39.980160+0000","last_undegraded":"2024-09-22T03:52:39.980160+0000","last_fullsized":"2024-09-22T03:52:39.980160+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":851968,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"39'14","reported_seq":26,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-22T03:52:39.992697+0000","last_change":"2024-09-22T03:52:38.235904+0000","last_active":"2024-09-22T03:52:39.992697+0000","last_peered":"2024-09-22T03:52:39.992697+0000","last_clean":"2024-09-22T03:52:39.992697+0000","last_became_active":"2024-09-22T03:52:38.225232+0000","last_became_peered":"2024-09-22T03:52:38.225232+0000","last_unstale":"2024-09-22T03:52:39.992697+0000","last_undegraded":"2024-09-22T03:52:39.992697+0000","last_fullsized":"2024-09-22T03:52:39.992697+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":917504,"num_objects":14,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"39'12","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-22T03:52:39.878324+0000","last_change":"2024-09-22T03:52:38.200669+0000","last_active":"2024-09-22T03:52:39.878324+0000","last_peered":"2024-09-22T03:52:39.878324+0000","last_clean":"2024-09-22T03:52:39.878324+0000","last_became_active":"2024-09-22T03:52:38.190269+0000","last_became_peered":"2024-09-22T03:52:38.190269+0000","last_unstale":"2024-09-22T03:52:39.878324+0000","last_undegraded":"2024-09-22T03:52:39.878324+0000","last_fullsized":"2024-09-22T03:52:39.878324+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":786432,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"39'9","reported_seq":21,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-22T03:52:39.909457+0000","last_change":"2024-09-22T03:52:38.177831+0000","last_active":"2024-09-22T03:52:39.909457+0000","last_peered":"2024-09-22T03:52:39.909457+0000","last_clean":"2024-09-22T03:52:39.909457+0000","last_became_active":"2024-09-22T03:52:38.169555+0000","last_became_peered":"2024-09-22T03:52:38.169555+0000","last_unstale":"2024-09-22T03:52:39.909457+0000","last_undegraded":"2024-09-22T03:52:39.909457+0000","last_fullsized":"2024-09-22T03:52:39.909457+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":589824,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"39'11","reported_seq":23,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-22T03:52:39.792294+0000","last_change":"2024-09-22T03:52:38.267240+0000","last_active":"2024-09-22T03:52:39.792294+0000","last_peered":"2024-09-22T03:52:39.792294+0000","last_clean":"2024-09-22T03:52:39.792294+0000","last_became_active":"2024-09-22T03:52:38.252880+0000","last_became_peered":"2024-09-22T03:52:38.252880+0000","last_unstale":"2024-09-22T03:52:39.792294+0000","last_undegraded":"2024-09-22T03:52:39.792294+0000","last_fullsized":"2024-09-22T03:52:39.792294+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":720896,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":151,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-22T03:52:36.086047+0000","last_change":"2024-09-22T03:49:12.034704+0000","last_active":"2024-09-22T03:52:36.086047+0000","last_peered":"2024-09-22T03:52:36.086047+0000","last_clean":"2024-09-22T03:52:36.086047+0000","last_became_active":"2024-09-22T03:49:12.027470+0000","last_became_peered":"2024-09-22T03:49:12.027470+0000","last_unstale":"2024-09-22T03:52:36.086047+0000","last_undegraded":"2024-09-22T03:52:36.086047+0000","last_fullsized":"2024-09-22T03:52:36.086047+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_clean_scrub_stamp":"2024-09-22T03:49:10.979949+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":86,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-22T03:52:39.100352+0000","last_change":"2024-09-22T03:49:17.031458+0000","last_active":"2024-09-22T03:52:39.100352+0000","last_peered":"2024-09-22T03:52:39.100352+0000","last_clean":"2024-09-22T03:52:39.100352+0000","last_became_active":"2024-09-22T03:49:15.125490+0000","last_became_peered":"2024-09-22T03:49:15.125490+0000","last_unstale":"2024-09-22T03:52:39.100352+0000","last_undegraded":"2024-09-22T03:52:39.100352+0000","last_fullsized":"2024-09-22T03:52:39.100352+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"39'11","reported_seq":23,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-22T03:52:39.757844+0000","last_change":"2024-09-22T03:52:38.263115+0000","last_active":"2024-09-22T03:52:39.757844+0000","last_peered":"2024-09-22T03:52:39.757844+0000","last_clean":"2024-09-22T03:52:39.757844+0000","last_became_active":"2024-09-22T03:52:38.245622+0000","last_became_peered":"2024-09-22T03:52:38.245622+0000","last_unstale":"2024-09-22T03:52:39.757844+0000","last_undegraded":"2024-09-22T03:52:39.757844+0000","last_fullsized":"2024-09-22T03:52:39.757844+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":720896,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-22T03:52:39.090973+0000","last_change":"2024-09-22T03:49:17.029339+0000","last_active":"2024-09-22T03:52:39.090973+0000","last_peered":"2024-09-22T03:52:39.090973+0000","last_clean":"2024-09-22T03:52:39.090973+0000","last_became_active":"2024-09-22T03:49:15.097304+0000","last_became_peered":"2024-09-22T03:49:15.097304+0000","last_unstale":"2024-09-22T03:52:39.090973+0000","last_undegraded":"2024-09-22T03:52:39.090973+0000","last_fullsized":"2024-09-22T03:52:39.090973+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-22T03:52:37.061276+0000","last_change":"2024-09-22T03:52:37.061276+0000","last_active":"2024-09-22T03:52:37.061276+0000","last_peered":"2024-09-22T03:52:37.061276+0000","last_clean":"2024-09-22T03:52:37.061276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:52:37.061276+0000","last_undegraded":"2024-09-22T03:52:37.061276+0000","last_fullsized":"2024-09-22T03:52:37.061276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-22T03:52:39.101539+0000","last_change":"2024-09-22T03:49:17.029349+0000","last_active":"2024-09-22T03:52:39.101539+0000","last_peered":"2024-09-22T03:52:39.101539+0000","last_clean":"2024-09-22T03:52:39.101539+0000","last_became_active":"2024-09-22T03:49:15.094890+0000","last_became_peered":"2024-09-22T03:49:15.094890+0000","last_unstale":"2024-09-22T03:52:39.101539+0000","last_undegraded":"2024-09-22T03:52:39.101539+0000","last_fullsized":"2024-09-22T03:52:39.101539+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-22T03:52:37.061276+0000","last_change":"2024-09-22T03:52:37.061276+0000","last_active":"2024-09-22T03:52:37.061276+0000","last_peered":"2024-09-22T03:52:37.061276+0000","last_clean":"2024-09-22T03:52:37.061276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:52:37.061276+0000","last_undegraded":"2024-09-22T03:52:37.061276+0000","last_fullsized":"2024-09-22T03:52:37.061276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":87,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-22T03:52:39.100276+0000","last_change":"2024-09-22T03:49:17.031466+0000","last_active":"2024-09-22T03:52:39.100276+0000","last_peered":"2024-09-22T03:52:39.100276+0000","last_clean":"2024-09-22T03:52:39.100276+0000","last_became_active":"2024-09-22T03:49:15.098420+0000","last_became_peered":"2024-09-22T03:49:15.098420+0000","last_unstale":"2024-09-22T03:52:39.100276+0000","last_undegraded":"2024-09-22T03:52:39.100276+0000","last_fullsized":"2024-09-22T03:52:39.100276+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2","version":"39'10","reported_seq":22,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-22T03:52:39.739058+0000","last_change":"2024-09-22T03:52:38.215825+0000","last_active":"2024-09-22T03:52:39.739058+0000","last_peered":"2024-09-22T03:52:39.739058+0000","last_clean":"2024-09-22T03:52:39.739058+0000","last_became_active":"2024-09-22T03:52:38.203741+0000","last_became_peered":"2024-09-22T03:52:38.203741+0000","last_unstale":"2024-09-22T03:52:39.739058+0000","last_undegraded":"2024-09-22T03:52:39.739058+0000","last_fullsized":"2024-09-22T03:52:39.739058+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":655360,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":76,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-22T03:52:36.115590+0000","last_change":"2024-09-22T03:49:17.036954+0000","last_active":"2024-09-22T03:52:36.115590+0000","last_peered":"2024-09-22T03:52:36.115590+0000","last_clean":"2024-09-22T03:52:36.115590+0000","last_became_active":"2024-09-22T03:49:15.110506+0000","last_became_peered":"2024-09-22T03:49:15.110506+0000","last_unstale":"2024-09-22T03:52:36.115590+0000","last_undegraded":"2024-09-22T03:52:36.115590+0000","last_fullsized":"2024-09-22T03:52:36.115590+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"39'6","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-22T03:52:39.364035+0000","last_change":"2024-09-22T03:52:38.239558+0000","last_active":"2024-09-22T03:52:39.364035+0000","last_peered":"2024-09-22T03:52:39.364035+0000","last_clean":"2024-09-22T03:52:39.364035+0000","last_became_active":"2024-09-22T03:52:38.229931+0000","last_became_peered":"2024-09-22T03:52:38.229931+0000","last_unstale":"2024-09-22T03:52:39.364035+0000","last_undegraded":"2024-09-22T03:52:39.364035+0000","last_fullsized":"2024-09-22T03:52:39.364035+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":76,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-22T03:52:36.104669+0000","last_change":"2024-09-22T03:49:17.032989+0000","last_active":"2024-09-22T03:52:36.104669+0000","last_peered":"2024-09-22T03:52:36.104669+0000","last_clean":"2024-09-22T03:52:36.104669+0000","last_became_active":"2024-09-22T03:49:15.079260+0000","last_became_peered":"2024-09-22T03:49:15.079260+0000","last_unstale":"2024-09-22T03:52:36.104669+0000","last_undegraded":"2024-09-22T03:52:36.104669+0000","last_fullsized":"2024-09-22T03:52:36.104669+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"39'9","reported_seq":21,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-22T03:52:40.004261+0000","last_change":"2024-09-22T03:52:38.258650+0000","last_active":"2024-09-22T03:52:40.004261+0000","last_peered":"2024-09-22T03:52:40.004261+0000","last_clean":"2024-09-22T03:52:40.004261+0000","last_became_active":"2024-09-22T03:52:38.238553+0000","last_became_peered":"2024-09-22T03:52:38.238553+0000","last_unstale":"2024-09-22T03:52:40.004261+0000","last_undegraded":"2024-09-22T03:52:40.004261+0000","last_fullsized":"2024-09-22T03:52:40.004261+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":589824,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":76,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-22T03:52:36.115415+0000","last_change":"2024-09-22T03:49:17.036402+0000","last_active":"2024-09-22T03:52:36.115415+0000","last_peered":"2024-09-22T03:52:36.115415+0000","last_clean":"2024-09-22T03:52:36.115415+0000","last_became_active":"2024-09-22T03:49:15.108430+0000","last_became_peered":"2024-09-22T03:49:15.108430+0000","last_unstale":"2024-09-22T03:52:36.115415+0000","last_undegraded":"2024-09-22T03:52:36.115415+0000","last_fullsized":"2024-09-22T03:52:36.115415+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"39'6","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-22T03:52:39.652976+0000","last_change":"2024-09-22T03:52:38.208326+0000","last_active":"2024-09-22T03:52:39.652976+0000","last_peered":"2024-09-22T03:52:39.652976+0000","last_clean":"2024-09-22T03:52:39.652976+0000","last_became_active":"2024-09-22T03:52:38.200509+0000","last_became_peered":"2024-09-22T03:52:38.200509+0000","last_unstale":"2024-09-22T03:52:39.652976+0000","last_undegraded":"2024-09-22T03:52:39.652976+0000","last_fullsized":"2024-09-22T03:52:39.652976+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-22T03:52:39.092091+0000","last_change":"2024-09-22T03:49:17.029128+0000","last_active":"2024-09-22T03:52:39.092091+0000","last_peered":"2024-09-22T03:52:39.092091+0000","last_clean":"2024-09-22T03:52:39.092091+0000","last_became_active":"2024-09-22T03:49:15.113396+0000","last_became_peered":"2024-09-22T03:49:15.113396+0000","last_unstale":"2024-09-22T03:52:39.092091+0000","last_undegraded":"2024-09-22T03:52:39.092091+0000","last_fullsized":"2024-09-22T03:52:39.092091+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":7536640,"num_objects":115,"num_object_clones":0,"num_object_copies":345,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115,"num_write_kb":7360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1572864,"data_stored":25165824,"data_compressed":1194373,"data_compressed_allocated":1572864,"data_compressed_original":25165824,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":36,"acting":36,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949673164,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":49388,"kb_used_data":348,"kb_used_omap":0,"kb_used_meta":49024,"kb_avail":94322452,"statfs":{"total":96636764160,"available":96586190848,"internally_reserved":0,"allocated":356352,"data_stored":690209,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":50200576},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654705873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":45304,"kb_used_data":424,"kb_used_omap":0,"kb_used_meta":44864,"kb_avail":94326536,"statfs":{"total":96636764160,"available":96590372864,"internally_reserved":0,"allocated":434176,"data_stored":1752348,"data_compressed":77741,"data_compressed_allocated":102400,"data_compressed_original":1638400,"omap_allocated":0,"internal_metadata":45940736},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":45400,"kb_used_data":520,"kb_used_omap":0,"kb_used_meta":44864,"kb_avail":94326440,"statfs":{"total":96636764160,"available":96590274560,"internally_reserved":0,"allocated":532480,"data_stored":2932540,"data_compressed":135789,"data_compressed_allocated":180224,"data_compressed_original":2801664,"omap_allocated":0,"internal_metadata":45940736},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":49568,"kb_used_data":528,"kb_used_omap":0,"kb_used_meta":49024,"kb_avail":94322272,"statfs":{"total":96636764160,"available":96586006528,"internally_reserved":0,"allocated":540672,"data_stored":3129129,"data_compressed":145118,"data_compressed_allocated":192512,"data_compressed_original":2998272,"omap_allocated":0,"internal_metadata":50200576},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":385024,"data_stored":6160384,"data_compressed":292371,"data_compressed_allocated":385024,"data_compressed_original":6160384,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":610304,"data_stored":9764864,"data_compressed":463446,"data_compressed_allocated":610304,"data_compressed_original":9764864,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":577536,"data_stored":9240576,"data_compressed":438556,"data_compressed_allocated":577536,"data_compressed_original":9240576,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:52:42.167 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 3 16 535 519 10.8117 10.375 0.0875266 0.0910471 2024-09-22T03:52:42.493 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:52:42.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:52:42.628+0000 7fa764348640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:52:42.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:52:42.635+0000 7fa764348640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:52:43.167 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 4 16 717 701 10.9522 11.375 0.0972579 0.0901144 2024-09-22T03:52:44.167 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 5 16 920 904 11.2991 12.6875 0.0564853 0.0875424 2024-09-22T03:52:44.941 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:52:45.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:52:45.067+0000 7f352ef11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:52:45.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:52:45.075+0000 7f352ef11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:52:45.167 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 6 16 1113 1097 11.4261 12.0625 0.0706684 0.0870631 2024-09-22T03:52:46.167 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 7 16 1306 1290 11.5169 12.0625 0.103825 0.0865081 2024-09-22T03:52:46.350 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:52:46.350 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:52:46.350 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:52:46.350 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:52:46.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:52:46.503+0000 7f8e59057640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:52:46.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:52:46.521+0000 7f8e59057640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:52:46.544 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:52:46.544 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:52:46.544 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:52:46.544 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:52:46.544 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:52:46.544 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:52:46.544 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:52:46.544 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:52:46.544 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:52:46.544 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:52:46.545 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:52:46.545 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:52:46.548 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:52:46.548 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:52:46.548 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:52:46.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:52:46.688+0000 7fb5f6f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:52:46.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:52:46.702+0000 7fb5f6f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:52:46.768 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:52:46.769 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:52:46.770 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:52:46.770 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:52:46.770 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:52:46.770 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:52:46.770 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:52:46.770 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:52:46.770 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:52:46.770 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:52:46.770 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:52:46.770 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:52:46.772 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:52:46.772 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:52:46.772 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:52:46.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:52:46.930+0000 7ff7c5aac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:52:46.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:52:46.949+0000 7ff7c5aac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:52:47.094 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:52:47.094 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:52:47.094 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:52:47.095 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:52:47.095 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:52:47.095 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:52:47.095 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:52:47.095 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:52:47.095 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:52:47.095 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:52:47.095 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:52:47.095 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:52:47.099 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:52:47.099 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:52:47.100 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:52:47.168 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 8 16 1494 1478 11.5459 11.75 0.13349 0.0859946 2024-09-22T03:52:47.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:52:47.242+0000 7f622e151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:52:47.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:52:47.254+0000 7f622e151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:52:47.387 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:52:47.387 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:52:47.387 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:52:47.387 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:52:47.387 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:52:47.387 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:52:47.387 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:52:47.387 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:52:47.387 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:52:47.387 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:52:47.387 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:52:47.388 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:52:47.390 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:52:47.390 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:52:47.481 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:52:47.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:52:47.612+0000 7f741f246640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:52:47.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:52:47.620+0000 7f741f246640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:52:48.168 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 9 16 1673 1657 11.5059 11.1875 0.0842465 0.0865451 2024-09-22T03:52:49.168 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 10 16 1862 1846 11.5365 11.8125 0.0558748 0.0863314 2024-09-22T03:52:49.970 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:52:50.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:52:50.123+0000 7fb988711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:52:50.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:52:50.130+0000 7fb988711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:52:50.168 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 11 16 2046 2030 11.5331 11.5 0.066104 0.0862455 2024-09-22T03:52:51.168 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 12 16 2224 2208 11.499 11.125 0.0829912 0.0865136 2024-09-22T03:52:52.168 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 13 16 2405 2389 11.4845 11.3125 0.131501 0.0866899 2024-09-22T03:52:52.391 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:52:52.392 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:52:52.392 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:52:52.392 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:52:52.495 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:52:52.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:52:52.524+0000 7f8557151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:52:52.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:52:52.538+0000 7f8557151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:52:52.565 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:52:52.566 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:52:52.566 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:52:52.566 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:52:52.566 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:52:52.566 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:52:52.566 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:52:52.566 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:52:52.566 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:52:52.566 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:52:52.566 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:52:52.566 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:52:52.571 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:52:52.572 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:52:52.572 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:52:52.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:52:52.642+0000 7fa2cfd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:52:52.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:52:52.652+0000 7fa2cfd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:52:52.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:52:52.768+0000 7f3fd8111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:52:52.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:52:52.785+0000 7f3fd8111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:52:52.823 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:52:52.823 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:52:52.824 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:52:52.824 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:52:52.824 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:52:52.824 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:52:52.824 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:52:52.824 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:52:52.824 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:52:52.824 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:52:52.824 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:52:52.824 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:52:52.828 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:52:52.828 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:52:52.829 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:52:53.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:52:53.012+0000 7fc74a8b4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:52:53.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:52:53.030+0000 7fc74a8b4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:52:53.087 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:52:53.088 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:52:53.088 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:52:53.088 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:52:53.088 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:52:53.088 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:52:53.088 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:52:53.088 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:52:53.088 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:52:53.088 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:52:53.088 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:52:53.088 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:52:53.092 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:52:53.093 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:52:53.093 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:52:53.168 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 14 16 2582 2566 11.4543 11.0625 0.0866779 0.0869439 2024-09-22T03:52:53.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:52:53.241+0000 7f603c4ec640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:52:53.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:52:53.256+0000 7f603c4ec640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:52:53.422 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:52:53.422 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:52:53.422 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:52:53.422 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:52:53.422 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:52:53.422 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:52:53.422 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:52:53.422 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:52:53.422 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:52:53.422 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:52:53.423 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:52:53.423 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:52:53.426 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:52:53.426 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:52:54.168 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 15 16 2780 2764 11.5156 12.375 0.105402 0.0865081 2024-09-22T03:52:55.038 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:52:55.168 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 16 16 2962 2946 11.5067 11.375 0.0593801 0.0866573 2024-09-22T03:52:55.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:52:55.204+0000 7f03d4191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:52:55.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:52:55.212+0000 7f03d4191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:52:56.168 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 17 16 3138 3122 11.4769 11 0.120051 0.0868493 2024-09-22T03:52:57.169 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 18 16 3333 3317 11.5163 12.1875 0.0486996 0.0867193 2024-09-22T03:52:57.567 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:52:57.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:52:57.719+0000 7f71410d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:52:57.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:52:57.728+0000 7f71410d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:52:58.169 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 19 16 3522 3506 11.5318 11.8125 0.0470676 0.0864932 2024-09-22T03:52:58.427 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:52:58.428 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:52:58.428 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:52:58.428 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:52:58.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:52:58.578+0000 7f09f2911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:52:58.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:52:58.590+0000 7f09f2911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:52:58.623 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:52:58.623 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:52:58.623 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:52:58.623 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:52:58.623 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:52:58.623 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:52:58.623 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:52:58.623 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:52:58.623 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:52:58.623 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:52:58.623 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:52:58.623 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:52:58.627 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:52:58.627 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:52:58.627 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:52:58.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:52:58.774+0000 7fb90dd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:52:58.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:52:58.790+0000 7fb90dd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:52:58.818 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:52:58.818 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:52:58.818 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:52:58.818 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:52:58.818 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:52:58.818 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:52:58.818 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:52:58.818 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:52:58.819 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:52:58.819 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:52:58.819 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:52:58.819 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:52:58.822 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:52:58.822 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:52:58.822 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:52:58.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:52:58.974+0000 7fcf72263640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:52:58.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:52:58.990+0000 7fcf72263640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:52:59.011 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:52:59.011 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:52:59.011 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:52:59.012 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:52:59.012 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:52:59.012 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:52:59.012 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:52:59.012 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:52:59.012 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:52:59.012 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:52:59.012 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:52:59.012 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:52:59.015 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:52:59.015 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:52:59.016 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:52:59.169 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:2024-09-22T03:52:59.168799+0000 min lat: 0.0149423 max lat: 0.206281 avg lat: 0.0868499 2024-09-22T03:52:59.169 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-22T03:52:59.169 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 20 16 3692 3676 11.4864 10.625 0.0549111 0.0868499 2024-09-22T03:52:59.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:52:59.161+0000 7f5b6e4d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:52:59.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:52:59.174+0000 7f5b6e4d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:52:59.305 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:52:59.305 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:52:59.305 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:52:59.305 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:52:59.305 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:52:59.305 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:52:59.305 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:52:59.305 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:52:59.306 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:52:59.306 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:52:59.306 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:52:59.306 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:52:59.309 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:52:59.309 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:53:00.169 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 21 16 3872 3856 11.4751 11.25 0.152325 0.0869089 2024-09-22T03:53:00.310 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:53:00.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:00.445+0000 7fc422791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:00.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:00.453+0000 7fc422791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:01.169 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 22 16 4056 4040 11.4762 11.5 0.038132 0.0869034 2024-09-22T03:53:02.169 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 23 16 4244 4228 11.4881 11.75 0.0670867 0.086863 2024-09-22T03:53:02.823 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:53:02.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:02.954+0000 7f390c911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:02.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:02.964+0000 7f390c911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:03.169 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 24 16 4413 4397 11.4495 10.5625 0.0561168 0.08712 2024-09-22T03:53:04.169 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 25 16 4597 4581 11.4514 11.5 0.050717 0.0871797 2024-09-22T03:53:04.311 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:53:04.311 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-22T03:53:04.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:04.455+0000 7f137ccd1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:04.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:04.468+0000 7f137ccd1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:05.169 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 26 16 4774 4758 11.4364 11.0625 0.0500333 0.087281 2024-09-22T03:53:05.427 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:53:05.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:05.564+0000 7fc823591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:05.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:05.573+0000 7fc823591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:05.698 INFO:teuthology.orchestra.run.smithi037.stderr:reweighted osd.0 to 1 (10000) 2024-09-22T03:53:05.716 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-22T03:53:05.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:05.870+0000 7f2943191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:05.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:05.890+0000 7f2943191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:06.169 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 27 16 4939 4923 11.3948 10.3125 0.0660864 0.0875843 2024-09-22T03:53:06.699 INFO:teuthology.orchestra.run.smithi037.stderr:reweighted osd.1 to 1 (10000) 2024-09-22T03:53:06.721 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-22T03:53:06.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:06.873+0000 7f9f22751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:06.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:06.890+0000 7f9f22751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:07.169 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 28 16 5124 5108 11.4007 11.5625 0.0893108 0.0875526 2024-09-22T03:53:07.707 INFO:teuthology.orchestra.run.smithi037.stderr:reweighted osd.2 to 1 (10000) 2024-09-22T03:53:07.729 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-22T03:53:07.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:07.884+0000 7fc520b11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:07.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:07.900+0000 7fc520b11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:08.029 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:53:08.169 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 29 16 5303 5287 11.3934 11.1875 0.0628948 0.0876133 2024-09-22T03:53:08.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:08.188+0000 7f192ed91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:08.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:08.199+0000 7f192ed91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:08.716 INFO:teuthology.orchestra.run.smithi037.stderr:reweighted osd.3 to 1 (10000) 2024-09-22T03:53:08.739 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-22T03:53:08.739 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:53:08.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:08.889+0000 7f837c791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:08.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:08.900+0000 7f837c791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:09.170 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 30 16 5470 5454 11.3615 10.4375 0.0741562 0.0878034 2024-09-22T03:53:09.209 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:53:09.209 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-22T03:53:09.229 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":156,"stamp":"2024-09-22T03:53:09.012372+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":314442291,"num_objects":4793,"num_object_clones":0,"num_object_copies":14379,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":4870,"num_write_kb":307604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4844,"ondisk_log_size":4844,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":258028,"kb_used_data":57708,"kb_used_omap":0,"kb_used_meta":200256,"kb_avail":377229332,"statfs":{"total":386547056640,"available":386282835968,"internally_reserved":0,"allocated":59092992,"data_stored":923597501,"data_compressed":43838446,"data_compressed_allocated":57708544,"data_compressed_original":923090944,"omap_allocated":0,"internal_metadata":205062144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":57999360,"num_objects":885,"num_object_clones":0,"num_object_copies":2655,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":885,"num_write_kb":56640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000653"},"pg_stats":[{"pgid":"4.f","version":"40'321","reported_seq":336,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-22T03:53:06.062700+0000","last_change":"2024-09-22T03:52:38.267363+0000","last_active":"2024-09-22T03:53:06.062700+0000","last_peered":"2024-09-22T03:53:06.062700+0000","last_clean":"2024-09-22T03:53:06.062700+0000","last_became_active":"2024-09-22T03:52:38.261984+0000","last_became_peered":"2024-09-22T03:52:38.261984+0000","last_unstale":"2024-09-22T03:53:06.062700+0000","last_undegraded":"2024-09-22T03:53:06.062700+0000","last_fullsized":"2024-09-22T03:53:06.062700+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":321,"log_dups_size":0,"ondisk_log_size":321,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21037056,"num_objects":321,"num_object_clones":0,"num_object_copies":963,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":321,"num_write_kb":20544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"40'318","reported_seq":333,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-22T03:53:05.974270+0000","last_change":"2024-09-22T03:52:38.211390+0000","last_active":"2024-09-22T03:53:05.974270+0000","last_peered":"2024-09-22T03:53:05.974270+0000","last_clean":"2024-09-22T03:53:05.974270+0000","last_became_active":"2024-09-22T03:52:38.190969+0000","last_became_peered":"2024-09-22T03:52:38.190969+0000","last_unstale":"2024-09-22T03:53:05.974270+0000","last_undegraded":"2024-09-22T03:53:05.974270+0000","last_fullsized":"2024-09-22T03:53:05.974270+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":318,"log_dups_size":0,"ondisk_log_size":318,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20840448,"num_objects":318,"num_object_clones":0,"num_object_copies":954,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":318,"num_write_kb":20352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"39'274","reported_seq":286,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-22T03:53:04.707840+0000","last_change":"2024-09-22T03:52:38.196399+0000","last_active":"2024-09-22T03:53:04.707840+0000","last_peered":"2024-09-22T03:53:04.707840+0000","last_clean":"2024-09-22T03:53:04.707840+0000","last_became_active":"2024-09-22T03:52:38.183573+0000","last_became_peered":"2024-09-22T03:52:38.183573+0000","last_unstale":"2024-09-22T03:53:04.707840+0000","last_undegraded":"2024-09-22T03:53:04.707840+0000","last_fullsized":"2024-09-22T03:53:04.707840+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":274,"log_dups_size":0,"ondisk_log_size":274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17956864,"num_objects":274,"num_object_clones":0,"num_object_copies":822,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":274,"num_write_kb":17536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"39'293","reported_seq":305,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-22T03:53:04.888684+0000","last_change":"2024-09-22T03:52:38.241973+0000","last_active":"2024-09-22T03:53:04.888684+0000","last_peered":"2024-09-22T03:53:04.888684+0000","last_clean":"2024-09-22T03:53:04.888684+0000","last_became_active":"2024-09-22T03:52:38.234357+0000","last_became_peered":"2024-09-22T03:52:38.234357+0000","last_unstale":"2024-09-22T03:53:04.888684+0000","last_undegraded":"2024-09-22T03:53:04.888684+0000","last_fullsized":"2024-09-22T03:53:04.888684+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":293,"log_dups_size":0,"ondisk_log_size":293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19202048,"num_objects":293,"num_object_clones":0,"num_object_copies":879,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":293,"num_write_kb":18752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"39'298","reported_seq":310,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-22T03:53:04.884372+0000","last_change":"2024-09-22T03:52:38.234728+0000","last_active":"2024-09-22T03:53:04.884372+0000","last_peered":"2024-09-22T03:53:04.884372+0000","last_clean":"2024-09-22T03:53:04.884372+0000","last_became_active":"2024-09-22T03:52:38.221861+0000","last_became_peered":"2024-09-22T03:52:38.221861+0000","last_unstale":"2024-09-22T03:53:04.884372+0000","last_undegraded":"2024-09-22T03:53:04.884372+0000","last_fullsized":"2024-09-22T03:53:04.884372+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":298,"log_dups_size":0,"ondisk_log_size":298,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19529728,"num_objects":298,"num_object_clones":0,"num_object_copies":894,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":298,"num_write_kb":19072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"39'295","reported_seq":307,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-22T03:53:04.859351+0000","last_change":"2024-09-22T03:52:38.235904+0000","last_active":"2024-09-22T03:53:04.859351+0000","last_peered":"2024-09-22T03:53:04.859351+0000","last_clean":"2024-09-22T03:53:04.859351+0000","last_became_active":"2024-09-22T03:52:38.225232+0000","last_became_peered":"2024-09-22T03:52:38.225232+0000","last_unstale":"2024-09-22T03:53:04.859351+0000","last_undegraded":"2024-09-22T03:53:04.859351+0000","last_fullsized":"2024-09-22T03:53:04.859351+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":295,"log_dups_size":0,"ondisk_log_size":295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19333120,"num_objects":295,"num_object_clones":0,"num_object_copies":885,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":295,"num_write_kb":18880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"39'311","reported_seq":323,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-22T03:53:04.980951+0000","last_change":"2024-09-22T03:52:38.200669+0000","last_active":"2024-09-22T03:53:04.980951+0000","last_peered":"2024-09-22T03:53:04.980951+0000","last_clean":"2024-09-22T03:53:04.980951+0000","last_became_active":"2024-09-22T03:52:38.190269+0000","last_became_peered":"2024-09-22T03:52:38.190269+0000","last_unstale":"2024-09-22T03:53:04.980951+0000","last_undegraded":"2024-09-22T03:53:04.980951+0000","last_fullsized":"2024-09-22T03:53:04.980951+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":311,"log_dups_size":0,"ondisk_log_size":311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20381696,"num_objects":311,"num_object_clones":0,"num_object_copies":933,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":311,"num_write_kb":19904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"39'290","reported_seq":302,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-22T03:53:04.937057+0000","last_change":"2024-09-22T03:52:38.177831+0000","last_active":"2024-09-22T03:53:04.937057+0000","last_peered":"2024-09-22T03:53:04.937057+0000","last_clean":"2024-09-22T03:53:04.937057+0000","last_became_active":"2024-09-22T03:52:38.169555+0000","last_became_peered":"2024-09-22T03:52:38.169555+0000","last_unstale":"2024-09-22T03:53:04.937057+0000","last_undegraded":"2024-09-22T03:53:04.937057+0000","last_fullsized":"2024-09-22T03:53:04.937057+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":290,"log_dups_size":0,"ondisk_log_size":290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19005440,"num_objects":290,"num_object_clones":0,"num_object_copies":870,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":290,"num_write_kb":18560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"39'287","reported_seq":299,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-22T03:53:04.678683+0000","last_change":"2024-09-22T03:52:38.267240+0000","last_active":"2024-09-22T03:53:04.678683+0000","last_peered":"2024-09-22T03:53:04.678683+0000","last_clean":"2024-09-22T03:53:04.678683+0000","last_became_active":"2024-09-22T03:52:38.252880+0000","last_became_peered":"2024-09-22T03:52:38.252880+0000","last_unstale":"2024-09-22T03:53:04.678683+0000","last_undegraded":"2024-09-22T03:53:04.678683+0000","last_fullsized":"2024-09-22T03:53:04.678683+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":287,"log_dups_size":0,"ondisk_log_size":287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18808832,"num_objects":287,"num_object_clones":0,"num_object_copies":861,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":287,"num_write_kb":18368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":163,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-22T03:53:05.736599+0000","last_change":"2024-09-22T03:49:12.034704+0000","last_active":"2024-09-22T03:53:05.736599+0000","last_peered":"2024-09-22T03:53:05.736599+0000","last_clean":"2024-09-22T03:53:05.736599+0000","last_became_active":"2024-09-22T03:49:12.027470+0000","last_became_peered":"2024-09-22T03:49:12.027470+0000","last_unstale":"2024-09-22T03:53:05.736599+0000","last_undegraded":"2024-09-22T03:53:05.736599+0000","last_fullsized":"2024-09-22T03:53:05.736599+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_clean_scrub_stamp":"2024-09-22T03:49:10.979949+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":86,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-22T03:52:39.100352+0000","last_change":"2024-09-22T03:49:17.031458+0000","last_active":"2024-09-22T03:52:39.100352+0000","last_peered":"2024-09-22T03:52:39.100352+0000","last_clean":"2024-09-22T03:52:39.100352+0000","last_became_active":"2024-09-22T03:49:15.125490+0000","last_became_peered":"2024-09-22T03:49:15.125490+0000","last_unstale":"2024-09-22T03:52:39.100352+0000","last_undegraded":"2024-09-22T03:52:39.100352+0000","last_fullsized":"2024-09-22T03:52:39.100352+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"39'256","reported_seq":268,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-22T03:53:04.732497+0000","last_change":"2024-09-22T03:52:38.263115+0000","last_active":"2024-09-22T03:53:04.732497+0000","last_peered":"2024-09-22T03:53:04.732497+0000","last_clean":"2024-09-22T03:53:04.732497+0000","last_became_active":"2024-09-22T03:52:38.245622+0000","last_became_peered":"2024-09-22T03:52:38.245622+0000","last_unstale":"2024-09-22T03:53:04.732497+0000","last_undegraded":"2024-09-22T03:53:04.732497+0000","last_fullsized":"2024-09-22T03:53:04.732497+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":256,"log_dups_size":0,"ondisk_log_size":256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":256,"num_object_clones":0,"num_object_copies":768,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":256,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-22T03:52:39.090973+0000","last_change":"2024-09-22T03:49:17.029339+0000","last_active":"2024-09-22T03:52:39.090973+0000","last_peered":"2024-09-22T03:52:39.090973+0000","last_clean":"2024-09-22T03:52:39.090973+0000","last_became_active":"2024-09-22T03:49:15.097304+0000","last_became_peered":"2024-09-22T03:49:15.097304+0000","last_unstale":"2024-09-22T03:52:39.090973+0000","last_undegraded":"2024-09-22T03:52:39.090973+0000","last_fullsized":"2024-09-22T03:52:39.090973+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"40'315","reported_seq":330,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-22T03:53:06.033981+0000","last_change":"2024-09-22T03:52:38.234061+0000","last_active":"2024-09-22T03:53:06.033981+0000","last_peered":"2024-09-22T03:53:06.033981+0000","last_clean":"2024-09-22T03:53:06.033981+0000","last_became_active":"2024-09-22T03:52:38.222894+0000","last_became_peered":"2024-09-22T03:52:38.222894+0000","last_unstale":"2024-09-22T03:53:06.033981+0000","last_undegraded":"2024-09-22T03:53:06.033981+0000","last_fullsized":"2024-09-22T03:53:06.033981+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":315,"log_dups_size":0,"ondisk_log_size":315,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20643840,"num_objects":315,"num_object_clones":0,"num_object_copies":945,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":315,"num_write_kb":20160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-22T03:52:39.101539+0000","last_change":"2024-09-22T03:49:17.029349+0000","last_active":"2024-09-22T03:52:39.101539+0000","last_peered":"2024-09-22T03:52:39.101539+0000","last_clean":"2024-09-22T03:52:39.101539+0000","last_became_active":"2024-09-22T03:49:15.094890+0000","last_became_peered":"2024-09-22T03:49:15.094890+0000","last_unstale":"2024-09-22T03:52:39.101539+0000","last_undegraded":"2024-09-22T03:52:39.101539+0000","last_fullsized":"2024-09-22T03:52:39.101539+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"40'335","reported_seq":350,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-22T03:53:05.975027+0000","last_change":"2024-09-22T03:52:38.248145+0000","last_active":"2024-09-22T03:53:05.975027+0000","last_peered":"2024-09-22T03:53:05.975027+0000","last_clean":"2024-09-22T03:53:05.975027+0000","last_became_active":"2024-09-22T03:52:38.241420+0000","last_became_peered":"2024-09-22T03:52:38.241420+0000","last_unstale":"2024-09-22T03:53:05.975027+0000","last_undegraded":"2024-09-22T03:53:05.975027+0000","last_fullsized":"2024-09-22T03:53:05.975027+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":335,"log_dups_size":0,"ondisk_log_size":335,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21954560,"num_objects":335,"num_object_clones":0,"num_object_copies":1005,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":335,"num_write_kb":21440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":87,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-22T03:52:39.100276+0000","last_change":"2024-09-22T03:49:17.031466+0000","last_active":"2024-09-22T03:52:39.100276+0000","last_peered":"2024-09-22T03:52:39.100276+0000","last_clean":"2024-09-22T03:52:39.100276+0000","last_became_active":"2024-09-22T03:49:15.098420+0000","last_became_peered":"2024-09-22T03:49:15.098420+0000","last_unstale":"2024-09-22T03:52:39.100276+0000","last_undegraded":"2024-09-22T03:52:39.100276+0000","last_fullsized":"2024-09-22T03:52:39.100276+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2","version":"39'287","reported_seq":299,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-22T03:53:04.904968+0000","last_change":"2024-09-22T03:52:38.215825+0000","last_active":"2024-09-22T03:53:04.904968+0000","last_peered":"2024-09-22T03:53:04.904968+0000","last_clean":"2024-09-22T03:53:04.904968+0000","last_became_active":"2024-09-22T03:52:38.203741+0000","last_became_peered":"2024-09-22T03:52:38.203741+0000","last_unstale":"2024-09-22T03:53:04.904968+0000","last_undegraded":"2024-09-22T03:53:04.904968+0000","last_fullsized":"2024-09-22T03:53:04.904968+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":287,"log_dups_size":0,"ondisk_log_size":287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18808832,"num_objects":287,"num_object_clones":0,"num_object_copies":861,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":287,"num_write_kb":18368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":88,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-22T03:53:05.755485+0000","last_change":"2024-09-22T03:49:17.036954+0000","last_active":"2024-09-22T03:53:05.755485+0000","last_peered":"2024-09-22T03:53:05.755485+0000","last_clean":"2024-09-22T03:53:05.755485+0000","last_became_active":"2024-09-22T03:49:15.110506+0000","last_became_peered":"2024-09-22T03:49:15.110506+0000","last_unstale":"2024-09-22T03:53:05.755485+0000","last_undegraded":"2024-09-22T03:53:05.755485+0000","last_fullsized":"2024-09-22T03:53:05.755485+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"39'308","reported_seq":320,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-22T03:53:04.999894+0000","last_change":"2024-09-22T03:52:38.239558+0000","last_active":"2024-09-22T03:53:04.999894+0000","last_peered":"2024-09-22T03:53:04.999894+0000","last_clean":"2024-09-22T03:53:04.999894+0000","last_became_active":"2024-09-22T03:52:38.229931+0000","last_became_peered":"2024-09-22T03:52:38.229931+0000","last_unstale":"2024-09-22T03:53:04.999894+0000","last_undegraded":"2024-09-22T03:53:04.999894+0000","last_fullsized":"2024-09-22T03:53:04.999894+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":308,"log_dups_size":0,"ondisk_log_size":308,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20185088,"num_objects":308,"num_object_clones":0,"num_object_copies":924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":308,"num_write_kb":19712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":88,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-22T03:53:05.742164+0000","last_change":"2024-09-22T03:49:17.032989+0000","last_active":"2024-09-22T03:53:05.742164+0000","last_peered":"2024-09-22T03:53:05.742164+0000","last_clean":"2024-09-22T03:53:05.742164+0000","last_became_active":"2024-09-22T03:49:15.079260+0000","last_became_peered":"2024-09-22T03:49:15.079260+0000","last_unstale":"2024-09-22T03:53:05.742164+0000","last_undegraded":"2024-09-22T03:53:05.742164+0000","last_fullsized":"2024-09-22T03:53:05.742164+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"39'308","reported_seq":320,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-22T03:53:04.849378+0000","last_change":"2024-09-22T03:52:38.258650+0000","last_active":"2024-09-22T03:53:04.849378+0000","last_peered":"2024-09-22T03:53:04.849378+0000","last_clean":"2024-09-22T03:53:04.849378+0000","last_became_active":"2024-09-22T03:52:38.238553+0000","last_became_peered":"2024-09-22T03:52:38.238553+0000","last_unstale":"2024-09-22T03:53:04.849378+0000","last_undegraded":"2024-09-22T03:53:04.849378+0000","last_fullsized":"2024-09-22T03:53:04.849378+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":308,"log_dups_size":0,"ondisk_log_size":308,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20185088,"num_objects":308,"num_object_clones":0,"num_object_copies":924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":308,"num_write_kb":19712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":88,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-22T03:53:05.747178+0000","last_change":"2024-09-22T03:49:17.036402+0000","last_active":"2024-09-22T03:53:05.747178+0000","last_peered":"2024-09-22T03:53:05.747178+0000","last_clean":"2024-09-22T03:53:05.747178+0000","last_became_active":"2024-09-22T03:49:15.108430+0000","last_became_peered":"2024-09-22T03:49:15.108430+0000","last_unstale":"2024-09-22T03:53:05.747178+0000","last_undegraded":"2024-09-22T03:53:05.747178+0000","last_fullsized":"2024-09-22T03:53:05.747178+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"39'293","reported_seq":305,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-22T03:53:04.981015+0000","last_change":"2024-09-22T03:52:38.208326+0000","last_active":"2024-09-22T03:53:04.981015+0000","last_peered":"2024-09-22T03:53:04.981015+0000","last_clean":"2024-09-22T03:53:04.981015+0000","last_became_active":"2024-09-22T03:52:38.200509+0000","last_became_peered":"2024-09-22T03:52:38.200509+0000","last_unstale":"2024-09-22T03:53:04.981015+0000","last_undegraded":"2024-09-22T03:53:04.981015+0000","last_fullsized":"2024-09-22T03:53:04.981015+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":293,"log_dups_size":0,"ondisk_log_size":293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19202048,"num_objects":293,"num_object_clones":0,"num_object_copies":879,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":293,"num_write_kb":18752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-22T03:52:39.092091+0000","last_change":"2024-09-22T03:49:17.029128+0000","last_active":"2024-09-22T03:52:39.092091+0000","last_peered":"2024-09-22T03:52:39.092091+0000","last_clean":"2024-09-22T03:52:39.092091+0000","last_became_active":"2024-09-22T03:49:15.113396+0000","last_became_peered":"2024-09-22T03:49:15.113396+0000","last_unstale":"2024-09-22T03:52:39.092091+0000","last_undegraded":"2024-09-22T03:52:39.092091+0000","last_fullsized":"2024-09-22T03:52:39.092091+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":313851904,"num_objects":4789,"num_object_clones":0,"num_object_copies":14367,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4789,"num_write_kb":306496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":58834944,"data_stored":941359104,"data_compressed":44697438,"data_compressed_allocated":58834944,"data_compressed_original":941359104,"omap_allocated":0,"internal_metadata":0},"log_size":4789,"ondisk_log_size":4789,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949673194,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":62692,"kb_used_data":13652,"kb_used_omap":0,"kb_used_meta":49024,"kb_avail":94309148,"statfs":{"total":96636764160,"available":96572567552,"internally_reserved":0,"allocated":13979648,"data_stored":218087228,"data_compressed":10351790,"data_compressed_allocated":13627392,"data_compressed_original":217956352,"omap_allocated":0,"internal_metadata":50200576},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654705898,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":78020,"kb_used_data":16500,"kb_used_omap":0,"kb_used_meta":61504,"kb_avail":94293820,"statfs":{"total":96636764160,"available":96556871680,"internally_reserved":0,"allocated":16896000,"data_stored":265141532,"data_compressed":12583951,"data_compressed_allocated":16564224,"data_compressed_original":265027584,"omap_allocated":0,"internal_metadata":62980096},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705898,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":61520,"kb_used_data":16640,"kb_used_omap":0,"kb_used_meta":44864,"kb_avail":94310320,"statfs":{"total":96636764160,"available":96573767680,"internally_reserved":0,"allocated":17039360,"data_stored":267042620,"data_compressed":12676242,"data_compressed_allocated":16687104,"data_compressed_original":266911744,"omap_allocated":0,"internal_metadata":45940736},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705898,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":55796,"kb_used_data":10916,"kb_used_omap":0,"kb_used_meta":44864,"kb_avail":94316044,"statfs":{"total":96636764160,"available":96579629056,"internally_reserved":0,"allocated":11177984,"data_stored":173326121,"data_compressed":8226463,"data_compressed_allocated":10829824,"data_compressed_original":173195264,"omap_allocated":0,"internal_metadata":45940736},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":11034624,"data_stored":176553984,"data_compressed":8383127,"data_compressed_allocated":11034624,"data_compressed_original":176553984,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":13869056,"data_stored":221904896,"data_compressed":10536462,"data_compressed_allocated":13869056,"data_compressed_original":221904896,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16965632,"data_stored":271450112,"data_compressed":12888922,"data_compressed_allocated":16965632,"data_compressed_original":271450112,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16965632,"data_stored":271450112,"data_compressed":12888927,"data_compressed_allocated":16965632,"data_compressed_original":271450112,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:53:09.230 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:53:09.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:09.399+0000 7f5d5d0c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:09.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:09.410+0000 7f5d5d0c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:09.747 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:53:09.748 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-22T03:53:09.767 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":156,"stamp":"2024-09-22T03:53:09.012372+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":314442291,"num_objects":4793,"num_object_clones":0,"num_object_copies":14379,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":4870,"num_write_kb":307604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4844,"ondisk_log_size":4844,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":258028,"kb_used_data":57708,"kb_used_omap":0,"kb_used_meta":200256,"kb_avail":377229332,"statfs":{"total":386547056640,"available":386282835968,"internally_reserved":0,"allocated":59092992,"data_stored":923597501,"data_compressed":43838446,"data_compressed_allocated":57708544,"data_compressed_original":923090944,"omap_allocated":0,"internal_metadata":205062144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":57999360,"num_objects":885,"num_object_clones":0,"num_object_copies":2655,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":885,"num_write_kb":56640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000653"},"pg_stats":[{"pgid":"4.f","version":"40'321","reported_seq":336,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-22T03:53:06.062700+0000","last_change":"2024-09-22T03:52:38.267363+0000","last_active":"2024-09-22T03:53:06.062700+0000","last_peered":"2024-09-22T03:53:06.062700+0000","last_clean":"2024-09-22T03:53:06.062700+0000","last_became_active":"2024-09-22T03:52:38.261984+0000","last_became_peered":"2024-09-22T03:52:38.261984+0000","last_unstale":"2024-09-22T03:53:06.062700+0000","last_undegraded":"2024-09-22T03:53:06.062700+0000","last_fullsized":"2024-09-22T03:53:06.062700+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":321,"log_dups_size":0,"ondisk_log_size":321,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21037056,"num_objects":321,"num_object_clones":0,"num_object_copies":963,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":321,"num_write_kb":20544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"40'318","reported_seq":333,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-22T03:53:05.974270+0000","last_change":"2024-09-22T03:52:38.211390+0000","last_active":"2024-09-22T03:53:05.974270+0000","last_peered":"2024-09-22T03:53:05.974270+0000","last_clean":"2024-09-22T03:53:05.974270+0000","last_became_active":"2024-09-22T03:52:38.190969+0000","last_became_peered":"2024-09-22T03:52:38.190969+0000","last_unstale":"2024-09-22T03:53:05.974270+0000","last_undegraded":"2024-09-22T03:53:05.974270+0000","last_fullsized":"2024-09-22T03:53:05.974270+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":318,"log_dups_size":0,"ondisk_log_size":318,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20840448,"num_objects":318,"num_object_clones":0,"num_object_copies":954,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":318,"num_write_kb":20352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"39'274","reported_seq":286,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-22T03:53:04.707840+0000","last_change":"2024-09-22T03:52:38.196399+0000","last_active":"2024-09-22T03:53:04.707840+0000","last_peered":"2024-09-22T03:53:04.707840+0000","last_clean":"2024-09-22T03:53:04.707840+0000","last_became_active":"2024-09-22T03:52:38.183573+0000","last_became_peered":"2024-09-22T03:52:38.183573+0000","last_unstale":"2024-09-22T03:53:04.707840+0000","last_undegraded":"2024-09-22T03:53:04.707840+0000","last_fullsized":"2024-09-22T03:53:04.707840+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":274,"log_dups_size":0,"ondisk_log_size":274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17956864,"num_objects":274,"num_object_clones":0,"num_object_copies":822,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":274,"num_write_kb":17536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"39'293","reported_seq":305,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-22T03:53:04.888684+0000","last_change":"2024-09-22T03:52:38.241973+0000","last_active":"2024-09-22T03:53:04.888684+0000","last_peered":"2024-09-22T03:53:04.888684+0000","last_clean":"2024-09-22T03:53:04.888684+0000","last_became_active":"2024-09-22T03:52:38.234357+0000","last_became_peered":"2024-09-22T03:52:38.234357+0000","last_unstale":"2024-09-22T03:53:04.888684+0000","last_undegraded":"2024-09-22T03:53:04.888684+0000","last_fullsized":"2024-09-22T03:53:04.888684+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":293,"log_dups_size":0,"ondisk_log_size":293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19202048,"num_objects":293,"num_object_clones":0,"num_object_copies":879,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":293,"num_write_kb":18752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"39'298","reported_seq":310,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-22T03:53:04.884372+0000","last_change":"2024-09-22T03:52:38.234728+0000","last_active":"2024-09-22T03:53:04.884372+0000","last_peered":"2024-09-22T03:53:04.884372+0000","last_clean":"2024-09-22T03:53:04.884372+0000","last_became_active":"2024-09-22T03:52:38.221861+0000","last_became_peered":"2024-09-22T03:52:38.221861+0000","last_unstale":"2024-09-22T03:53:04.884372+0000","last_undegraded":"2024-09-22T03:53:04.884372+0000","last_fullsized":"2024-09-22T03:53:04.884372+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":298,"log_dups_size":0,"ondisk_log_size":298,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19529728,"num_objects":298,"num_object_clones":0,"num_object_copies":894,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":298,"num_write_kb":19072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"39'295","reported_seq":307,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-22T03:53:04.859351+0000","last_change":"2024-09-22T03:52:38.235904+0000","last_active":"2024-09-22T03:53:04.859351+0000","last_peered":"2024-09-22T03:53:04.859351+0000","last_clean":"2024-09-22T03:53:04.859351+0000","last_became_active":"2024-09-22T03:52:38.225232+0000","last_became_peered":"2024-09-22T03:52:38.225232+0000","last_unstale":"2024-09-22T03:53:04.859351+0000","last_undegraded":"2024-09-22T03:53:04.859351+0000","last_fullsized":"2024-09-22T03:53:04.859351+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":295,"log_dups_size":0,"ondisk_log_size":295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19333120,"num_objects":295,"num_object_clones":0,"num_object_copies":885,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":295,"num_write_kb":18880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"39'311","reported_seq":323,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-22T03:53:04.980951+0000","last_change":"2024-09-22T03:52:38.200669+0000","last_active":"2024-09-22T03:53:04.980951+0000","last_peered":"2024-09-22T03:53:04.980951+0000","last_clean":"2024-09-22T03:53:04.980951+0000","last_became_active":"2024-09-22T03:52:38.190269+0000","last_became_peered":"2024-09-22T03:52:38.190269+0000","last_unstale":"2024-09-22T03:53:04.980951+0000","last_undegraded":"2024-09-22T03:53:04.980951+0000","last_fullsized":"2024-09-22T03:53:04.980951+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":311,"log_dups_size":0,"ondisk_log_size":311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20381696,"num_objects":311,"num_object_clones":0,"num_object_copies":933,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":311,"num_write_kb":19904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"39'290","reported_seq":302,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-22T03:53:04.937057+0000","last_change":"2024-09-22T03:52:38.177831+0000","last_active":"2024-09-22T03:53:04.937057+0000","last_peered":"2024-09-22T03:53:04.937057+0000","last_clean":"2024-09-22T03:53:04.937057+0000","last_became_active":"2024-09-22T03:52:38.169555+0000","last_became_peered":"2024-09-22T03:52:38.169555+0000","last_unstale":"2024-09-22T03:53:04.937057+0000","last_undegraded":"2024-09-22T03:53:04.937057+0000","last_fullsized":"2024-09-22T03:53:04.937057+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":290,"log_dups_size":0,"ondisk_log_size":290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19005440,"num_objects":290,"num_object_clones":0,"num_object_copies":870,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":290,"num_write_kb":18560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"39'287","reported_seq":299,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-22T03:53:04.678683+0000","last_change":"2024-09-22T03:52:38.267240+0000","last_active":"2024-09-22T03:53:04.678683+0000","last_peered":"2024-09-22T03:53:04.678683+0000","last_clean":"2024-09-22T03:53:04.678683+0000","last_became_active":"2024-09-22T03:52:38.252880+0000","last_became_peered":"2024-09-22T03:52:38.252880+0000","last_unstale":"2024-09-22T03:53:04.678683+0000","last_undegraded":"2024-09-22T03:53:04.678683+0000","last_fullsized":"2024-09-22T03:53:04.678683+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":287,"log_dups_size":0,"ondisk_log_size":287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18808832,"num_objects":287,"num_object_clones":0,"num_object_copies":861,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":287,"num_write_kb":18368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":163,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-22T03:53:05.736599+0000","last_change":"2024-09-22T03:49:12.034704+0000","last_active":"2024-09-22T03:53:05.736599+0000","last_peered":"2024-09-22T03:53:05.736599+0000","last_clean":"2024-09-22T03:53:05.736599+0000","last_became_active":"2024-09-22T03:49:12.027470+0000","last_became_peered":"2024-09-22T03:49:12.027470+0000","last_unstale":"2024-09-22T03:53:05.736599+0000","last_undegraded":"2024-09-22T03:53:05.736599+0000","last_fullsized":"2024-09-22T03:53:05.736599+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_clean_scrub_stamp":"2024-09-22T03:49:10.979949+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":86,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-22T03:52:39.100352+0000","last_change":"2024-09-22T03:49:17.031458+0000","last_active":"2024-09-22T03:52:39.100352+0000","last_peered":"2024-09-22T03:52:39.100352+0000","last_clean":"2024-09-22T03:52:39.100352+0000","last_became_active":"2024-09-22T03:49:15.125490+0000","last_became_peered":"2024-09-22T03:49:15.125490+0000","last_unstale":"2024-09-22T03:52:39.100352+0000","last_undegraded":"2024-09-22T03:52:39.100352+0000","last_fullsized":"2024-09-22T03:52:39.100352+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"39'256","reported_seq":268,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-22T03:53:04.732497+0000","last_change":"2024-09-22T03:52:38.263115+0000","last_active":"2024-09-22T03:53:04.732497+0000","last_peered":"2024-09-22T03:53:04.732497+0000","last_clean":"2024-09-22T03:53:04.732497+0000","last_became_active":"2024-09-22T03:52:38.245622+0000","last_became_peered":"2024-09-22T03:52:38.245622+0000","last_unstale":"2024-09-22T03:53:04.732497+0000","last_undegraded":"2024-09-22T03:53:04.732497+0000","last_fullsized":"2024-09-22T03:53:04.732497+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":256,"log_dups_size":0,"ondisk_log_size":256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":256,"num_object_clones":0,"num_object_copies":768,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":256,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-22T03:52:39.090973+0000","last_change":"2024-09-22T03:49:17.029339+0000","last_active":"2024-09-22T03:52:39.090973+0000","last_peered":"2024-09-22T03:52:39.090973+0000","last_clean":"2024-09-22T03:52:39.090973+0000","last_became_active":"2024-09-22T03:49:15.097304+0000","last_became_peered":"2024-09-22T03:49:15.097304+0000","last_unstale":"2024-09-22T03:52:39.090973+0000","last_undegraded":"2024-09-22T03:52:39.090973+0000","last_fullsized":"2024-09-22T03:52:39.090973+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"40'315","reported_seq":330,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-22T03:53:06.033981+0000","last_change":"2024-09-22T03:52:38.234061+0000","last_active":"2024-09-22T03:53:06.033981+0000","last_peered":"2024-09-22T03:53:06.033981+0000","last_clean":"2024-09-22T03:53:06.033981+0000","last_became_active":"2024-09-22T03:52:38.222894+0000","last_became_peered":"2024-09-22T03:52:38.222894+0000","last_unstale":"2024-09-22T03:53:06.033981+0000","last_undegraded":"2024-09-22T03:53:06.033981+0000","last_fullsized":"2024-09-22T03:53:06.033981+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":315,"log_dups_size":0,"ondisk_log_size":315,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20643840,"num_objects":315,"num_object_clones":0,"num_object_copies":945,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":315,"num_write_kb":20160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-22T03:52:39.101539+0000","last_change":"2024-09-22T03:49:17.029349+0000","last_active":"2024-09-22T03:52:39.101539+0000","last_peered":"2024-09-22T03:52:39.101539+0000","last_clean":"2024-09-22T03:52:39.101539+0000","last_became_active":"2024-09-22T03:49:15.094890+0000","last_became_peered":"2024-09-22T03:49:15.094890+0000","last_unstale":"2024-09-22T03:52:39.101539+0000","last_undegraded":"2024-09-22T03:52:39.101539+0000","last_fullsized":"2024-09-22T03:52:39.101539+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"40'335","reported_seq":350,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-22T03:53:05.975027+0000","last_change":"2024-09-22T03:52:38.248145+0000","last_active":"2024-09-22T03:53:05.975027+0000","last_peered":"2024-09-22T03:53:05.975027+0000","last_clean":"2024-09-22T03:53:05.975027+0000","last_became_active":"2024-09-22T03:52:38.241420+0000","last_became_peered":"2024-09-22T03:52:38.241420+0000","last_unstale":"2024-09-22T03:53:05.975027+0000","last_undegraded":"2024-09-22T03:53:05.975027+0000","last_fullsized":"2024-09-22T03:53:05.975027+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":335,"log_dups_size":0,"ondisk_log_size":335,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21954560,"num_objects":335,"num_object_clones":0,"num_object_copies":1005,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":335,"num_write_kb":21440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":87,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-22T03:52:39.100276+0000","last_change":"2024-09-22T03:49:17.031466+0000","last_active":"2024-09-22T03:52:39.100276+0000","last_peered":"2024-09-22T03:52:39.100276+0000","last_clean":"2024-09-22T03:52:39.100276+0000","last_became_active":"2024-09-22T03:49:15.098420+0000","last_became_peered":"2024-09-22T03:49:15.098420+0000","last_unstale":"2024-09-22T03:52:39.100276+0000","last_undegraded":"2024-09-22T03:52:39.100276+0000","last_fullsized":"2024-09-22T03:52:39.100276+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2","version":"39'287","reported_seq":299,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-22T03:53:04.904968+0000","last_change":"2024-09-22T03:52:38.215825+0000","last_active":"2024-09-22T03:53:04.904968+0000","last_peered":"2024-09-22T03:53:04.904968+0000","last_clean":"2024-09-22T03:53:04.904968+0000","last_became_active":"2024-09-22T03:52:38.203741+0000","last_became_peered":"2024-09-22T03:52:38.203741+0000","last_unstale":"2024-09-22T03:53:04.904968+0000","last_undegraded":"2024-09-22T03:53:04.904968+0000","last_fullsized":"2024-09-22T03:53:04.904968+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":287,"log_dups_size":0,"ondisk_log_size":287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18808832,"num_objects":287,"num_object_clones":0,"num_object_copies":861,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":287,"num_write_kb":18368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":88,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-22T03:53:05.755485+0000","last_change":"2024-09-22T03:49:17.036954+0000","last_active":"2024-09-22T03:53:05.755485+0000","last_peered":"2024-09-22T03:53:05.755485+0000","last_clean":"2024-09-22T03:53:05.755485+0000","last_became_active":"2024-09-22T03:49:15.110506+0000","last_became_peered":"2024-09-22T03:49:15.110506+0000","last_unstale":"2024-09-22T03:53:05.755485+0000","last_undegraded":"2024-09-22T03:53:05.755485+0000","last_fullsized":"2024-09-22T03:53:05.755485+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"39'308","reported_seq":320,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-22T03:53:04.999894+0000","last_change":"2024-09-22T03:52:38.239558+0000","last_active":"2024-09-22T03:53:04.999894+0000","last_peered":"2024-09-22T03:53:04.999894+0000","last_clean":"2024-09-22T03:53:04.999894+0000","last_became_active":"2024-09-22T03:52:38.229931+0000","last_became_peered":"2024-09-22T03:52:38.229931+0000","last_unstale":"2024-09-22T03:53:04.999894+0000","last_undegraded":"2024-09-22T03:53:04.999894+0000","last_fullsized":"2024-09-22T03:53:04.999894+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":308,"log_dups_size":0,"ondisk_log_size":308,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20185088,"num_objects":308,"num_object_clones":0,"num_object_copies":924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":308,"num_write_kb":19712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":88,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-22T03:53:05.742164+0000","last_change":"2024-09-22T03:49:17.032989+0000","last_active":"2024-09-22T03:53:05.742164+0000","last_peered":"2024-09-22T03:53:05.742164+0000","last_clean":"2024-09-22T03:53:05.742164+0000","last_became_active":"2024-09-22T03:49:15.079260+0000","last_became_peered":"2024-09-22T03:49:15.079260+0000","last_unstale":"2024-09-22T03:53:05.742164+0000","last_undegraded":"2024-09-22T03:53:05.742164+0000","last_fullsized":"2024-09-22T03:53:05.742164+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"39'308","reported_seq":320,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-22T03:53:04.849378+0000","last_change":"2024-09-22T03:52:38.258650+0000","last_active":"2024-09-22T03:53:04.849378+0000","last_peered":"2024-09-22T03:53:04.849378+0000","last_clean":"2024-09-22T03:53:04.849378+0000","last_became_active":"2024-09-22T03:52:38.238553+0000","last_became_peered":"2024-09-22T03:52:38.238553+0000","last_unstale":"2024-09-22T03:53:04.849378+0000","last_undegraded":"2024-09-22T03:53:04.849378+0000","last_fullsized":"2024-09-22T03:53:04.849378+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":308,"log_dups_size":0,"ondisk_log_size":308,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20185088,"num_objects":308,"num_object_clones":0,"num_object_copies":924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":308,"num_write_kb":19712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":88,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-22T03:53:05.747178+0000","last_change":"2024-09-22T03:49:17.036402+0000","last_active":"2024-09-22T03:53:05.747178+0000","last_peered":"2024-09-22T03:53:05.747178+0000","last_clean":"2024-09-22T03:53:05.747178+0000","last_became_active":"2024-09-22T03:49:15.108430+0000","last_became_peered":"2024-09-22T03:49:15.108430+0000","last_unstale":"2024-09-22T03:53:05.747178+0000","last_undegraded":"2024-09-22T03:53:05.747178+0000","last_fullsized":"2024-09-22T03:53:05.747178+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"39'293","reported_seq":305,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-22T03:53:04.981015+0000","last_change":"2024-09-22T03:52:38.208326+0000","last_active":"2024-09-22T03:53:04.981015+0000","last_peered":"2024-09-22T03:53:04.981015+0000","last_clean":"2024-09-22T03:53:04.981015+0000","last_became_active":"2024-09-22T03:52:38.200509+0000","last_became_peered":"2024-09-22T03:52:38.200509+0000","last_unstale":"2024-09-22T03:53:04.981015+0000","last_undegraded":"2024-09-22T03:53:04.981015+0000","last_fullsized":"2024-09-22T03:53:04.981015+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":293,"log_dups_size":0,"ondisk_log_size":293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19202048,"num_objects":293,"num_object_clones":0,"num_object_copies":879,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":293,"num_write_kb":18752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":85,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-22T03:52:39.092091+0000","last_change":"2024-09-22T03:49:17.029128+0000","last_active":"2024-09-22T03:52:39.092091+0000","last_peered":"2024-09-22T03:52:39.092091+0000","last_clean":"2024-09-22T03:52:39.092091+0000","last_became_active":"2024-09-22T03:49:15.113396+0000","last_became_peered":"2024-09-22T03:49:15.113396+0000","last_unstale":"2024-09-22T03:52:39.092091+0000","last_undegraded":"2024-09-22T03:52:39.092091+0000","last_fullsized":"2024-09-22T03:52:39.092091+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":313851904,"num_objects":4789,"num_object_clones":0,"num_object_copies":14367,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4789,"num_write_kb":306496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":58834944,"data_stored":941359104,"data_compressed":44697438,"data_compressed_allocated":58834944,"data_compressed_original":941359104,"omap_allocated":0,"internal_metadata":0},"log_size":4789,"ondisk_log_size":4789,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949673194,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":62692,"kb_used_data":13652,"kb_used_omap":0,"kb_used_meta":49024,"kb_avail":94309148,"statfs":{"total":96636764160,"available":96572567552,"internally_reserved":0,"allocated":13979648,"data_stored":218087228,"data_compressed":10351790,"data_compressed_allocated":13627392,"data_compressed_original":217956352,"omap_allocated":0,"internal_metadata":50200576},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654705898,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":78020,"kb_used_data":16500,"kb_used_omap":0,"kb_used_meta":61504,"kb_avail":94293820,"statfs":{"total":96636764160,"available":96556871680,"internally_reserved":0,"allocated":16896000,"data_stored":265141532,"data_compressed":12583951,"data_compressed_allocated":16564224,"data_compressed_original":265027584,"omap_allocated":0,"internal_metadata":62980096},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705898,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":61520,"kb_used_data":16640,"kb_used_omap":0,"kb_used_meta":44864,"kb_avail":94310320,"statfs":{"total":96636764160,"available":96573767680,"internally_reserved":0,"allocated":17039360,"data_stored":267042620,"data_compressed":12676242,"data_compressed_allocated":16687104,"data_compressed_original":266911744,"omap_allocated":0,"internal_metadata":45940736},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705898,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":55796,"kb_used_data":10916,"kb_used_omap":0,"kb_used_meta":44864,"kb_avail":94316044,"statfs":{"total":96636764160,"available":96579629056,"internally_reserved":0,"allocated":11177984,"data_stored":173326121,"data_compressed":8226463,"data_compressed_allocated":10829824,"data_compressed_original":173195264,"omap_allocated":0,"internal_metadata":45940736},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":11034624,"data_stored":176553984,"data_compressed":8383127,"data_compressed_allocated":11034624,"data_compressed_original":176553984,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":13869056,"data_stored":221904896,"data_compressed":10536462,"data_compressed_allocated":13869056,"data_compressed_original":221904896,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16965632,"data_stored":271450112,"data_compressed":12888922,"data_compressed_allocated":16965632,"data_compressed_original":271450112,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16965632,"data_stored":271450112,"data_compressed":12888927,"data_compressed_allocated":16965632,"data_compressed_original":271450112,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:53:09.768 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-22T03:53:09.768 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:53:09.769 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:53:09.769 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:53:09.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:09.916+0000 7fc137591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:09.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:09.930+0000 7fc137591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:09.957 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:53:09.957 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:53:09.957 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:53:09.957 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:53:09.957 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:53:09.957 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:53:09.957 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:53:09.957 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:53:09.957 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:53:09.957 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:53:09.957 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:53:09.957 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:53:09.961 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:53:09.962 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:53:09.962 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:53:10.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:10.103+0000 7f2477ed1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:10.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:10.122+0000 7f2477ed1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:10.158 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:53:10.158 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:53:10.158 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:53:10.159 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:53:10.159 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:53:10.159 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:53:10.159 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:53:10.159 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:53:10.159 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:53:10.159 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:53:10.159 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:53:10.159 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:53:10.163 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:53:10.163 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:53:10.164 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:53:10.169 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 31 16 5645 5629 11.3478 10.9375 0.113907 0.0879563 2024-09-22T03:53:10.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:10.313+0000 7f64072fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:10.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:10.325+0000 7f64072fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:10.442 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:53:10.443 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:53:10.443 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:53:10.443 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:53:10.443 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:53:10.443 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:53:10.443 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:53:10.443 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:53:10.443 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:53:10.443 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:53:10.443 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:53:10.443 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:53:10.447 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:53:10.447 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:53:10.447 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:53:10.588 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:53:10.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:10.649+0000 7efedeb08640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:10.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:10.660+0000 7efedeb08640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:10.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:10.725+0000 7fd529e74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:10.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:10.733+0000 7fd529e74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:10.827 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:53:10.827 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:53:10.827 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:53:10.827 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:53:10.827 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:53:10.827 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:53:10.828 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:53:10.828 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:53:10.828 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:53:10.828 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:53:10.828 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:53:10.828 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:53:10.831 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:53:10.831 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:53:11.170 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 32 16 5811 5795 11.3173 10.375 0.0649163 0.0881897 2024-09-22T03:53:12.170 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 33 16 5985 5969 11.3039 10.875 0.115776 0.0882948 2024-09-22T03:53:13.065 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:53:13.170 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 34 16 6174 6158 11.3188 11.8125 0.0552702 0.0881942 2024-09-22T03:53:13.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:13.211+0000 7f792af91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:13.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:13.221+0000 7f792af91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:14.170 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 35 16 6331 6315 11.2758 9.8125 0.123149 0.0885389 2024-09-22T03:53:15.170 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 36 16 6509 6493 11.2715 11.125 0.0448345 0.0885512 2024-09-22T03:53:15.592 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:53:15.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:15.740+0000 7fa866391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:15.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:15.750+0000 7fa866391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:15.832 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:53:15.833 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:53:15.833 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:53:15.833 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:53:15.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:15.983+0000 7f55f8cd1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:16.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:16.003+0000 7f55f8cd1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:16.058 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:53:16.058 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:53:16.059 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:53:16.059 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:53:16.059 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:53:16.059 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:53:16.059 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:53:16.059 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:53:16.059 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:53:16.059 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:53:16.059 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:53:16.059 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:53:16.062 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:53:16.062 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:53:16.063 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:53:16.171 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 37 16 6689 6673 11.2709 11.25 0.0920557 0.0886066 2024-09-22T03:53:16.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:16.199+0000 7fde502d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:16.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:16.213+0000 7fde502d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:16.280 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:53:16.280 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:53:16.280 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:53:16.280 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:53:16.280 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:53:16.280 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:53:16.280 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:53:16.280 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:53:16.280 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:53:16.280 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:53:16.280 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:53:16.280 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:53:16.283 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:53:16.283 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:53:16.283 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:53:16.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:16.415+0000 7fe16eb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:16.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:16.429+0000 7fe16eb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:16.673 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:53:16.674 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:53:16.674 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:53:16.674 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:53:16.674 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:53:16.674 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:53:16.674 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:53:16.674 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:53:16.674 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:53:16.674 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:53:16.674 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:53:16.674 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:53:16.677 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:53:16.677 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:53:16.677 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:53:16.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:16.825+0000 7f7cbeb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:16.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:16.841+0000 7f7cbeb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:17.030 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:53:17.030 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:53:17.031 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:53:17.031 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:53:17.031 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:53:17.031 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:53:17.031 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:53:17.031 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:53:17.031 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:53:17.031 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:53:17.031 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:53:17.031 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:53:17.034 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:53:17.034 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:53:17.170 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 38 16 6851 6835 11.2407 10.125 0.126815 0.0887294 2024-09-22T03:53:18.171 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 39 16 7025 7009 11.2313 10.875 0.0634502 0.0888917 2024-09-22T03:53:18.284 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:53:18.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:18.435+0000 7fd173191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:18.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:18.443+0000 7fd173191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:19.171 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:2024-09-22T03:53:19.170672+0000 min lat: 0.0149423 max lat: 0.215218 avg lat: 0.0890224 2024-09-22T03:53:19.171 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-22T03:53:19.171 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 40 16 7198 7182 11.2208 10.8125 0.0642123 0.0890224 2024-09-22T03:53:20.171 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 41 16 7373 7357 11.2139 10.9375 0.110926 0.0890874 2024-09-22T03:53:20.778 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:53:20.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:20.929+0000 7fbb35f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:20.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:20.938+0000 7fbb35f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:21.175 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 42 16 7543 7527 11.1999 10.625 0.0658545 0.0891829 2024-09-22T03:53:22.034 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:53:22.035 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:53:22.035 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:53:22.035 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:53:22.171 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 43 16 7724 7708 11.2025 11.3125 0.135402 0.0891197 2024-09-22T03:53:22.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:22.174+0000 7fe755b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:22.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:22.184+0000 7fe755b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:22.212 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:53:22.212 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:53:22.212 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:53:22.212 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:53:22.213 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:53:22.213 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:53:22.213 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:53:22.213 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:53:22.213 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:53:22.213 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:53:22.213 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:53:22.213 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:53:22.217 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:53:22.217 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:53:22.218 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:53:22.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:22.376+0000 7f46e8674640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:22.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:22.390+0000 7f46e8674640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:22.417 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:53:22.417 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:53:22.417 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:53:22.417 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:53:22.417 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:53:22.417 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:53:22.417 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:53:22.417 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:53:22.417 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:53:22.417 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:53:22.417 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:53:22.417 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:53:22.421 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:53:22.421 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:53:22.421 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:53:22.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:22.583+0000 7fb168191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:22.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:22.600+0000 7fb168191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:22.647 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:53:22.647 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:53:22.647 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:53:22.647 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:53:22.647 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:53:22.647 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:53:22.648 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:53:22.648 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:53:22.648 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:53:22.648 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:53:22.648 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:53:22.648 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:53:22.651 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:53:22.651 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:53:22.651 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:53:22.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:22.800+0000 7f2f2ac63640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:22.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:22.818+0000 7f2f2ac63640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:22.991 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:53:22.992 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:53:22.992 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:53:22.992 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:53:22.992 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:53:22.992 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:53:22.992 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:53:22.993 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:53:22.993 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:53:22.993 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:53:22.993 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:53:22.993 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:53:22.995 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:53:22.996 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:53:23.171 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 44 16 7900 7884 11.1978 11 0.0891884 0.0892026 2024-09-22T03:53:23.271 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:53:23.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:23.418+0000 7f1cf5791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:23.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:23.426+0000 7f1cf5791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:24.171 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 45 16 8083 8067 11.2031 11.4375 0.165361 0.08916 2024-09-22T03:53:25.171 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 46 16 8265 8249 11.2069 11.375 0.100326 0.0891474 2024-09-22T03:53:25.895 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:53:26.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:26.028+0000 7f19f8646640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:26.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:26.036+0000 7f19f8646640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:26.171 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 47 16 8449 8433 11.2131 11.5 0.0801918 0.0891088 2024-09-22T03:53:27.171 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 48 16 8610 8594 11.1891 10.0625 0.0578413 0.0892617 2024-09-22T03:53:27.996 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:53:27.996 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:53:27.997 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:53:27.997 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:53:28.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:28.143+0000 7f54c2d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:28.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:28.157+0000 7f54c2d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:28.171 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 49 16 8777 8761 11.1737 10.4375 0.107909 0.0893698 2024-09-22T03:53:28.183 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:53:28.183 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:53:28.184 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:53:28.184 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:53:28.184 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:53:28.184 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:53:28.184 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:53:28.184 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:53:28.184 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:53:28.184 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:53:28.184 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:53:28.184 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:53:28.187 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:53:28.187 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:53:28.187 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:53:28.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:28.339+0000 7f83daf91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:28.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:28.352+0000 7f83daf91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:28.399 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:53:28.427 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:53:28.427 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:53:28.427 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:53:28.427 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:53:28.428 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:53:28.428 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:53:28.428 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:53:28.428 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:53:28.428 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:53:28.428 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:53:28.428 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:53:28.428 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:53:28.433 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:53:28.433 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:53:28.433 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:53:28.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:28.548+0000 7f7a5b591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:28.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:28.558+0000 7f7a5b591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:28.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:28.615+0000 7fc843646640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:28.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:28.631+0000 7fc843646640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:28.793 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:53:28.793 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:53:28.793 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:53:28.793 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:53:28.793 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:53:28.793 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:53:28.793 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:53:28.793 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:53:28.793 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:53:28.793 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:53:28.793 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:53:28.794 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:53:28.795 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:53:28.796 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:53:28.796 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:53:28.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:28.947+0000 7f985b991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:28.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:28.959+0000 7f985b991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:29.126 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:53:29.127 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:53:29.127 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:53:29.127 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:53:29.127 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:53:29.127 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:53:29.127 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:53:29.127 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:53:29.127 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:53:29.127 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:53:29.127 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:53:29.127 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:53:29.131 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:53:29.131 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:53:29.171 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 50 16 8957 8941 11.1752 11.25 0.0493079 0.0894051 2024-09-22T03:53:30.171 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 51 16 9135 9119 11.1742 11.125 0.0961639 0.0893852 2024-09-22T03:53:30.979 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:53:31.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:31.117+0000 7f5ea8e74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:31.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:31.126+0000 7f5ea8e74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:31.172 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 52 15 9314 9299 11.1757 11.25 0.121954 0.0893783 2024-09-22T03:53:32.172 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 53 16 9487 9471 11.1676 10.75 0.082487 0.0894522 2024-09-22T03:53:33.172 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 54 16 9655 9639 11.1552 10.5 0.0324664 0.0895562 2024-09-22T03:53:33.448 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:53:33.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:33.588+0000 7f31ca711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:33.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:33.598+0000 7f31ca711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:34.132 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:53:34.132 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:53:34.132 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:53:34.133 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:53:34.172 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 55 16 9815 9799 11.1342 10 0.10865 0.0897096 2024-09-22T03:53:34.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:34.278+0000 7fb9d6b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:34.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:34.293+0000 7fb9d6b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:34.312 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:53:34.312 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:53:34.312 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:53:34.312 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:53:34.312 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:53:34.312 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:53:34.312 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:53:34.312 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:53:34.312 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:53:34.313 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:53:34.313 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:53:34.313 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:53:34.315 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:53:34.316 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:53:34.316 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:53:34.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:34.489+0000 7f5322f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:34.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:34.501+0000 7f5322f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:34.522 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:53:34.522 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:53:34.522 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:53:34.522 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:53:34.522 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:53:34.522 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:53:34.522 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:53:34.522 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:53:34.522 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:53:34.522 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:53:34.522 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:53:34.522 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:53:34.525 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:53:34.525 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:53:34.525 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:53:34.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:34.667+0000 7fad6de7d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:34.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:34.682+0000 7fad6de7d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:34.753 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:53:34.754 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:53:34.754 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:53:34.754 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:53:34.754 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:53:34.754 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:53:34.754 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:53:34.754 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:53:34.754 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:53:34.754 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:53:34.754 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:53:34.754 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:53:34.758 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:53:34.758 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:53:34.759 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:53:34.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:34.905+0000 7fdc89e7f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:34.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:34.917+0000 7fdc89e7f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:35.144 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:53:35.144 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:53:35.144 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:53:35.144 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:53:35.144 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:53:35.144 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:53:35.144 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:53:35.144 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:53:35.145 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:53:35.145 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:53:35.145 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:53:35.145 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:53:35.148 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:53:35.149 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:53:35.172 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 56 16 9984 9968 11.124 10.5625 0.113153 0.0898077 2024-09-22T03:53:35.924 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:53:36.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:36.089+0000 7fe528cac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:36.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:36.097+0000 7fe528cac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:36.172 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 57 16 10154 10138 11.1152 10.625 0.106281 0.0898712 2024-09-22T03:53:37.174 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 58 16 10337 10321 11.1208 11.4375 0.129804 0.0898327 2024-09-22T03:53:38.172 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 59 16 10521 10505 11.1272 11.5 0.087887 0.0898005 2024-09-22T03:53:38.545 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:53:38.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:38.684+0000 7f623ca63640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:38.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:38.691+0000 7f623ca63640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:39.172 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:2024-09-22T03:53:39.172426+0000 min lat: 0.0149423 max lat: 0.227375 avg lat: 0.0898681 2024-09-22T03:53:39.173 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-22T03:53:39.173 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 60 16 10688 10672 11.1157 10.4375 0.0430238 0.0898681 2024-09-22T03:53:40.150 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:53:40.150 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:53:40.151 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:53:40.151 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:53:40.172 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 61 16 10846 10830 11.0953 9.875 0.125915 0.0900076 2024-09-22T03:53:40.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:40.301+0000 7fd0fed91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:40.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:40.316+0000 7fd0fed91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:40.343 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:53:40.343 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:53:40.343 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:53:40.343 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:53:40.343 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:53:40.343 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:53:40.343 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:53:40.343 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:53:40.343 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:53:40.344 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:53:40.344 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:53:40.344 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:53:40.346 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:53:40.347 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:53:40.347 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:53:40.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:40.520+0000 7f9a37308640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:40.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:40.534+0000 7f9a37308640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:40.564 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:53:40.564 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:53:40.564 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:53:40.565 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:53:40.565 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:53:40.565 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:53:40.565 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:53:40.565 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:53:40.565 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:53:40.565 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:53:40.565 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:53:40.565 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:53:40.570 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:53:40.571 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:53:40.571 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:53:40.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:40.720+0000 7efc25991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:40.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:40.734+0000 7efc25991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:40.853 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:53:40.853 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:53:40.853 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:53:40.853 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:53:40.854 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:53:40.854 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:53:40.854 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:53:40.854 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:53:40.854 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:53:40.855 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:53:40.855 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:53:40.855 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:53:40.856 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:53:40.857 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:53:40.857 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:53:41.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:41.016+0000 7f3df6391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:41.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:41.032+0000 7f3df6391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:41.087 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:53:41.173 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 62 16 11010 10994 11.0817 10.25 0.0936617 0.0901372 2024-09-22T03:53:41.198 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:53:41.198 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:53:41.198 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:53:41.198 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:53:41.198 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:53:41.198 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:53:41.198 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:53:41.198 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:53:41.198 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:53:41.198 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:53:41.198 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:53:41.198 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:53:41.202 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:53:41.203 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:53:41.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:41.248+0000 7f9f39ea3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:41.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:41.257+0000 7f9f39ea3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:42.173 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 63 16 11185 11169 11.0794 10.9375 0.0919588 0.0901905 2024-09-22T03:53:43.173 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 64 16 11335 11319 11.0527 9.375 0.0612392 0.090376 2024-09-22T03:53:43.645 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:53:43.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:43.777+0000 7f83def91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:43.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:43.786+0000 7f83def91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:44.173 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 65 16 11502 11486 11.0432 10.4375 0.0864402 0.0904782 2024-09-22T03:53:45.173 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 66 16 11663 11647 11.0284 10.0625 0.0824373 0.0905891 2024-09-22T03:53:46.173 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 67 16 11839 11823 11.0279 11 0.0788609 0.0906251 2024-09-22T03:53:46.203 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:53:46.203 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:53:46.204 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:53:46.204 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:53:46.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:46.348+0000 7f6540311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:46.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:46.361+0000 7f6540311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:46.365 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:53:46.386 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:53:46.386 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:53:46.386 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:53:46.386 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:53:46.386 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:53:46.386 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:53:46.387 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:53:46.387 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:53:46.387 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:53:46.387 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:53:46.387 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:53:46.387 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:53:46.389 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:53:46.389 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:53:46.390 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:53:46.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:46.522+0000 7f4467b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:46.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:46.530+0000 7f4467b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:46.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:46.586+0000 7fb5eef91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:46.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:46.599+0000 7fb5eef91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:46.716 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:53:46.716 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:53:46.716 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:53:46.716 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:53:46.716 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:53:46.716 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:53:46.717 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:53:46.717 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:53:46.717 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:53:46.717 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:53:46.717 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:53:46.717 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:53:46.719 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:53:46.719 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:53:46.719 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:53:46.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:46.861+0000 7f8bedd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:46.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:46.880+0000 7f8bedd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:46.922 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:53:46.922 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:53:46.922 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:53:46.922 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:53:46.922 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:53:46.923 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:53:46.923 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:53:46.923 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:53:46.923 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:53:46.923 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:53:46.923 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:53:46.923 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:53:46.927 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:53:46.927 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:53:46.928 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:53:47.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:47.086+0000 7f926b591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:47.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:47.101+0000 7f926b591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:47.173 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 68 16 12009 11993 11.022 10.625 0.113744 0.0906546 2024-09-22T03:53:47.311 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:53:47.311 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:53:47.311 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:53:47.311 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:53:47.311 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:53:47.311 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:53:47.311 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:53:47.311 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:53:47.311 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:53:47.311 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:53:47.312 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:53:47.312 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:53:47.314 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:53:47.315 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:53:48.173 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 69 16 12171 12155 11.009 10.125 0.108413 0.0907775 2024-09-22T03:53:48.999 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:53:49.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:49.137+0000 7fedacabd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:49.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:49.144+0000 7fedacabd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:49.173 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 70 16 12338 12322 11.0008 10.4375 0.075384 0.0908109 2024-09-22T03:53:50.173 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 71 16 12496 12480 10.9849 9.875 0.0463244 0.0909557 2024-09-22T03:53:51.173 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 72 16 12657 12641 10.9721 10.0625 0.0717871 0.0910582 2024-09-22T03:53:51.541 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:53:51.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:51.672+0000 7f3a72b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:51.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:51.680+0000 7f3a72b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:52.173 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 73 16 12814 12798 10.9562 9.8125 0.1042 0.0912026 2024-09-22T03:53:52.316 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:53:52.316 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:53:52.316 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:53:52.316 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:53:52.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:52.461+0000 7fec79191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:52.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:52.472+0000 7fec79191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:52.498 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:53:52.499 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:53:52.499 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:53:52.499 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:53:52.499 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:53:52.499 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:53:52.499 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:53:52.499 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:53:52.499 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:53:52.499 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:53:52.499 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:53:52.500 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:53:52.502 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:53:52.502 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:53:52.502 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:53:52.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:52.640+0000 7fc2702d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:52.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:52.652+0000 7fc2702d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:52.697 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:53:52.697 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:53:52.697 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:53:52.697 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:53:52.697 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:53:52.697 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:53:52.698 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:53:52.698 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:53:52.698 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:53:52.698 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:53:52.698 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:53:52.698 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:53:52.704 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:53:52.705 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:53:52.705 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:53:52.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:52.857+0000 7fc319cc8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:52.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:52.872+0000 7fc319cc8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:53.100 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:53:53.100 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:53:53.100 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:53:53.100 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:53:53.100 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:53:53.101 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:53:53.101 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:53:53.101 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:53:53.101 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:53:53.101 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:53:53.101 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:53:53.101 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:53:53.104 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:53:53.104 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:53:53.105 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:53:53.174 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 74 16 12973 12957 10.9424 9.9375 0.0474332 0.0913189 2024-09-22T03:53:53.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:53.249+0000 7f9185f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:53.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:53.265+0000 7f9185f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:53.417 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:53:53.418 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:53:53.418 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:53:53.418 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:53:53.418 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:53:53.418 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:53:53.418 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:53:53.418 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:53:53.418 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:53:53.418 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:53:53.418 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:53:53.418 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:53:53.421 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:53:53.422 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:53:54.066 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:53:54.175 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 75 16 13142 13126 10.9373 10.5625 0.0612729 0.0913651 2024-09-22T03:53:54.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:54.228+0000 7ff64f991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:54.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:54.236+0000 7ff64f991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:55.174 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 76 16 13304 13288 10.9266 10.125 0.129688 0.0914427 2024-09-22T03:53:56.174 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 77 16 13460 13444 10.9113 9.75 0.071732 0.0915844 2024-09-22T03:53:56.609 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:53:56.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:56.763+0000 7f4a9309c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:56.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:56.772+0000 7f4a9309c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:57.174 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 78 16 13621 13605 10.9004 10.0625 0.183727 0.0916359 2024-09-22T03:53:58.174 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 79 16 13782 13766 10.8898 10.0625 0.102046 0.0917494 2024-09-22T03:53:58.423 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:53:58.423 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:53:58.423 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:53:58.423 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:53:58.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:58.555+0000 7fe86066c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:58.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:58.569+0000 7fe86066c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:58.589 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:53:58.589 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:53:58.589 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:53:58.589 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:53:58.589 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:53:58.589 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:53:58.589 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:53:58.590 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:53:58.590 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:53:58.590 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:53:58.590 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:53:58.590 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:53:58.593 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:53:58.593 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:53:58.593 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:53:58.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:58.740+0000 7faa37674640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:58.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:58.750+0000 7faa37674640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:58.821 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:53:58.821 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:53:58.821 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:53:58.821 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:53:58.821 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:53:58.821 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:53:58.822 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:53:58.822 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:53:58.822 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:53:58.822 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:53:58.822 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:53:58.822 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:53:58.825 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:53:58.825 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:53:58.825 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:53:58.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:58.968+0000 7f0cf8f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:58.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:58.984+0000 7f0cf8f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:59.125 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:53:59.125 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:53:59.125 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:53:59.125 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:53:59.125 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:53:59.125 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:53:59.125 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:53:59.125 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:53:59.126 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:53:59.126 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:53:59.126 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:53:59.126 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:53:59.128 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:53:59.128 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:53:59.129 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:53:59.166 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:53:59.174 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:2024-09-22T03:53:59.174258+0000 min lat: 0.0149423 max lat: 0.228666 avg lat: 0.0918713 2024-09-22T03:53:59.174 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-22T03:53:59.174 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 80 16 13937 13921 10.8748 9.6875 0.140536 0.0918713 2024-09-22T03:53:59.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:59.264+0000 7efca58bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:59.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:59.284+0000 7efca58bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:59.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:59.342+0000 7feec48a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:59.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:53:59.357+0000 7feec48a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:53:59.500 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:53:59.501 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:53:59.501 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:53:59.501 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:53:59.501 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:53:59.501 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:53:59.501 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:53:59.501 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:53:59.501 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:53:59.501 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:53:59.501 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:53:59.501 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:53:59.505 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:53:59.506 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:54:00.174 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 81 16 14103 14087 10.8686 10.375 0.08065 0.091955 2024-09-22T03:54:01.174 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 82 16 14266 14250 10.8603 10.1875 0.0893331 0.0920049 2024-09-22T03:54:01.968 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:54:02.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:54:02.092+0000 7fc653348640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:54:02.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:54:02.101+0000 7fc653348640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:54:02.174 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 83 16 14434 14418 10.8559 10.5 0.0885597 0.0920674 2024-09-22T03:54:03.174 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 84 16 14589 14573 10.842 9.6875 0.15108 0.0921692 2024-09-22T03:54:04.175 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 85 16 14756 14740 10.8372 10.4375 0.0877564 0.092221 2024-09-22T03:54:04.506 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:54:04.506 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:54:04.507 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:54:04.558 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:54:04.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:54:04.640+0000 7f32ea111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:54:04.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:54:04.652+0000 7f32ea111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:54:04.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:54:04.720+0000 7f0ebbd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:54:04.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:54:04.728+0000 7f0ebbd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:54:04.936 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:54:04.936 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-22T03:54:04.958 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":183,"stamp":"2024-09-22T03:54:03.024060+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":926155315,"num_objects":14127,"num_object_clones":0,"num_object_copies":42381,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":14204,"num_write_kb":904980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14178,"ondisk_log_size":14178,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":431544,"kb_used_data":170168,"kb_used_omap":0,"kb_used_meta":261312,"kb_avail":377055816,"statfs":{"total":386547056640,"available":386105155584,"internally_reserved":0,"allocated":174252032,"data_stored":2764097357,"data_compressed":131232739,"data_compressed_allocated":172736512,"data_compressed_original":2763538432,"omap_allocated":0,"internal_metadata":267583488},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":120127488,"num_objects":1833,"num_object_clones":0,"num_object_copies":5499,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1833,"num_write_kb":117312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002733"},"pg_stats":[{"pgid":"4.f","version":"43'879","reported_seq":903,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:54:00.732538+0000","last_change":"2024-09-22T03:52:38.267363+0000","last_active":"2024-09-22T03:54:00.732538+0000","last_peered":"2024-09-22T03:54:00.732538+0000","last_clean":"2024-09-22T03:54:00.732538+0000","last_became_active":"2024-09-22T03:52:38.261984+0000","last_became_peered":"2024-09-22T03:52:38.261984+0000","last_unstale":"2024-09-22T03:54:00.732538+0000","last_undegraded":"2024-09-22T03:54:00.732538+0000","last_fullsized":"2024-09-22T03:54:00.732538+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":879,"log_dups_size":0,"ondisk_log_size":879,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57606144,"num_objects":879,"num_object_clones":0,"num_object_copies":2637,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":879,"num_write_kb":56256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"43'891","reported_seq":915,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:54:00.724658+0000","last_change":"2024-09-22T03:52:38.211390+0000","last_active":"2024-09-22T03:54:00.724658+0000","last_peered":"2024-09-22T03:54:00.724658+0000","last_clean":"2024-09-22T03:54:00.724658+0000","last_became_active":"2024-09-22T03:52:38.190969+0000","last_became_peered":"2024-09-22T03:52:38.190969+0000","last_unstale":"2024-09-22T03:54:00.724658+0000","last_undegraded":"2024-09-22T03:54:00.724658+0000","last_fullsized":"2024-09-22T03:54:00.724658+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":891,"log_dups_size":0,"ondisk_log_size":891,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58392576,"num_objects":891,"num_object_clones":0,"num_object_copies":2673,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":891,"num_write_kb":57024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"43'837","reported_seq":861,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:53:59.801211+0000","last_change":"2024-09-22T03:52:38.196399+0000","last_active":"2024-09-22T03:53:59.801211+0000","last_peered":"2024-09-22T03:53:59.801211+0000","last_clean":"2024-09-22T03:53:59.801211+0000","last_became_active":"2024-09-22T03:52:38.183573+0000","last_became_peered":"2024-09-22T03:52:38.183573+0000","last_unstale":"2024-09-22T03:53:59.801211+0000","last_undegraded":"2024-09-22T03:53:59.801211+0000","last_fullsized":"2024-09-22T03:53:59.801211+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":837,"log_dups_size":0,"ondisk_log_size":837,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54853632,"num_objects":837,"num_object_clones":0,"num_object_copies":2511,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":837,"num_write_kb":53568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"43'859","reported_seq":883,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:53:59.585270+0000","last_change":"2024-09-22T03:52:38.241973+0000","last_active":"2024-09-22T03:53:59.585270+0000","last_peered":"2024-09-22T03:53:59.585270+0000","last_clean":"2024-09-22T03:53:59.585270+0000","last_became_active":"2024-09-22T03:52:38.234357+0000","last_became_peered":"2024-09-22T03:52:38.234357+0000","last_unstale":"2024-09-22T03:53:59.585270+0000","last_undegraded":"2024-09-22T03:53:59.585270+0000","last_fullsized":"2024-09-22T03:53:59.585270+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":859,"log_dups_size":0,"ondisk_log_size":859,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56295424,"num_objects":859,"num_object_clones":0,"num_object_copies":2577,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":859,"num_write_kb":54976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"43'836","reported_seq":860,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:53:59.779988+0000","last_change":"2024-09-22T03:52:38.234728+0000","last_active":"2024-09-22T03:53:59.779988+0000","last_peered":"2024-09-22T03:53:59.779988+0000","last_clean":"2024-09-22T03:53:59.779988+0000","last_became_active":"2024-09-22T03:52:38.221861+0000","last_became_peered":"2024-09-22T03:52:38.221861+0000","last_unstale":"2024-09-22T03:53:59.779988+0000","last_undegraded":"2024-09-22T03:53:59.779988+0000","last_fullsized":"2024-09-22T03:53:59.779988+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":836,"log_dups_size":0,"ondisk_log_size":836,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54788096,"num_objects":836,"num_object_clones":0,"num_object_copies":2508,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":836,"num_write_kb":53504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"43'899","reported_seq":923,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:53:59.923764+0000","last_change":"2024-09-22T03:52:38.235904+0000","last_active":"2024-09-22T03:53:59.923764+0000","last_peered":"2024-09-22T03:53:59.923764+0000","last_clean":"2024-09-22T03:53:59.923764+0000","last_became_active":"2024-09-22T03:52:38.225232+0000","last_became_peered":"2024-09-22T03:52:38.225232+0000","last_unstale":"2024-09-22T03:53:59.923764+0000","last_undegraded":"2024-09-22T03:53:59.923764+0000","last_fullsized":"2024-09-22T03:53:59.923764+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":899,"log_dups_size":0,"ondisk_log_size":899,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58916864,"num_objects":899,"num_object_clones":0,"num_object_copies":2697,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":899,"num_write_kb":57536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"43'904","reported_seq":928,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:53:59.937595+0000","last_change":"2024-09-22T03:52:38.200669+0000","last_active":"2024-09-22T03:53:59.937595+0000","last_peered":"2024-09-22T03:53:59.937595+0000","last_clean":"2024-09-22T03:53:59.937595+0000","last_became_active":"2024-09-22T03:52:38.190269+0000","last_became_peered":"2024-09-22T03:52:38.190269+0000","last_unstale":"2024-09-22T03:53:59.937595+0000","last_undegraded":"2024-09-22T03:53:59.937595+0000","last_fullsized":"2024-09-22T03:53:59.937595+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":904,"log_dups_size":0,"ondisk_log_size":904,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59244544,"num_objects":904,"num_object_clones":0,"num_object_copies":2712,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":904,"num_write_kb":57856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"43'893","reported_seq":917,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:53:59.875840+0000","last_change":"2024-09-22T03:52:38.177831+0000","last_active":"2024-09-22T03:53:59.875840+0000","last_peered":"2024-09-22T03:53:59.875840+0000","last_clean":"2024-09-22T03:53:59.875840+0000","last_became_active":"2024-09-22T03:52:38.169555+0000","last_became_peered":"2024-09-22T03:52:38.169555+0000","last_unstale":"2024-09-22T03:53:59.875840+0000","last_undegraded":"2024-09-22T03:53:59.875840+0000","last_fullsized":"2024-09-22T03:53:59.875840+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":893,"log_dups_size":0,"ondisk_log_size":893,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58523648,"num_objects":893,"num_object_clones":0,"num_object_copies":2679,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":893,"num_write_kb":57152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"43'863","reported_seq":887,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:53:59.734915+0000","last_change":"2024-09-22T03:52:38.267240+0000","last_active":"2024-09-22T03:53:59.734915+0000","last_peered":"2024-09-22T03:53:59.734915+0000","last_clean":"2024-09-22T03:53:59.734915+0000","last_became_active":"2024-09-22T03:52:38.252880+0000","last_became_peered":"2024-09-22T03:52:38.252880+0000","last_unstale":"2024-09-22T03:53:59.734915+0000","last_undegraded":"2024-09-22T03:53:59.734915+0000","last_fullsized":"2024-09-22T03:53:59.734915+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":863,"log_dups_size":0,"ondisk_log_size":863,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56557568,"num_objects":863,"num_object_clones":0,"num_object_copies":2589,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":863,"num_write_kb":55232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":172,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:53:08.738004+0000","last_change":"2024-09-22T03:49:12.034704+0000","last_active":"2024-09-22T03:53:08.738004+0000","last_peered":"2024-09-22T03:53:08.738004+0000","last_clean":"2024-09-22T03:53:08.738004+0000","last_became_active":"2024-09-22T03:49:12.027470+0000","last_became_peered":"2024-09-22T03:49:12.027470+0000","last_unstale":"2024-09-22T03:53:08.738004+0000","last_undegraded":"2024-09-22T03:53:08.738004+0000","last_fullsized":"2024-09-22T03:53:08.738004+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_clean_scrub_stamp":"2024-09-22T03:49:10.979949+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":98,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:53:08.753153+0000","last_change":"2024-09-22T03:49:17.031458+0000","last_active":"2024-09-22T03:53:08.753153+0000","last_peered":"2024-09-22T03:53:08.753153+0000","last_clean":"2024-09-22T03:53:08.753153+0000","last_became_active":"2024-09-22T03:49:15.125490+0000","last_became_peered":"2024-09-22T03:49:15.125490+0000","last_unstale":"2024-09-22T03:53:08.753153+0000","last_undegraded":"2024-09-22T03:53:08.753153+0000","last_fullsized":"2024-09-22T03:53:08.753153+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"43'848","reported_seq":872,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:53:59.811590+0000","last_change":"2024-09-22T03:52:38.263115+0000","last_active":"2024-09-22T03:53:59.811590+0000","last_peered":"2024-09-22T03:53:59.811590+0000","last_clean":"2024-09-22T03:53:59.811590+0000","last_became_active":"2024-09-22T03:52:38.245622+0000","last_became_peered":"2024-09-22T03:52:38.245622+0000","last_unstale":"2024-09-22T03:53:59.811590+0000","last_undegraded":"2024-09-22T03:53:59.811590+0000","last_fullsized":"2024-09-22T03:53:59.811590+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":848,"log_dups_size":0,"ondisk_log_size":848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55574528,"num_objects":848,"num_object_clones":0,"num_object_copies":2544,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":848,"num_write_kb":54272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:53:08.749573+0000","last_change":"2024-09-22T03:49:17.029339+0000","last_active":"2024-09-22T03:53:08.749573+0000","last_peered":"2024-09-22T03:53:08.749573+0000","last_clean":"2024-09-22T03:53:08.749573+0000","last_became_active":"2024-09-22T03:49:15.097304+0000","last_became_peered":"2024-09-22T03:49:15.097304+0000","last_unstale":"2024-09-22T03:53:08.749573+0000","last_undegraded":"2024-09-22T03:53:08.749573+0000","last_fullsized":"2024-09-22T03:53:08.749573+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"43'929","reported_seq":953,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:54:00.898403+0000","last_change":"2024-09-22T03:52:38.234061+0000","last_active":"2024-09-22T03:54:00.898403+0000","last_peered":"2024-09-22T03:54:00.898403+0000","last_clean":"2024-09-22T03:54:00.898403+0000","last_became_active":"2024-09-22T03:52:38.222894+0000","last_became_peered":"2024-09-22T03:52:38.222894+0000","last_unstale":"2024-09-22T03:54:00.898403+0000","last_undegraded":"2024-09-22T03:54:00.898403+0000","last_fullsized":"2024-09-22T03:54:00.898403+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":929,"log_dups_size":0,"ondisk_log_size":929,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60882944,"num_objects":929,"num_object_clones":0,"num_object_copies":2787,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":929,"num_write_kb":59456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:53:08.765557+0000","last_change":"2024-09-22T03:49:17.029349+0000","last_active":"2024-09-22T03:53:08.765557+0000","last_peered":"2024-09-22T03:53:08.765557+0000","last_clean":"2024-09-22T03:53:08.765557+0000","last_became_active":"2024-09-22T03:49:15.094890+0000","last_became_peered":"2024-09-22T03:49:15.094890+0000","last_unstale":"2024-09-22T03:53:08.765557+0000","last_undegraded":"2024-09-22T03:53:08.765557+0000","last_fullsized":"2024-09-22T03:53:08.765557+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"43'951","reported_seq":975,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:54:01.011438+0000","last_change":"2024-09-22T03:52:38.248145+0000","last_active":"2024-09-22T03:54:01.011438+0000","last_peered":"2024-09-22T03:54:01.011438+0000","last_clean":"2024-09-22T03:54:01.011438+0000","last_became_active":"2024-09-22T03:52:38.241420+0000","last_became_peered":"2024-09-22T03:52:38.241420+0000","last_unstale":"2024-09-22T03:54:01.011438+0000","last_undegraded":"2024-09-22T03:54:01.011438+0000","last_fullsized":"2024-09-22T03:54:01.011438+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":951,"log_dups_size":0,"ondisk_log_size":951,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62324736,"num_objects":951,"num_object_clones":0,"num_object_copies":2853,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":951,"num_write_kb":60864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":99,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:53:08.758873+0000","last_change":"2024-09-22T03:49:17.031466+0000","last_active":"2024-09-22T03:53:08.758873+0000","last_peered":"2024-09-22T03:53:08.758873+0000","last_clean":"2024-09-22T03:53:08.758873+0000","last_became_active":"2024-09-22T03:49:15.098420+0000","last_became_peered":"2024-09-22T03:49:15.098420+0000","last_unstale":"2024-09-22T03:53:08.758873+0000","last_undegraded":"2024-09-22T03:53:08.758873+0000","last_fullsized":"2024-09-22T03:53:08.758873+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2","version":"43'876","reported_seq":900,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:54:00.011967+0000","last_change":"2024-09-22T03:52:38.215825+0000","last_active":"2024-09-22T03:54:00.011967+0000","last_peered":"2024-09-22T03:54:00.011967+0000","last_clean":"2024-09-22T03:54:00.011967+0000","last_became_active":"2024-09-22T03:52:38.203741+0000","last_became_peered":"2024-09-22T03:52:38.203741+0000","last_unstale":"2024-09-22T03:54:00.011967+0000","last_undegraded":"2024-09-22T03:54:00.011967+0000","last_fullsized":"2024-09-22T03:54:00.011967+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":876,"log_dups_size":0,"ondisk_log_size":876,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57409536,"num_objects":876,"num_object_clones":0,"num_object_copies":2628,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":876,"num_write_kb":56064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:53:08.752323+0000","last_change":"2024-09-22T03:49:17.036954+0000","last_active":"2024-09-22T03:53:08.752323+0000","last_peered":"2024-09-22T03:53:08.752323+0000","last_clean":"2024-09-22T03:53:08.752323+0000","last_became_active":"2024-09-22T03:49:15.110506+0000","last_became_peered":"2024-09-22T03:49:15.110506+0000","last_unstale":"2024-09-22T03:53:08.752323+0000","last_undegraded":"2024-09-22T03:53:08.752323+0000","last_fullsized":"2024-09-22T03:53:08.752323+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"43'899","reported_seq":923,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:53:59.977365+0000","last_change":"2024-09-22T03:52:38.239558+0000","last_active":"2024-09-22T03:53:59.977365+0000","last_peered":"2024-09-22T03:53:59.977365+0000","last_clean":"2024-09-22T03:53:59.977365+0000","last_became_active":"2024-09-22T03:52:38.229931+0000","last_became_peered":"2024-09-22T03:52:38.229931+0000","last_unstale":"2024-09-22T03:53:59.977365+0000","last_undegraded":"2024-09-22T03:53:59.977365+0000","last_fullsized":"2024-09-22T03:53:59.977365+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":899,"log_dups_size":0,"ondisk_log_size":899,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58916864,"num_objects":899,"num_object_clones":0,"num_object_copies":2697,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":899,"num_write_kb":57536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:53:08.738470+0000","last_change":"2024-09-22T03:49:17.032989+0000","last_active":"2024-09-22T03:53:08.738470+0000","last_peered":"2024-09-22T03:53:08.738470+0000","last_clean":"2024-09-22T03:53:08.738470+0000","last_became_active":"2024-09-22T03:49:15.079260+0000","last_became_peered":"2024-09-22T03:49:15.079260+0000","last_unstale":"2024-09-22T03:53:08.738470+0000","last_undegraded":"2024-09-22T03:53:08.738470+0000","last_fullsized":"2024-09-22T03:53:08.738470+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"43'894","reported_seq":918,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:53:59.825100+0000","last_change":"2024-09-22T03:52:38.258650+0000","last_active":"2024-09-22T03:53:59.825100+0000","last_peered":"2024-09-22T03:53:59.825100+0000","last_clean":"2024-09-22T03:53:59.825100+0000","last_became_active":"2024-09-22T03:52:38.238553+0000","last_became_peered":"2024-09-22T03:52:38.238553+0000","last_unstale":"2024-09-22T03:53:59.825100+0000","last_undegraded":"2024-09-22T03:53:59.825100+0000","last_fullsized":"2024-09-22T03:53:59.825100+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":894,"log_dups_size":0,"ondisk_log_size":894,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58589184,"num_objects":894,"num_object_clones":0,"num_object_copies":2682,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":894,"num_write_kb":57216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:53:08.749614+0000","last_change":"2024-09-22T03:49:17.036402+0000","last_active":"2024-09-22T03:53:08.749614+0000","last_peered":"2024-09-22T03:53:08.749614+0000","last_clean":"2024-09-22T03:53:08.749614+0000","last_became_active":"2024-09-22T03:49:15.108430+0000","last_became_peered":"2024-09-22T03:49:15.108430+0000","last_unstale":"2024-09-22T03:53:08.749614+0000","last_undegraded":"2024-09-22T03:53:08.749614+0000","last_fullsized":"2024-09-22T03:53:08.749614+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"43'865","reported_seq":889,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:53:59.592148+0000","last_change":"2024-09-22T03:52:38.208326+0000","last_active":"2024-09-22T03:53:59.592148+0000","last_peered":"2024-09-22T03:53:59.592148+0000","last_clean":"2024-09-22T03:53:59.592148+0000","last_became_active":"2024-09-22T03:52:38.200509+0000","last_became_peered":"2024-09-22T03:52:38.200509+0000","last_unstale":"2024-09-22T03:53:59.592148+0000","last_undegraded":"2024-09-22T03:53:59.592148+0000","last_fullsized":"2024-09-22T03:53:59.592148+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":865,"log_dups_size":0,"ondisk_log_size":865,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56688640,"num_objects":865,"num_object_clones":0,"num_object_copies":2595,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":865,"num_write_kb":55360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:53:08.752300+0000","last_change":"2024-09-22T03:49:17.029128+0000","last_active":"2024-09-22T03:53:08.752300+0000","last_peered":"2024-09-22T03:53:08.752300+0000","last_clean":"2024-09-22T03:53:08.752300+0000","last_became_active":"2024-09-22T03:49:15.113396+0000","last_became_peered":"2024-09-22T03:49:15.113396+0000","last_unstale":"2024-09-22T03:53:08.752300+0000","last_undegraded":"2024-09-22T03:53:08.752300+0000","last_fullsized":"2024-09-22T03:53:08.752300+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":925564928,"num_objects":14123,"num_object_clones":0,"num_object_copies":42369,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14123,"num_write_kb":903872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":173490176,"data_stored":2775842816,"data_compressed":131808539,"data_compressed_allocated":173490176,"data_compressed_original":2775842816,"omap_allocated":0,"internal_metadata":0},"log_size":14123,"ondisk_log_size":14123,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949673249,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":114780,"kb_used_data":39372,"kb_used_omap":0,"kb_used_meta":75392,"kb_avail":94257060,"statfs":{"total":96636764160,"available":96519229440,"internally_reserved":0,"allocated":40316928,"data_stored":638972512,"data_compressed":30337053,"data_compressed_allocated":39931904,"data_compressed_original":638828544,"omap_allocated":0,"internal_metadata":77201408},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654705953,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":124656,"kb_used_data":49248,"kb_used_omap":0,"kb_used_meta":75392,"kb_avail":94247184,"statfs":{"total":96636764160,"available":96509116416,"internally_reserved":0,"allocated":50429952,"data_stored":801173568,"data_compressed":38036999,"data_compressed_allocated":50065408,"data_compressed_original":801046528,"omap_allocated":0,"internal_metadata":77201408},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705953,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":110756,"kb_used_data":49236,"kb_used_omap":0,"kb_used_meta":61504,"kb_avail":94261084,"statfs":{"total":96636764160,"available":96523350016,"internally_reserved":0,"allocated":50417664,"data_stored":800584288,"data_compressed":38011033,"data_compressed_allocated":50032640,"data_compressed_original":800440320,"omap_allocated":0,"internal_metadata":62980096},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705953,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":81352,"kb_used_data":32312,"kb_used_omap":0,"kb_used_meta":49024,"kb_avail":94290488,"statfs":{"total":96636764160,"available":96553459712,"internally_reserved":0,"allocated":33087488,"data_stored":523366989,"data_compressed":24847654,"data_compressed_allocated":32706560,"data_compressed_original":523223040,"omap_allocated":0,"internal_metadata":50200576},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32817152,"data_stored":525074432,"data_compressed":24932742,"data_compressed_allocated":32817152,"data_compressed_original":525074432,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40099840,"data_stored":641597440,"data_compressed":30465709,"data_compressed_allocated":40099840,"data_compressed_original":641597440,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":50229248,"data_stored":803667968,"data_compressed":38161473,"data_compressed_allocated":50229248,"data_compressed_original":803667968,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":50343936,"data_stored":805502976,"data_compressed":38248615,"data_compressed_allocated":50343936,"data_compressed_original":805502976,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:54:05.175 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 86 16 14915 14899 10.8268 9.9375 0.133963 0.0922925 2024-09-22T03:54:06.175 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 87 16 15077 15061 10.8187 10.125 0.0788684 0.0923453 2024-09-22T03:54:07.166 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:54:07.175 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 88 16 15224 15208 10.8002 9.1875 0.113769 0.0925192 2024-09-22T03:54:07.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:54:07.309+0000 7f60ec791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:54:07.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:54:07.317+0000 7f60ec791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:54:08.175 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 89 16 15381 15365 10.789 9.8125 0.104031 0.0926327 2024-09-22T03:54:09.175 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 90 15 15542 15527 10.7817 10.125 0.114844 0.0926717 2024-09-22T03:54:09.960 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:54:09.960 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:54:09.960 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:54:09.960 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:54:09.986 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:54:10.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:54:10.088+0000 7f9c66f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:54:10.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:54:10.100+0000 7f9c66f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:54:10.117 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:54:10.118 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:54:10.118 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:54:10.118 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:54:10.118 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:54:10.118 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:54:10.118 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:54:10.118 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:54:10.118 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:54:10.118 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:54:10.118 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:54:10.118 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:54:10.120 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:54:10.121 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:54:10.121 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:54:10.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:54:10.124+0000 7f86a7c7d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:54:10.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:54:10.131+0000 7f86a7c7d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:54:10.175 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Total time run: 90.0544 2024-09-22T03:54:10.175 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Total writes made: 15542 2024-09-22T03:54:10.175 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Write size: 65536 2024-09-22T03:54:10.176 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Object size: 65536 2024-09-22T03:54:10.176 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Bandwidth (MB/sec): 10.7865 2024-09-22T03:54:10.176 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Stddev Bandwidth: 0.720159 2024-09-22T03:54:10.176 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Max bandwidth (MB/sec): 12.6875 2024-09-22T03:54:10.176 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Min bandwidth (MB/sec): 9.1875 2024-09-22T03:54:10.176 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Average IOPS: 172 2024-09-22T03:54:10.176 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Stddev IOPS: 11.5226 2024-09-22T03:54:10.176 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Max IOPS: 203 2024-09-22T03:54:10.177 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Min IOPS: 147 2024-09-22T03:54:10.177 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Average Latency(s): 0.0926775 2024-09-22T03:54:10.177 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Stddev Latency(s): 0.0348373 2024-09-22T03:54:10.177 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Max latency(s): 0.228666 2024-09-22T03:54:10.177 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Min latency(s): 0.0149423 2024-09-22T03:54:10.203 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Cleaning up (deleting benchmark objects) 2024-09-22T03:54:10.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:54:10.246+0000 7f7660751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:54:10.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:54:10.258+0000 7f7660751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:54:10.292 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:54:10.293 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:54:10.293 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:54:10.293 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:54:10.293 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:54:10.293 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:54:10.293 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:54:10.293 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:54:10.293 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:54:10.293 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:54:10.293 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:54:10.293 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:54:10.296 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:54:10.296 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:54:10.296 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:54:10.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:54:10.491+0000 7f622c511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:54:10.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:54:10.504+0000 7f622c511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:54:10.556 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:54:10.556 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:54:10.556 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:54:10.556 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:54:10.557 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:54:10.557 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:54:10.557 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:54:10.557 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:54:10.557 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:54:10.557 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:54:10.557 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:54:10.557 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:54:10.561 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:54:10.562 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:54:10.562 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:54:10.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:54:10.725+0000 7f6800f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:54:10.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:54:10.740+0000 7f6800f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:54:10.777 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:54:10.777 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:54:10.777 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:54:10.778 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:54:10.778 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:54:10.778 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:54:10.778 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:54:10.778 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:54:10.778 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:54:10.778 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:54:10.778 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:54:10.778 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:54:10.781 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:54:10.781 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:54:12.432 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:54:12.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:54:12.570+0000 7fdf79191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:54:12.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:54:12.579+0000 7fdf79191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:54:15.027 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:54:15.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:54:15.168+0000 7fbd03391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:54:15.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:54:15.176+0000 7fbd03391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:54:15.782 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:54:15.783 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:54:15.783 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:54:15.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:54:15.922+0000 7fe267f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:54:15.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:54:15.933+0000 7fe267f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:54:16.189 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:54:16.189 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-22T03:54:16.206 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":189,"stamp":"2024-09-22T03:54:15.026751+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1015415347,"num_objects":15489,"num_object_clones":0,"num_object_copies":46467,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":15680,"num_write_kb":995796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15654,"ondisk_log_size":15654,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":454792,"kb_used_data":187848,"kb_used_omap":0,"kb_used_meta":266880,"kb_avail":377032568,"statfs":{"total":386547056640,"available":386081349632,"internally_reserved":0,"allocated":192356352,"data_stored":3053700965,"data_compressed":144984803,"data_compressed_allocated":190836736,"data_compressed_original":3053142016,"omap_allocated":0,"internal_metadata":273285120},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":89260032,"num_objects":1362,"num_object_clones":0,"num_object_copies":4086,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1476,"num_write_kb":90816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002691"},"pg_stats":[{"pgid":"4.f","version":"43'982","reported_seq":1006,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:54:11.000644+0000","last_change":"2024-09-22T03:52:38.267363+0000","last_active":"2024-09-22T03:54:11.000644+0000","last_peered":"2024-09-22T03:54:11.000644+0000","last_clean":"2024-09-22T03:54:11.000644+0000","last_became_active":"2024-09-22T03:52:38.261984+0000","last_became_peered":"2024-09-22T03:52:38.261984+0000","last_unstale":"2024-09-22T03:54:11.000644+0000","last_undegraded":"2024-09-22T03:54:11.000644+0000","last_fullsized":"2024-09-22T03:54:11.000644+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":982,"log_dups_size":0,"ondisk_log_size":982,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62783488,"num_objects":958,"num_object_clones":0,"num_object_copies":2874,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":982,"num_write_kb":62080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"43'981","reported_seq":1005,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:54:10.996426+0000","last_change":"2024-09-22T03:52:38.211390+0000","last_active":"2024-09-22T03:54:10.996426+0000","last_peered":"2024-09-22T03:54:10.996426+0000","last_clean":"2024-09-22T03:54:10.996426+0000","last_became_active":"2024-09-22T03:52:38.190969+0000","last_became_peered":"2024-09-22T03:52:38.190969+0000","last_unstale":"2024-09-22T03:54:10.996426+0000","last_undegraded":"2024-09-22T03:54:10.996426+0000","last_fullsized":"2024-09-22T03:54:10.996426+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":981,"log_dups_size":0,"ondisk_log_size":981,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62324736,"num_objects":951,"num_object_clones":0,"num_object_copies":2853,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":981,"num_write_kb":61824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"43'940","reported_seq":964,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:54:09.112319+0000","last_change":"2024-09-22T03:52:38.196399+0000","last_active":"2024-09-22T03:54:09.112319+0000","last_peered":"2024-09-22T03:54:09.112319+0000","last_clean":"2024-09-22T03:54:09.112319+0000","last_became_active":"2024-09-22T03:52:38.183573+0000","last_became_peered":"2024-09-22T03:52:38.183573+0000","last_unstale":"2024-09-22T03:54:09.112319+0000","last_undegraded":"2024-09-22T03:54:09.112319+0000","last_fullsized":"2024-09-22T03:54:09.112319+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":940,"log_dups_size":0,"ondisk_log_size":940,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61603840,"num_objects":940,"num_object_clones":0,"num_object_copies":2820,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":940,"num_write_kb":60160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"43'935","reported_seq":959,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:54:08.783927+0000","last_change":"2024-09-22T03:52:38.241973+0000","last_active":"2024-09-22T03:54:08.783927+0000","last_peered":"2024-09-22T03:54:08.783927+0000","last_clean":"2024-09-22T03:54:08.783927+0000","last_became_active":"2024-09-22T03:52:38.234357+0000","last_became_peered":"2024-09-22T03:52:38.234357+0000","last_unstale":"2024-09-22T03:54:08.783927+0000","last_undegraded":"2024-09-22T03:54:08.783927+0000","last_fullsized":"2024-09-22T03:54:08.783927+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":935,"log_dups_size":0,"ondisk_log_size":935,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61276160,"num_objects":935,"num_object_clones":0,"num_object_copies":2805,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":935,"num_write_kb":59840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"43'934","reported_seq":958,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:54:08.990090+0000","last_change":"2024-09-22T03:52:38.234728+0000","last_active":"2024-09-22T03:54:08.990090+0000","last_peered":"2024-09-22T03:54:08.990090+0000","last_clean":"2024-09-22T03:54:08.990090+0000","last_became_active":"2024-09-22T03:52:38.221861+0000","last_became_peered":"2024-09-22T03:52:38.221861+0000","last_unstale":"2024-09-22T03:54:08.990090+0000","last_undegraded":"2024-09-22T03:54:08.990090+0000","last_fullsized":"2024-09-22T03:54:08.990090+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":934,"log_dups_size":0,"ondisk_log_size":934,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61210624,"num_objects":934,"num_object_clones":0,"num_object_copies":2802,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":934,"num_write_kb":59776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"43'990","reported_seq":1014,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:54:08.853277+0000","last_change":"2024-09-22T03:52:38.235904+0000","last_active":"2024-09-22T03:54:08.853277+0000","last_peered":"2024-09-22T03:54:08.853277+0000","last_clean":"2024-09-22T03:54:08.853277+0000","last_became_active":"2024-09-22T03:52:38.225232+0000","last_became_peered":"2024-09-22T03:52:38.225232+0000","last_unstale":"2024-09-22T03:54:08.853277+0000","last_undegraded":"2024-09-22T03:54:08.853277+0000","last_fullsized":"2024-09-22T03:54:08.853277+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":990,"log_dups_size":0,"ondisk_log_size":990,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64880640,"num_objects":990,"num_object_clones":0,"num_object_copies":2970,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":990,"num_write_kb":63360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"43'1000","reported_seq":1024,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:54:08.931257+0000","last_change":"2024-09-22T03:52:38.200669+0000","last_active":"2024-09-22T03:54:08.931257+0000","last_peered":"2024-09-22T03:54:08.931257+0000","last_clean":"2024-09-22T03:54:08.931257+0000","last_became_active":"2024-09-22T03:52:38.190269+0000","last_became_peered":"2024-09-22T03:52:38.190269+0000","last_unstale":"2024-09-22T03:54:08.931257+0000","last_undegraded":"2024-09-22T03:54:08.931257+0000","last_fullsized":"2024-09-22T03:54:08.931257+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1000,"log_dups_size":0,"ondisk_log_size":1000,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65536000,"num_objects":1000,"num_object_clones":0,"num_object_copies":3000,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1000,"num_write_kb":64000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"43'987","reported_seq":1011,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:54:09.099650+0000","last_change":"2024-09-22T03:52:38.177831+0000","last_active":"2024-09-22T03:54:09.099650+0000","last_peered":"2024-09-22T03:54:09.099650+0000","last_clean":"2024-09-22T03:54:09.099650+0000","last_became_active":"2024-09-22T03:52:38.169555+0000","last_became_peered":"2024-09-22T03:52:38.169555+0000","last_unstale":"2024-09-22T03:54:09.099650+0000","last_undegraded":"2024-09-22T03:54:09.099650+0000","last_fullsized":"2024-09-22T03:54:09.099650+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":987,"log_dups_size":0,"ondisk_log_size":987,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64684032,"num_objects":987,"num_object_clones":0,"num_object_copies":2961,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":987,"num_write_kb":63168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"43'962","reported_seq":986,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:54:08.869200+0000","last_change":"2024-09-22T03:52:38.267240+0000","last_active":"2024-09-22T03:54:08.869200+0000","last_peered":"2024-09-22T03:54:08.869200+0000","last_clean":"2024-09-22T03:54:08.869200+0000","last_became_active":"2024-09-22T03:52:38.252880+0000","last_became_peered":"2024-09-22T03:52:38.252880+0000","last_unstale":"2024-09-22T03:54:08.869200+0000","last_undegraded":"2024-09-22T03:54:08.869200+0000","last_fullsized":"2024-09-22T03:54:08.869200+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":962,"log_dups_size":0,"ondisk_log_size":962,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63045632,"num_objects":962,"num_object_clones":0,"num_object_copies":2886,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":962,"num_write_kb":61568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":172,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:53:08.738004+0000","last_change":"2024-09-22T03:49:12.034704+0000","last_active":"2024-09-22T03:53:08.738004+0000","last_peered":"2024-09-22T03:53:08.738004+0000","last_clean":"2024-09-22T03:53:08.738004+0000","last_became_active":"2024-09-22T03:49:12.027470+0000","last_became_peered":"2024-09-22T03:49:12.027470+0000","last_unstale":"2024-09-22T03:53:08.738004+0000","last_undegraded":"2024-09-22T03:53:08.738004+0000","last_fullsized":"2024-09-22T03:53:08.738004+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_clean_scrub_stamp":"2024-09-22T03:49:10.979949+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":98,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:53:08.753153+0000","last_change":"2024-09-22T03:49:17.031458+0000","last_active":"2024-09-22T03:53:08.753153+0000","last_peered":"2024-09-22T03:53:08.753153+0000","last_clean":"2024-09-22T03:53:08.753153+0000","last_became_active":"2024-09-22T03:49:15.125490+0000","last_became_peered":"2024-09-22T03:49:15.125490+0000","last_unstale":"2024-09-22T03:53:08.753153+0000","last_undegraded":"2024-09-22T03:53:08.753153+0000","last_fullsized":"2024-09-22T03:53:08.753153+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"43'941","reported_seq":965,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:54:09.158770+0000","last_change":"2024-09-22T03:52:38.263115+0000","last_active":"2024-09-22T03:54:09.158770+0000","last_peered":"2024-09-22T03:54:09.158770+0000","last_clean":"2024-09-22T03:54:09.158770+0000","last_became_active":"2024-09-22T03:52:38.245622+0000","last_became_peered":"2024-09-22T03:52:38.245622+0000","last_unstale":"2024-09-22T03:54:09.158770+0000","last_undegraded":"2024-09-22T03:54:09.158770+0000","last_fullsized":"2024-09-22T03:54:09.158770+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":941,"log_dups_size":0,"ondisk_log_size":941,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61669376,"num_objects":941,"num_object_clones":0,"num_object_copies":2823,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":941,"num_write_kb":60224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:53:08.749573+0000","last_change":"2024-09-22T03:49:17.029339+0000","last_active":"2024-09-22T03:53:08.749573+0000","last_peered":"2024-09-22T03:53:08.749573+0000","last_clean":"2024-09-22T03:53:08.749573+0000","last_became_active":"2024-09-22T03:49:15.097304+0000","last_became_peered":"2024-09-22T03:49:15.097304+0000","last_unstale":"2024-09-22T03:53:08.749573+0000","last_undegraded":"2024-09-22T03:53:08.749573+0000","last_fullsized":"2024-09-22T03:53:08.749573+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"43'1026","reported_seq":1050,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:54:10.990423+0000","last_change":"2024-09-22T03:52:38.234061+0000","last_active":"2024-09-22T03:54:10.990423+0000","last_peered":"2024-09-22T03:54:10.990423+0000","last_clean":"2024-09-22T03:54:10.990423+0000","last_became_active":"2024-09-22T03:52:38.222894+0000","last_became_peered":"2024-09-22T03:52:38.222894+0000","last_unstale":"2024-09-22T03:54:10.990423+0000","last_undegraded":"2024-09-22T03:54:10.990423+0000","last_fullsized":"2024-09-22T03:54:10.990423+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1026,"log_dups_size":0,"ondisk_log_size":1026,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64880640,"num_objects":990,"num_object_clones":0,"num_object_copies":2970,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1026,"num_write_kb":64512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:53:08.765557+0000","last_change":"2024-09-22T03:49:17.029349+0000","last_active":"2024-09-22T03:53:08.765557+0000","last_peered":"2024-09-22T03:53:08.765557+0000","last_clean":"2024-09-22T03:53:08.765557+0000","last_became_active":"2024-09-22T03:49:15.094890+0000","last_became_peered":"2024-09-22T03:49:15.094890+0000","last_unstale":"2024-09-22T03:53:08.765557+0000","last_undegraded":"2024-09-22T03:53:08.765557+0000","last_fullsized":"2024-09-22T03:53:08.765557+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"43'1044","reported_seq":1068,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:54:11.001348+0000","last_change":"2024-09-22T03:52:38.248145+0000","last_active":"2024-09-22T03:54:11.001348+0000","last_peered":"2024-09-22T03:54:11.001348+0000","last_clean":"2024-09-22T03:54:11.001348+0000","last_became_active":"2024-09-22T03:52:38.241420+0000","last_became_peered":"2024-09-22T03:52:38.241420+0000","last_unstale":"2024-09-22T03:54:11.001348+0000","last_undegraded":"2024-09-22T03:54:11.001348+0000","last_fullsized":"2024-09-22T03:54:11.001348+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1044,"log_dups_size":0,"ondisk_log_size":1044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66846720,"num_objects":1020,"num_object_clones":0,"num_object_copies":3060,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1044,"num_write_kb":66048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":99,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:53:08.758873+0000","last_change":"2024-09-22T03:49:17.031466+0000","last_active":"2024-09-22T03:53:08.758873+0000","last_peered":"2024-09-22T03:53:08.758873+0000","last_clean":"2024-09-22T03:53:08.758873+0000","last_became_active":"2024-09-22T03:49:15.098420+0000","last_became_peered":"2024-09-22T03:49:15.098420+0000","last_unstale":"2024-09-22T03:53:08.758873+0000","last_undegraded":"2024-09-22T03:53:08.758873+0000","last_fullsized":"2024-09-22T03:53:08.758873+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2","version":"43'960","reported_seq":984,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:54:08.632448+0000","last_change":"2024-09-22T03:52:38.215825+0000","last_active":"2024-09-22T03:54:08.632448+0000","last_peered":"2024-09-22T03:54:08.632448+0000","last_clean":"2024-09-22T03:54:08.632448+0000","last_became_active":"2024-09-22T03:52:38.203741+0000","last_became_peered":"2024-09-22T03:52:38.203741+0000","last_unstale":"2024-09-22T03:54:08.632448+0000","last_undegraded":"2024-09-22T03:54:08.632448+0000","last_fullsized":"2024-09-22T03:54:08.632448+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":960,"log_dups_size":0,"ondisk_log_size":960,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62914560,"num_objects":960,"num_object_clones":0,"num_object_copies":2880,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":960,"num_write_kb":61440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:53:08.752323+0000","last_change":"2024-09-22T03:49:17.036954+0000","last_active":"2024-09-22T03:53:08.752323+0000","last_peered":"2024-09-22T03:53:08.752323+0000","last_clean":"2024-09-22T03:53:08.752323+0000","last_became_active":"2024-09-22T03:49:15.110506+0000","last_became_peered":"2024-09-22T03:49:15.110506+0000","last_unstale":"2024-09-22T03:53:08.752323+0000","last_undegraded":"2024-09-22T03:53:08.752323+0000","last_fullsized":"2024-09-22T03:53:08.752323+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"43'989","reported_seq":1013,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:54:09.086985+0000","last_change":"2024-09-22T03:52:38.239558+0000","last_active":"2024-09-22T03:54:09.086985+0000","last_peered":"2024-09-22T03:54:09.086985+0000","last_clean":"2024-09-22T03:54:09.086985+0000","last_became_active":"2024-09-22T03:52:38.229931+0000","last_became_peered":"2024-09-22T03:52:38.229931+0000","last_unstale":"2024-09-22T03:54:09.086985+0000","last_undegraded":"2024-09-22T03:54:09.086985+0000","last_fullsized":"2024-09-22T03:54:09.086985+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":989,"log_dups_size":0,"ondisk_log_size":989,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64815104,"num_objects":989,"num_object_clones":0,"num_object_copies":2967,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":989,"num_write_kb":63296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:53:08.738470+0000","last_change":"2024-09-22T03:49:17.032989+0000","last_active":"2024-09-22T03:53:08.738470+0000","last_peered":"2024-09-22T03:53:08.738470+0000","last_clean":"2024-09-22T03:53:08.738470+0000","last_became_active":"2024-09-22T03:49:15.079260+0000","last_became_peered":"2024-09-22T03:49:15.079260+0000","last_unstale":"2024-09-22T03:53:08.738470+0000","last_undegraded":"2024-09-22T03:53:08.738470+0000","last_fullsized":"2024-09-22T03:53:08.738470+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"43'983","reported_seq":1007,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:54:09.078358+0000","last_change":"2024-09-22T03:52:38.258650+0000","last_active":"2024-09-22T03:54:09.078358+0000","last_peered":"2024-09-22T03:54:09.078358+0000","last_clean":"2024-09-22T03:54:09.078358+0000","last_became_active":"2024-09-22T03:52:38.238553+0000","last_became_peered":"2024-09-22T03:52:38.238553+0000","last_unstale":"2024-09-22T03:54:09.078358+0000","last_undegraded":"2024-09-22T03:54:09.078358+0000","last_fullsized":"2024-09-22T03:54:09.078358+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":983,"log_dups_size":0,"ondisk_log_size":983,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64421888,"num_objects":983,"num_object_clones":0,"num_object_copies":2949,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":983,"num_write_kb":62912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:53:08.749614+0000","last_change":"2024-09-22T03:49:17.036402+0000","last_active":"2024-09-22T03:53:08.749614+0000","last_peered":"2024-09-22T03:53:08.749614+0000","last_clean":"2024-09-22T03:53:08.749614+0000","last_became_active":"2024-09-22T03:49:15.108430+0000","last_became_peered":"2024-09-22T03:49:15.108430+0000","last_unstale":"2024-09-22T03:53:08.749614+0000","last_undegraded":"2024-09-22T03:53:08.749614+0000","last_fullsized":"2024-09-22T03:53:08.749614+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"43'945","reported_seq":969,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:54:08.936523+0000","last_change":"2024-09-22T03:52:38.208326+0000","last_active":"2024-09-22T03:54:08.936523+0000","last_peered":"2024-09-22T03:54:08.936523+0000","last_clean":"2024-09-22T03:54:08.936523+0000","last_became_active":"2024-09-22T03:52:38.200509+0000","last_became_peered":"2024-09-22T03:52:38.200509+0000","last_unstale":"2024-09-22T03:54:08.936523+0000","last_undegraded":"2024-09-22T03:54:08.936523+0000","last_fullsized":"2024-09-22T03:54:08.936523+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":945,"log_dups_size":0,"ondisk_log_size":945,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61931520,"num_objects":945,"num_object_clones":0,"num_object_copies":2835,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":945,"num_write_kb":60480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:53:08.752300+0000","last_change":"2024-09-22T03:49:17.029128+0000","last_active":"2024-09-22T03:53:08.752300+0000","last_peered":"2024-09-22T03:53:08.752300+0000","last_clean":"2024-09-22T03:53:08.752300+0000","last_became_active":"2024-09-22T03:49:15.113396+0000","last_became_peered":"2024-09-22T03:49:15.113396+0000","last_unstale":"2024-09-22T03:53:08.752300+0000","last_undegraded":"2024-09-22T03:53:08.752300+0000","last_fullsized":"2024-09-22T03:53:08.752300+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":1014824960,"num_objects":15485,"num_object_clones":0,"num_object_copies":46455,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15599,"num_write_kb":994688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":190443520,"data_stored":3047030808,"data_compressed":144686206,"data_compressed_allocated":190439424,"data_compressed_original":3047030784,"omap_allocated":0,"internal_metadata":0},"log_size":15599,"ondisk_log_size":15599,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949673259,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":122428,"kb_used_data":42860,"kb_used_omap":0,"kb_used_meta":79552,"kb_avail":94249412,"statfs":{"total":96636764160,"available":96511397888,"internally_reserved":0,"allocated":43888640,"data_stored":696054392,"data_compressed":33047741,"data_compressed_allocated":43499520,"data_compressed_original":695910400,"omap_allocated":0,"internal_metadata":81461248},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654705963,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":121800,"kb_used_data":54712,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94250040,"statfs":{"total":96636764160,"available":96512040960,"internally_reserved":0,"allocated":56025088,"data_stored":890695744,"data_compressed":42287991,"data_compressed_allocated":55660544,"data_compressed_original":890568704,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705963,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":103656,"kb_used_data":54616,"kb_used_omap":0,"kb_used_meta":49024,"kb_avail":94268184,"statfs":{"total":96636764160,"available":96530620416,"internally_reserved":0,"allocated":55926784,"data_stored":888730208,"data_compressed":42196673,"data_compressed_allocated":55541760,"data_compressed_original":888586240,"omap_allocated":0,"internal_metadata":50200576},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705963,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":106908,"kb_used_data":35660,"kb_used_omap":0,"kb_used_meta":71232,"kb_avail":94264932,"statfs":{"total":96636764160,"available":96527290368,"internally_reserved":0,"allocated":36515840,"data_stored":578220621,"data_compressed":27452398,"data_compressed_allocated":36134912,"data_compressed_original":578076672,"omap_allocated":0,"internal_metadata":72941568},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36093952,"data_stored":577503232,"data_compressed":27422342,"data_compressed_allocated":36093952,"data_compressed_original":577503232,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":43188224,"data_stored":690946072,"data_compressed":32809256,"data_compressed_allocated":43184128,"data_compressed_original":690946048,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55500800,"data_stored":888012800,"data_compressed":42166617,"data_compressed_allocated":55500800,"data_compressed_original":888012800,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":55660544,"data_stored":890568704,"data_compressed":42287991,"data_compressed_allocated":55660544,"data_compressed_original":890568704,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:54:17.723 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:54:17.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:54:17.862+0000 7f0d4f791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:54:17.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:54:17.871+0000 7f0d4f791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:54:20.289 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:54:20.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:54:20.425+0000 7fe29c074640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:54:20.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:54:20.437+0000 7fe29c074640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:54:21.208 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:54:21.209 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:54:21.209 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:54:21.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:54:21.381+0000 7f4ef7ec8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:54:21.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:54:21.393+0000 7f4ef7ec8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:54:21.733 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:54:21.734 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-22T03:54:21.751 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":192,"stamp":"2024-09-22T03:54:21.028036+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":907936331,"num_objects":13850,"num_object_clones":0,"num_object_copies":41550,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":17321,"num_write_kb":995797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17295,"ondisk_log_size":17295,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":449624,"kb_used_data":168792,"kb_used_omap":0,"kb_used_meta":280768,"kb_avail":377037736,"statfs":{"total":386547056640,"available":386086641664,"internally_reserved":0,"allocated":172843008,"data_stored":2741356437,"data_compressed":130156205,"data_compressed_allocated":171315200,"data_compressed_original":2740797440,"omap_allocated":0,"internal_metadata":287506432},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-71434216,"num_objects":-1089,"num_object_clones":0,"num_object_copies":-3267,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2305,"num_write_kb":38849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002653"},"pg_stats":[{"pgid":"4.f","version":"43'1061","reported_seq":1085,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:54:15.993200+0000","last_change":"2024-09-22T03:52:38.267363+0000","last_active":"2024-09-22T03:54:15.993200+0000","last_peered":"2024-09-22T03:54:15.993200+0000","last_clean":"2024-09-22T03:54:15.993200+0000","last_became_active":"2024-09-22T03:52:38.261984+0000","last_became_peered":"2024-09-22T03:52:38.261984+0000","last_unstale":"2024-09-22T03:54:15.993200+0000","last_undegraded":"2024-09-22T03:54:15.993200+0000","last_fullsized":"2024-09-22T03:54:15.993200+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1061,"log_dups_size":0,"ondisk_log_size":1061,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57606144,"num_objects":879,"num_object_clones":0,"num_object_copies":2637,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1061,"num_write_kb":62080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"43'1046","reported_seq":1070,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:54:16.040289+0000","last_change":"2024-09-22T03:52:38.211390+0000","last_active":"2024-09-22T03:54:16.040289+0000","last_peered":"2024-09-22T03:54:16.040289+0000","last_clean":"2024-09-22T03:54:16.040289+0000","last_became_active":"2024-09-22T03:52:38.190969+0000","last_became_peered":"2024-09-22T03:52:38.190969+0000","last_unstale":"2024-09-22T03:54:16.040289+0000","last_undegraded":"2024-09-22T03:54:16.040289+0000","last_fullsized":"2024-09-22T03:54:16.040289+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1046,"log_dups_size":0,"ondisk_log_size":1046,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58064896,"num_objects":886,"num_object_clones":0,"num_object_copies":2658,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1046,"num_write_kb":61824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"43'1050","reported_seq":1075,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:54:19.903005+0000","last_change":"2024-09-22T03:52:38.196399+0000","last_active":"2024-09-22T03:54:19.903005+0000","last_peered":"2024-09-22T03:54:19.903005+0000","last_clean":"2024-09-22T03:54:19.903005+0000","last_became_active":"2024-09-22T03:52:38.183573+0000","last_became_peered":"2024-09-22T03:52:38.183573+0000","last_unstale":"2024-09-22T03:54:19.903005+0000","last_undegraded":"2024-09-22T03:54:19.903005+0000","last_fullsized":"2024-09-22T03:54:19.903005+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1050,"log_dups_size":0,"ondisk_log_size":1050,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54460440,"num_objects":832,"num_object_clones":0,"num_object_copies":2496,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1050,"num_write_kb":60161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"43'1034","reported_seq":1058,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:54:19.947179+0000","last_change":"2024-09-22T03:52:38.241973+0000","last_active":"2024-09-22T03:54:19.947179+0000","last_peered":"2024-09-22T03:54:19.947179+0000","last_clean":"2024-09-22T03:54:19.947179+0000","last_became_active":"2024-09-22T03:52:38.234357+0000","last_became_peered":"2024-09-22T03:52:38.234357+0000","last_unstale":"2024-09-22T03:54:19.947179+0000","last_undegraded":"2024-09-22T03:54:19.947179+0000","last_fullsized":"2024-09-22T03:54:19.947179+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1034,"log_dups_size":0,"ondisk_log_size":1034,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54788096,"num_objects":836,"num_object_clones":0,"num_object_copies":2508,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1034,"num_write_kb":59840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"43'1063","reported_seq":1087,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:54:20.014639+0000","last_change":"2024-09-22T03:52:38.234728+0000","last_active":"2024-09-22T03:54:20.014639+0000","last_peered":"2024-09-22T03:54:20.014639+0000","last_clean":"2024-09-22T03:54:20.014639+0000","last_became_active":"2024-09-22T03:52:38.221861+0000","last_became_peered":"2024-09-22T03:52:38.221861+0000","last_unstale":"2024-09-22T03:54:20.014639+0000","last_undegraded":"2024-09-22T03:54:20.014639+0000","last_fullsized":"2024-09-22T03:54:20.014639+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1063,"log_dups_size":0,"ondisk_log_size":1063,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52756480,"num_objects":805,"num_object_clones":0,"num_object_copies":2415,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1063,"num_write_kb":59776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"43'1124","reported_seq":1148,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:54:19.820957+0000","last_change":"2024-09-22T03:52:38.235904+0000","last_active":"2024-09-22T03:54:19.820957+0000","last_peered":"2024-09-22T03:54:19.820957+0000","last_clean":"2024-09-22T03:54:19.820957+0000","last_became_active":"2024-09-22T03:52:38.225232+0000","last_became_peered":"2024-09-22T03:52:38.225232+0000","last_unstale":"2024-09-22T03:54:19.820957+0000","last_undegraded":"2024-09-22T03:54:19.820957+0000","last_fullsized":"2024-09-22T03:54:19.820957+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1124,"log_dups_size":0,"ondisk_log_size":1124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56098816,"num_objects":856,"num_object_clones":0,"num_object_copies":2568,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1124,"num_write_kb":63360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"43'1119","reported_seq":1143,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:54:19.976719+0000","last_change":"2024-09-22T03:52:38.200669+0000","last_active":"2024-09-22T03:54:19.976719+0000","last_peered":"2024-09-22T03:54:19.976719+0000","last_clean":"2024-09-22T03:54:19.976719+0000","last_became_active":"2024-09-22T03:52:38.190269+0000","last_became_peered":"2024-09-22T03:52:38.190269+0000","last_unstale":"2024-09-22T03:54:19.976719+0000","last_undegraded":"2024-09-22T03:54:19.976719+0000","last_fullsized":"2024-09-22T03:54:19.976719+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1119,"log_dups_size":0,"ondisk_log_size":1119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57737216,"num_objects":881,"num_object_clones":0,"num_object_copies":2643,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1119,"num_write_kb":64000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"43'1095","reported_seq":1119,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:54:19.758974+0000","last_change":"2024-09-22T03:52:38.177831+0000","last_active":"2024-09-22T03:54:19.758974+0000","last_peered":"2024-09-22T03:54:19.758974+0000","last_clean":"2024-09-22T03:54:19.758974+0000","last_became_active":"2024-09-22T03:52:38.169555+0000","last_became_peered":"2024-09-22T03:52:38.169555+0000","last_unstale":"2024-09-22T03:54:19.758974+0000","last_undegraded":"2024-09-22T03:54:19.758974+0000","last_fullsized":"2024-09-22T03:54:19.758974+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1095,"log_dups_size":0,"ondisk_log_size":1095,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57606144,"num_objects":879,"num_object_clones":0,"num_object_copies":2637,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1095,"num_write_kb":63168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"43'1079","reported_seq":1103,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:54:19.939728+0000","last_change":"2024-09-22T03:52:38.267240+0000","last_active":"2024-09-22T03:54:19.939728+0000","last_peered":"2024-09-22T03:54:19.939728+0000","last_clean":"2024-09-22T03:54:19.939728+0000","last_became_active":"2024-09-22T03:52:38.252880+0000","last_became_peered":"2024-09-22T03:52:38.252880+0000","last_unstale":"2024-09-22T03:54:19.939728+0000","last_undegraded":"2024-09-22T03:54:19.939728+0000","last_fullsized":"2024-09-22T03:54:19.939728+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1079,"log_dups_size":0,"ondisk_log_size":1079,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55377920,"num_objects":845,"num_object_clones":0,"num_object_copies":2535,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1079,"num_write_kb":61568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":172,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:53:08.738004+0000","last_change":"2024-09-22T03:49:12.034704+0000","last_active":"2024-09-22T03:53:08.738004+0000","last_peered":"2024-09-22T03:53:08.738004+0000","last_clean":"2024-09-22T03:53:08.738004+0000","last_became_active":"2024-09-22T03:49:12.027470+0000","last_became_peered":"2024-09-22T03:49:12.027470+0000","last_unstale":"2024-09-22T03:53:08.738004+0000","last_undegraded":"2024-09-22T03:53:08.738004+0000","last_fullsized":"2024-09-22T03:53:08.738004+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_clean_scrub_stamp":"2024-09-22T03:49:10.979949+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":98,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:53:08.753153+0000","last_change":"2024-09-22T03:49:17.031458+0000","last_active":"2024-09-22T03:53:08.753153+0000","last_peered":"2024-09-22T03:53:08.753153+0000","last_clean":"2024-09-22T03:53:08.753153+0000","last_became_active":"2024-09-22T03:49:15.125490+0000","last_became_peered":"2024-09-22T03:49:15.125490+0000","last_unstale":"2024-09-22T03:53:08.753153+0000","last_undegraded":"2024-09-22T03:53:08.753153+0000","last_fullsized":"2024-09-22T03:53:08.753153+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"43'1041","reported_seq":1065,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:54:19.826809+0000","last_change":"2024-09-22T03:52:38.263115+0000","last_active":"2024-09-22T03:54:19.826809+0000","last_peered":"2024-09-22T03:54:19.826809+0000","last_clean":"2024-09-22T03:54:19.826809+0000","last_became_active":"2024-09-22T03:52:38.245622+0000","last_became_peered":"2024-09-22T03:52:38.245622+0000","last_unstale":"2024-09-22T03:54:19.826809+0000","last_undegraded":"2024-09-22T03:54:19.826809+0000","last_fullsized":"2024-09-22T03:54:19.826809+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1041,"log_dups_size":0,"ondisk_log_size":1041,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55115776,"num_objects":841,"num_object_clones":0,"num_object_copies":2523,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1041,"num_write_kb":60224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:53:08.749573+0000","last_change":"2024-09-22T03:49:17.029339+0000","last_active":"2024-09-22T03:53:08.749573+0000","last_peered":"2024-09-22T03:53:08.749573+0000","last_clean":"2024-09-22T03:53:08.749573+0000","last_became_active":"2024-09-22T03:49:15.097304+0000","last_became_peered":"2024-09-22T03:49:15.097304+0000","last_unstale":"2024-09-22T03:53:08.749573+0000","last_undegraded":"2024-09-22T03:53:08.749573+0000","last_fullsized":"2024-09-22T03:53:08.749573+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"43'1083","reported_seq":1107,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:54:16.132445+0000","last_change":"2024-09-22T03:52:38.234061+0000","last_active":"2024-09-22T03:54:16.132445+0000","last_peered":"2024-09-22T03:54:16.132445+0000","last_clean":"2024-09-22T03:54:16.132445+0000","last_became_active":"2024-09-22T03:52:38.222894+0000","last_became_peered":"2024-09-22T03:52:38.222894+0000","last_unstale":"2024-09-22T03:54:16.132445+0000","last_undegraded":"2024-09-22T03:54:16.132445+0000","last_fullsized":"2024-09-22T03:54:16.132445+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1083,"log_dups_size":0,"ondisk_log_size":1083,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61145088,"num_objects":933,"num_object_clones":0,"num_object_copies":2799,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1083,"num_write_kb":64512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:53:08.765557+0000","last_change":"2024-09-22T03:49:17.029349+0000","last_active":"2024-09-22T03:53:08.765557+0000","last_peered":"2024-09-22T03:53:08.765557+0000","last_clean":"2024-09-22T03:53:08.765557+0000","last_became_active":"2024-09-22T03:49:15.094890+0000","last_became_peered":"2024-09-22T03:49:15.094890+0000","last_unstale":"2024-09-22T03:53:08.765557+0000","last_undegraded":"2024-09-22T03:53:08.765557+0000","last_fullsized":"2024-09-22T03:53:08.765557+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"43'1104","reported_seq":1128,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:54:15.993193+0000","last_change":"2024-09-22T03:52:38.248145+0000","last_active":"2024-09-22T03:54:15.993193+0000","last_peered":"2024-09-22T03:54:15.993193+0000","last_clean":"2024-09-22T03:54:15.993193+0000","last_became_active":"2024-09-22T03:52:38.241420+0000","last_became_peered":"2024-09-22T03:52:38.241420+0000","last_unstale":"2024-09-22T03:54:15.993193+0000","last_undegraded":"2024-09-22T03:54:15.993193+0000","last_fullsized":"2024-09-22T03:54:15.993193+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1104,"log_dups_size":0,"ondisk_log_size":1104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62914560,"num_objects":960,"num_object_clones":0,"num_object_copies":2880,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1104,"num_write_kb":66048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":99,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:53:08.758873+0000","last_change":"2024-09-22T03:49:17.031466+0000","last_active":"2024-09-22T03:53:08.758873+0000","last_peered":"2024-09-22T03:53:08.758873+0000","last_clean":"2024-09-22T03:53:08.758873+0000","last_became_active":"2024-09-22T03:49:15.098420+0000","last_became_peered":"2024-09-22T03:49:15.098420+0000","last_unstale":"2024-09-22T03:53:08.758873+0000","last_undegraded":"2024-09-22T03:53:08.758873+0000","last_fullsized":"2024-09-22T03:53:08.758873+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2","version":"43'1068","reported_seq":1092,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:54:19.951855+0000","last_change":"2024-09-22T03:52:38.215825+0000","last_active":"2024-09-22T03:54:19.951855+0000","last_peered":"2024-09-22T03:54:19.951855+0000","last_clean":"2024-09-22T03:54:19.951855+0000","last_became_active":"2024-09-22T03:52:38.203741+0000","last_became_peered":"2024-09-22T03:52:38.203741+0000","last_unstale":"2024-09-22T03:54:19.951855+0000","last_undegraded":"2024-09-22T03:54:19.951855+0000","last_fullsized":"2024-09-22T03:54:19.951855+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1068,"log_dups_size":0,"ondisk_log_size":1068,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55836672,"num_objects":852,"num_object_clones":0,"num_object_copies":2556,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1068,"num_write_kb":61440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:53:08.752323+0000","last_change":"2024-09-22T03:49:17.036954+0000","last_active":"2024-09-22T03:53:08.752323+0000","last_peered":"2024-09-22T03:53:08.752323+0000","last_clean":"2024-09-22T03:53:08.752323+0000","last_became_active":"2024-09-22T03:49:15.110506+0000","last_became_peered":"2024-09-22T03:49:15.110506+0000","last_unstale":"2024-09-22T03:53:08.752323+0000","last_undegraded":"2024-09-22T03:53:08.752323+0000","last_fullsized":"2024-09-22T03:53:08.752323+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"43'1113","reported_seq":1137,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:54:20.034846+0000","last_change":"2024-09-22T03:52:38.239558+0000","last_active":"2024-09-22T03:54:20.034846+0000","last_peered":"2024-09-22T03:54:20.034846+0000","last_clean":"2024-09-22T03:54:20.034846+0000","last_became_active":"2024-09-22T03:52:38.229931+0000","last_became_peered":"2024-09-22T03:52:38.229931+0000","last_unstale":"2024-09-22T03:54:20.034846+0000","last_undegraded":"2024-09-22T03:54:20.034846+0000","last_fullsized":"2024-09-22T03:54:20.034846+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1113,"log_dups_size":0,"ondisk_log_size":1113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56688640,"num_objects":865,"num_object_clones":0,"num_object_copies":2595,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1113,"num_write_kb":63296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:53:08.738470+0000","last_change":"2024-09-22T03:49:17.032989+0000","last_active":"2024-09-22T03:53:08.738470+0000","last_peered":"2024-09-22T03:53:08.738470+0000","last_clean":"2024-09-22T03:53:08.738470+0000","last_became_active":"2024-09-22T03:49:15.079260+0000","last_became_peered":"2024-09-22T03:49:15.079260+0000","last_unstale":"2024-09-22T03:53:08.738470+0000","last_undegraded":"2024-09-22T03:53:08.738470+0000","last_fullsized":"2024-09-22T03:53:08.738470+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"43'1105","reported_seq":1129,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:54:20.025325+0000","last_change":"2024-09-22T03:52:38.258650+0000","last_active":"2024-09-22T03:54:20.025325+0000","last_peered":"2024-09-22T03:54:20.025325+0000","last_clean":"2024-09-22T03:54:20.025325+0000","last_became_active":"2024-09-22T03:52:38.238553+0000","last_became_peered":"2024-09-22T03:52:38.238553+0000","last_unstale":"2024-09-22T03:54:20.025325+0000","last_undegraded":"2024-09-22T03:54:20.025325+0000","last_fullsized":"2024-09-22T03:54:20.025325+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1105,"log_dups_size":0,"ondisk_log_size":1105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56426496,"num_objects":861,"num_object_clones":0,"num_object_copies":2583,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1105,"num_write_kb":62912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:53:08.749614+0000","last_change":"2024-09-22T03:49:17.036402+0000","last_active":"2024-09-22T03:53:08.749614+0000","last_peered":"2024-09-22T03:53:08.749614+0000","last_clean":"2024-09-22T03:53:08.749614+0000","last_became_active":"2024-09-22T03:49:15.108430+0000","last_became_peered":"2024-09-22T03:49:15.108430+0000","last_unstale":"2024-09-22T03:53:08.749614+0000","last_undegraded":"2024-09-22T03:53:08.749614+0000","last_fullsized":"2024-09-22T03:53:08.749614+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"43'1055","reported_seq":1079,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:54:19.847563+0000","last_change":"2024-09-22T03:52:38.208326+0000","last_active":"2024-09-22T03:54:19.847563+0000","last_peered":"2024-09-22T03:54:19.847563+0000","last_clean":"2024-09-22T03:54:19.847563+0000","last_became_active":"2024-09-22T03:52:38.200509+0000","last_became_peered":"2024-09-22T03:52:38.200509+0000","last_unstale":"2024-09-22T03:54:19.847563+0000","last_undegraded":"2024-09-22T03:54:19.847563+0000","last_fullsized":"2024-09-22T03:54:19.847563+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1055,"log_dups_size":0,"ondisk_log_size":1055,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54722560,"num_objects":835,"num_object_clones":0,"num_object_copies":2505,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1055,"num_write_kb":60480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:53:08.752300+0000","last_change":"2024-09-22T03:49:17.029128+0000","last_active":"2024-09-22T03:53:08.752300+0000","last_peered":"2024-09-22T03:53:08.752300+0000","last_clean":"2024-09-22T03:53:08.752300+0000","last_became_active":"2024-09-22T03:49:15.113396+0000","last_became_peered":"2024-09-22T03:49:15.113396+0000","last_unstale":"2024-09-22T03:53:08.752300+0000","last_undegraded":"2024-09-22T03:53:08.752300+0000","last_fullsized":"2024-09-22T03:53:08.752300+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":907345944,"num_objects":13846,"num_object_clones":0,"num_object_copies":41538,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":17240,"num_write_kb":994689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":170135552,"data_stored":2721972296,"data_compressed":129253805,"data_compressed_allocated":170123264,"data_compressed_original":2721972224,"omap_allocated":0,"internal_metadata":0},"log_size":17240,"ondisk_log_size":17240,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949673264,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":103176,"kb_used_data":40248,"kb_used_omap":0,"kb_used_meta":62912,"kb_avail":94268664,"statfs":{"total":96636764160,"available":96531111936,"internally_reserved":0,"allocated":41213952,"data_stored":653259384,"data_compressed":31016239,"data_compressed_allocated":40824832,"data_compressed_original":653115392,"omap_allocated":0,"internal_metadata":64421888},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654705973,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":119712,"kb_used_data":48464,"kb_used_omap":0,"kb_used_meta":71232,"kb_avail":94252128,"statfs":{"total":96636764160,"available":96514179072,"internally_reserved":0,"allocated":49627136,"data_stored":788263000,"data_compressed":37424912,"data_compressed_allocated":49258496,"data_compressed_original":788135936,"omap_allocated":0,"internal_metadata":72941568},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705973,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":119568,"kb_used_data":48320,"kb_used_omap":0,"kb_used_meta":71232,"kb_avail":94252272,"statfs":{"total":96636764160,"available":96514326528,"internally_reserved":0,"allocated":49479680,"data_stored":785511032,"data_compressed":37296255,"data_compressed_allocated":49090560,"data_compressed_original":785367040,"omap_allocated":0,"internal_metadata":72941568},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705973,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":107168,"kb_used_data":31760,"kb_used_omap":0,"kb_used_meta":75392,"kb_avail":94264672,"statfs":{"total":96636764160,"available":96527024128,"internally_reserved":0,"allocated":32522240,"data_stored":514323021,"data_compressed":24418799,"data_compressed_allocated":32141312,"data_compressed_original":514179072,"omap_allocated":0,"internal_metadata":77201408},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":31924224,"data_stored":510787584,"data_compressed":24254927,"data_compressed_allocated":31924224,"data_compressed_original":510787584,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40529920,"data_stored":648413208,"data_compressed":30790127,"data_compressed_allocated":40525824,"data_compressed_original":648413184,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":48758784,"data_stored":780075032,"data_compressed":37042135,"data_compressed_allocated":48754688,"data_compressed_original":780075008,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":48922624,"data_stored":782696472,"data_compressed":37166616,"data_compressed_allocated":48918528,"data_compressed_original":782696448,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:54:23.072 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:54:23.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:54:23.211+0000 7f5d3fea3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:54:23.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:54:23.223+0000 7f5d3fea3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:54:25.664 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:54:25.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:54:25.808+0000 7fda9e911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:54:25.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:54:25.817+0000 7fda9e911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:54:26.753 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:54:26.754 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:54:26.754 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:54:26.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:54:26.883+0000 7f0059751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:54:26.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:54:26.895+0000 7f0059751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:54:27.159 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:54:27.159 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-22T03:54:27.179 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":195,"stamp":"2024-09-22T03:54:27.029285+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":833487435,"num_objects":12714,"num_object_clones":0,"num_object_copies":38142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":18457,"num_write_kb":995797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18431,"ondisk_log_size":18431,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":448484,"kb_used_data":155168,"kb_used_omap":0,"kb_used_meta":293248,"kb_avail":377038876,"statfs":{"total":386547056640,"available":386087809024,"internally_reserved":0,"allocated":158892032,"data_stored":2518140821,"data_compressed":119556733,"data_compressed_allocated":157364224,"data_compressed_original":2517581824,"omap_allocated":0,"internal_metadata":300285952},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-181927912,"num_objects":-2775,"num_object_clones":0,"num_object_copies":-8325,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2777,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002533"},"pg_stats":[{"pgid":"4.f","version":"43'1182","reported_seq":1206,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:54:26.081668+0000","last_change":"2024-09-22T03:52:38.267363+0000","last_active":"2024-09-22T03:54:26.081668+0000","last_peered":"2024-09-22T03:54:26.081668+0000","last_clean":"2024-09-22T03:54:26.081668+0000","last_became_active":"2024-09-22T03:52:38.261984+0000","last_became_peered":"2024-09-22T03:52:38.261984+0000","last_unstale":"2024-09-22T03:54:26.081668+0000","last_undegraded":"2024-09-22T03:54:26.081668+0000","last_fullsized":"2024-09-22T03:54:26.081668+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1182,"log_dups_size":0,"ondisk_log_size":1182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49676288,"num_objects":758,"num_object_clones":0,"num_object_copies":2274,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1182,"num_write_kb":62080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"43'1154","reported_seq":1178,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:54:25.970159+0000","last_change":"2024-09-22T03:52:38.211390+0000","last_active":"2024-09-22T03:54:25.970159+0000","last_peered":"2024-09-22T03:54:25.970159+0000","last_clean":"2024-09-22T03:54:25.970159+0000","last_became_active":"2024-09-22T03:52:38.190969+0000","last_became_peered":"2024-09-22T03:52:38.190969+0000","last_unstale":"2024-09-22T03:54:25.970159+0000","last_undegraded":"2024-09-22T03:54:25.970159+0000","last_fullsized":"2024-09-22T03:54:25.970159+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1154,"log_dups_size":0,"ondisk_log_size":1154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50987008,"num_objects":778,"num_object_clones":0,"num_object_copies":2334,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1154,"num_write_kb":61824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"43'1108","reported_seq":1133,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:54:24.971340+0000","last_change":"2024-09-22T03:52:38.196399+0000","last_active":"2024-09-22T03:54:24.971340+0000","last_peered":"2024-09-22T03:54:24.971340+0000","last_clean":"2024-09-22T03:54:24.971340+0000","last_became_active":"2024-09-22T03:52:38.183573+0000","last_became_peered":"2024-09-22T03:52:38.183573+0000","last_unstale":"2024-09-22T03:54:24.971340+0000","last_undegraded":"2024-09-22T03:54:24.971340+0000","last_fullsized":"2024-09-22T03:54:24.971340+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1108,"log_dups_size":0,"ondisk_log_size":1108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50659352,"num_objects":774,"num_object_clones":0,"num_object_copies":2322,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1108,"num_write_kb":60161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"43'1100","reported_seq":1124,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:54:24.931864+0000","last_change":"2024-09-22T03:52:38.241973+0000","last_active":"2024-09-22T03:54:24.931864+0000","last_peered":"2024-09-22T03:54:24.931864+0000","last_clean":"2024-09-22T03:54:24.931864+0000","last_became_active":"2024-09-22T03:52:38.234357+0000","last_became_peered":"2024-09-22T03:52:38.234357+0000","last_unstale":"2024-09-22T03:54:24.931864+0000","last_undegraded":"2024-09-22T03:54:24.931864+0000","last_fullsized":"2024-09-22T03:54:24.931864+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1100,"log_dups_size":0,"ondisk_log_size":1100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50462720,"num_objects":770,"num_object_clones":0,"num_object_copies":2310,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1100,"num_write_kb":59840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"43'1114","reported_seq":1138,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:54:24.650514+0000","last_change":"2024-09-22T03:52:38.234728+0000","last_active":"2024-09-22T03:54:24.650514+0000","last_peered":"2024-09-22T03:54:24.650514+0000","last_clean":"2024-09-22T03:54:24.650514+0000","last_became_active":"2024-09-22T03:52:38.221861+0000","last_became_peered":"2024-09-22T03:52:38.221861+0000","last_unstale":"2024-09-22T03:54:24.650514+0000","last_undegraded":"2024-09-22T03:54:24.650514+0000","last_fullsized":"2024-09-22T03:54:24.650514+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1114,"log_dups_size":0,"ondisk_log_size":1114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49414144,"num_objects":754,"num_object_clones":0,"num_object_copies":2262,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1114,"num_write_kb":59776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"43'1164","reported_seq":1188,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:54:24.969801+0000","last_change":"2024-09-22T03:52:38.235904+0000","last_active":"2024-09-22T03:54:24.969801+0000","last_peered":"2024-09-22T03:54:24.969801+0000","last_clean":"2024-09-22T03:54:24.969801+0000","last_became_active":"2024-09-22T03:52:38.225232+0000","last_became_peered":"2024-09-22T03:52:38.225232+0000","last_unstale":"2024-09-22T03:54:24.969801+0000","last_undegraded":"2024-09-22T03:54:24.969801+0000","last_fullsized":"2024-09-22T03:54:24.969801+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1164,"log_dups_size":0,"ondisk_log_size":1164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53477376,"num_objects":816,"num_object_clones":0,"num_object_copies":2448,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1164,"num_write_kb":63360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"43'1173","reported_seq":1197,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:54:24.838685+0000","last_change":"2024-09-22T03:52:38.200669+0000","last_active":"2024-09-22T03:54:24.838685+0000","last_peered":"2024-09-22T03:54:24.838685+0000","last_clean":"2024-09-22T03:54:24.838685+0000","last_became_active":"2024-09-22T03:52:38.190269+0000","last_became_peered":"2024-09-22T03:52:38.190269+0000","last_unstale":"2024-09-22T03:54:24.838685+0000","last_undegraded":"2024-09-22T03:54:24.838685+0000","last_fullsized":"2024-09-22T03:54:24.838685+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1173,"log_dups_size":0,"ondisk_log_size":1173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54198272,"num_objects":827,"num_object_clones":0,"num_object_copies":2481,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1173,"num_write_kb":64000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"43'1155","reported_seq":1179,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:54:24.937979+0000","last_change":"2024-09-22T03:52:38.177831+0000","last_active":"2024-09-22T03:54:24.937979+0000","last_peered":"2024-09-22T03:54:24.937979+0000","last_clean":"2024-09-22T03:54:24.937979+0000","last_became_active":"2024-09-22T03:52:38.169555+0000","last_became_peered":"2024-09-22T03:52:38.169555+0000","last_unstale":"2024-09-22T03:54:24.937979+0000","last_undegraded":"2024-09-22T03:54:24.937979+0000","last_fullsized":"2024-09-22T03:54:24.937979+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1155,"log_dups_size":0,"ondisk_log_size":1155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53673984,"num_objects":819,"num_object_clones":0,"num_object_copies":2457,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1155,"num_write_kb":63168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"43'1133","reported_seq":1157,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:54:24.731630+0000","last_change":"2024-09-22T03:52:38.267240+0000","last_active":"2024-09-22T03:54:24.731630+0000","last_peered":"2024-09-22T03:54:24.731630+0000","last_clean":"2024-09-22T03:54:24.731630+0000","last_became_active":"2024-09-22T03:52:38.252880+0000","last_became_peered":"2024-09-22T03:52:38.252880+0000","last_unstale":"2024-09-22T03:54:24.731630+0000","last_undegraded":"2024-09-22T03:54:24.731630+0000","last_fullsized":"2024-09-22T03:54:24.731630+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1133,"log_dups_size":0,"ondisk_log_size":1133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51838976,"num_objects":791,"num_object_clones":0,"num_object_copies":2373,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1133,"num_write_kb":61568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":172,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:53:08.738004+0000","last_change":"2024-09-22T03:49:12.034704+0000","last_active":"2024-09-22T03:53:08.738004+0000","last_peered":"2024-09-22T03:53:08.738004+0000","last_clean":"2024-09-22T03:53:08.738004+0000","last_became_active":"2024-09-22T03:49:12.027470+0000","last_became_peered":"2024-09-22T03:49:12.027470+0000","last_unstale":"2024-09-22T03:53:08.738004+0000","last_undegraded":"2024-09-22T03:53:08.738004+0000","last_fullsized":"2024-09-22T03:53:08.738004+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_clean_scrub_stamp":"2024-09-22T03:49:10.979949+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":98,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:53:08.753153+0000","last_change":"2024-09-22T03:49:17.031458+0000","last_active":"2024-09-22T03:53:08.753153+0000","last_peered":"2024-09-22T03:53:08.753153+0000","last_clean":"2024-09-22T03:53:08.753153+0000","last_became_active":"2024-09-22T03:49:15.125490+0000","last_became_peered":"2024-09-22T03:49:15.125490+0000","last_unstale":"2024-09-22T03:53:08.753153+0000","last_undegraded":"2024-09-22T03:53:08.753153+0000","last_fullsized":"2024-09-22T03:53:08.753153+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"43'1096","reported_seq":1120,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:54:24.839445+0000","last_change":"2024-09-22T03:52:38.263115+0000","last_active":"2024-09-22T03:54:24.839445+0000","last_peered":"2024-09-22T03:54:24.839445+0000","last_clean":"2024-09-22T03:54:24.839445+0000","last_became_active":"2024-09-22T03:52:38.245622+0000","last_became_peered":"2024-09-22T03:52:38.245622+0000","last_unstale":"2024-09-22T03:54:24.839445+0000","last_undegraded":"2024-09-22T03:54:24.839445+0000","last_fullsized":"2024-09-22T03:54:24.839445+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1096,"log_dups_size":0,"ondisk_log_size":1096,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51511296,"num_objects":786,"num_object_clones":0,"num_object_copies":2358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1096,"num_write_kb":60224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:53:08.749573+0000","last_change":"2024-09-22T03:49:17.029339+0000","last_active":"2024-09-22T03:53:08.749573+0000","last_peered":"2024-09-22T03:53:08.749573+0000","last_clean":"2024-09-22T03:53:08.749573+0000","last_became_active":"2024-09-22T03:49:15.097304+0000","last_became_peered":"2024-09-22T03:49:15.097304+0000","last_unstale":"2024-09-22T03:53:08.749573+0000","last_undegraded":"2024-09-22T03:53:08.749573+0000","last_fullsized":"2024-09-22T03:53:08.749573+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"43'1190","reported_seq":1214,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:54:25.948960+0000","last_change":"2024-09-22T03:52:38.234061+0000","last_active":"2024-09-22T03:54:25.948960+0000","last_peered":"2024-09-22T03:54:25.948960+0000","last_clean":"2024-09-22T03:54:25.948960+0000","last_became_active":"2024-09-22T03:52:38.222894+0000","last_became_peered":"2024-09-22T03:52:38.222894+0000","last_unstale":"2024-09-22T03:54:25.948960+0000","last_undegraded":"2024-09-22T03:54:25.948960+0000","last_fullsized":"2024-09-22T03:54:25.948960+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1190,"log_dups_size":0,"ondisk_log_size":1190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54132736,"num_objects":826,"num_object_clones":0,"num_object_copies":2478,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1190,"num_write_kb":64512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:53:08.765557+0000","last_change":"2024-09-22T03:49:17.029349+0000","last_active":"2024-09-22T03:53:08.765557+0000","last_peered":"2024-09-22T03:53:08.765557+0000","last_clean":"2024-09-22T03:53:08.765557+0000","last_became_active":"2024-09-22T03:49:15.094890+0000","last_became_peered":"2024-09-22T03:49:15.094890+0000","last_unstale":"2024-09-22T03:53:08.765557+0000","last_undegraded":"2024-09-22T03:53:08.765557+0000","last_fullsized":"2024-09-22T03:53:08.765557+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"43'1224","reported_seq":1248,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:54:25.867746+0000","last_change":"2024-09-22T03:52:38.248145+0000","last_active":"2024-09-22T03:54:25.867746+0000","last_peered":"2024-09-22T03:54:25.867746+0000","last_clean":"2024-09-22T03:54:25.867746+0000","last_became_active":"2024-09-22T03:52:38.241420+0000","last_became_peered":"2024-09-22T03:52:38.241420+0000","last_unstale":"2024-09-22T03:54:25.867746+0000","last_undegraded":"2024-09-22T03:54:25.867746+0000","last_fullsized":"2024-09-22T03:54:25.867746+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1224,"log_dups_size":0,"ondisk_log_size":1224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55050240,"num_objects":840,"num_object_clones":0,"num_object_copies":2520,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1224,"num_write_kb":66048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":99,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:53:08.758873+0000","last_change":"2024-09-22T03:49:17.031466+0000","last_active":"2024-09-22T03:53:08.758873+0000","last_peered":"2024-09-22T03:53:08.758873+0000","last_clean":"2024-09-22T03:53:08.758873+0000","last_became_active":"2024-09-22T03:49:15.098420+0000","last_became_peered":"2024-09-22T03:49:15.098420+0000","last_unstale":"2024-09-22T03:53:08.758873+0000","last_undegraded":"2024-09-22T03:53:08.758873+0000","last_fullsized":"2024-09-22T03:53:08.758873+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2","version":"43'1114","reported_seq":1138,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:54:24.922474+0000","last_change":"2024-09-22T03:52:38.215825+0000","last_active":"2024-09-22T03:54:24.922474+0000","last_peered":"2024-09-22T03:54:24.922474+0000","last_clean":"2024-09-22T03:54:24.922474+0000","last_became_active":"2024-09-22T03:52:38.203741+0000","last_became_peered":"2024-09-22T03:52:38.203741+0000","last_unstale":"2024-09-22T03:54:24.922474+0000","last_undegraded":"2024-09-22T03:54:24.922474+0000","last_fullsized":"2024-09-22T03:54:24.922474+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1114,"log_dups_size":0,"ondisk_log_size":1114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52822016,"num_objects":806,"num_object_clones":0,"num_object_copies":2418,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1114,"num_write_kb":61440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:53:08.752323+0000","last_change":"2024-09-22T03:49:17.036954+0000","last_active":"2024-09-22T03:53:08.752323+0000","last_peered":"2024-09-22T03:53:08.752323+0000","last_clean":"2024-09-22T03:53:08.752323+0000","last_became_active":"2024-09-22T03:49:15.110506+0000","last_became_peered":"2024-09-22T03:49:15.110506+0000","last_unstale":"2024-09-22T03:53:08.752323+0000","last_undegraded":"2024-09-22T03:53:08.752323+0000","last_fullsized":"2024-09-22T03:53:08.752323+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"43'1180","reported_seq":1204,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:54:24.986013+0000","last_change":"2024-09-22T03:52:38.239558+0000","last_active":"2024-09-22T03:54:24.986013+0000","last_peered":"2024-09-22T03:54:24.986013+0000","last_clean":"2024-09-22T03:54:24.986013+0000","last_became_active":"2024-09-22T03:52:38.229931+0000","last_became_peered":"2024-09-22T03:52:38.229931+0000","last_unstale":"2024-09-22T03:54:24.986013+0000","last_undegraded":"2024-09-22T03:54:24.986013+0000","last_fullsized":"2024-09-22T03:54:24.986013+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1180,"log_dups_size":0,"ondisk_log_size":1180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52297728,"num_objects":798,"num_object_clones":0,"num_object_copies":2394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1180,"num_write_kb":63296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:53:08.738470+0000","last_change":"2024-09-22T03:49:17.032989+0000","last_active":"2024-09-22T03:53:08.738470+0000","last_peered":"2024-09-22T03:53:08.738470+0000","last_clean":"2024-09-22T03:53:08.738470+0000","last_became_active":"2024-09-22T03:49:15.079260+0000","last_became_peered":"2024-09-22T03:49:15.079260+0000","last_unstale":"2024-09-22T03:53:08.738470+0000","last_undegraded":"2024-09-22T03:53:08.738470+0000","last_fullsized":"2024-09-22T03:53:08.738470+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"43'1164","reported_seq":1188,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:54:24.953206+0000","last_change":"2024-09-22T03:52:38.258650+0000","last_active":"2024-09-22T03:54:24.953206+0000","last_peered":"2024-09-22T03:54:24.953206+0000","last_clean":"2024-09-22T03:54:24.953206+0000","last_became_active":"2024-09-22T03:52:38.238553+0000","last_became_peered":"2024-09-22T03:52:38.238553+0000","last_unstale":"2024-09-22T03:54:24.953206+0000","last_undegraded":"2024-09-22T03:54:24.953206+0000","last_fullsized":"2024-09-22T03:54:24.953206+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1164,"log_dups_size":0,"ondisk_log_size":1164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52559872,"num_objects":802,"num_object_clones":0,"num_object_copies":2406,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1164,"num_write_kb":62912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:53:08.749614+0000","last_change":"2024-09-22T03:49:17.036402+0000","last_active":"2024-09-22T03:53:08.749614+0000","last_peered":"2024-09-22T03:53:08.749614+0000","last_clean":"2024-09-22T03:53:08.749614+0000","last_became_active":"2024-09-22T03:49:15.108430+0000","last_became_peered":"2024-09-22T03:49:15.108430+0000","last_unstale":"2024-09-22T03:53:08.749614+0000","last_undegraded":"2024-09-22T03:53:08.749614+0000","last_fullsized":"2024-09-22T03:53:08.749614+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"43'1125","reported_seq":1149,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:54:25.010898+0000","last_change":"2024-09-22T03:52:38.208326+0000","last_active":"2024-09-22T03:54:25.010898+0000","last_peered":"2024-09-22T03:54:25.010898+0000","last_clean":"2024-09-22T03:54:25.010898+0000","last_became_active":"2024-09-22T03:52:38.200509+0000","last_became_peered":"2024-09-22T03:52:38.200509+0000","last_unstale":"2024-09-22T03:54:25.010898+0000","last_undegraded":"2024-09-22T03:54:25.010898+0000","last_fullsized":"2024-09-22T03:54:25.010898+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1125,"log_dups_size":0,"ondisk_log_size":1125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50135040,"num_objects":765,"num_object_clones":0,"num_object_copies":2295,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1125,"num_write_kb":60480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:53:08.752300+0000","last_change":"2024-09-22T03:49:17.029128+0000","last_active":"2024-09-22T03:53:08.752300+0000","last_peered":"2024-09-22T03:53:08.752300+0000","last_clean":"2024-09-22T03:53:08.752300+0000","last_became_active":"2024-09-22T03:49:15.113396+0000","last_became_peered":"2024-09-22T03:49:15.113396+0000","last_unstale":"2024-09-22T03:53:08.752300+0000","last_undegraded":"2024-09-22T03:53:08.752300+0000","last_fullsized":"2024-09-22T03:53:08.752300+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":832897048,"num_objects":12710,"num_object_clones":0,"num_object_copies":38130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":18376,"num_write_kb":994689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":156303360,"data_stored":2500657224,"data_compressed":118744581,"data_compressed_allocated":156291072,"data_compressed_original":2500657152,"omap_allocated":0,"internal_metadata":0},"log_size":18376,"ondisk_log_size":18376,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949673274,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":102224,"kb_used_data":35132,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94269616,"statfs":{"total":96636764160,"available":96532086784,"internally_reserved":0,"allocated":35975168,"data_stored":569438840,"data_compressed":27035991,"data_compressed_allocated":35586048,"data_compressed_original":569294848,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654705978,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":120688,"kb_used_data":45280,"kb_used_omap":0,"kb_used_meta":75392,"kb_avail":94251152,"statfs":{"total":96636764160,"available":96513179648,"internally_reserved":0,"allocated":46366720,"data_stored":736096344,"data_compressed":34947760,"data_compressed_allocated":45998080,"data_compressed_original":735969280,"omap_allocated":0,"internal_metadata":77201408},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705978,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":120512,"kb_used_data":45104,"kb_used_omap":0,"kb_used_meta":75392,"kb_avail":94251328,"statfs":{"total":96636764160,"available":96513359872,"internally_reserved":0,"allocated":46186496,"data_stored":732820088,"data_compressed":34794207,"data_compressed_allocated":45797376,"data_compressed_original":732676096,"omap_allocated":0,"internal_metadata":77201408},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705978,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":105060,"kb_used_data":29652,"kb_used_omap":0,"kb_used_meta":75392,"kb_avail":94266780,"statfs":{"total":96636764160,"available":96529182720,"internally_reserved":0,"allocated":30363648,"data_stored":479785549,"data_compressed":22778775,"data_compressed_allocated":29982720,"data_compressed_original":479641600,"omap_allocated":0,"internal_metadata":77201408},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":29761536,"data_stored":476184576,"data_compressed":22611791,"data_compressed_allocated":29761536,"data_compressed_original":476184576,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":35307520,"data_stored":564854808,"data_compressed":26822327,"data_compressed_allocated":35303424,"data_compressed_original":564854784,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45494272,"data_stored":727842840,"data_compressed":34561871,"data_compressed_allocated":45490176,"data_compressed_original":727842816,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45740032,"data_stored":731775000,"data_compressed":34748592,"data_compressed_allocated":45735936,"data_compressed_original":731774976,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:54:28.389 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:54:28.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:54:28.541+0000 7f4f37b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:54:28.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:54:28.553+0000 7f4f37b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:54:31.207 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:54:31.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:54:31.356+0000 7feed6d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:54:31.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:54:31.364+0000 7feed6d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:54:32.181 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:54:32.181 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:54:32.181 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:54:32.181 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:54:32.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:54:32.320+0000 7ff26b991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:54:32.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:54:32.331+0000 7ff26b991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:54:32.357 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:54:32.357 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:54:32.357 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:54:32.357 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:54:32.357 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:54:32.357 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:54:32.357 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:54:32.357 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:54:32.357 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:54:32.357 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:54:32.357 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:54:32.357 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:54:32.360 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:54:32.360 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:54:32.361 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:54:32.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:54:32.505+0000 7fbf80751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:54:32.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:54:32.516+0000 7fbf80751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:54:32.600 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:54:32.600 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:54:32.600 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:54:32.600 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:54:32.600 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:54:32.600 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:54:32.600 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:54:32.600 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:54:32.600 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:54:32.601 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:54:32.601 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:54:32.601 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:54:32.604 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:54:32.604 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:54:32.604 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:54:32.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:54:32.742+0000 7f9600f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:54:32.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:54:32.757+0000 7f9600f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:54:32.986 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:54:32.986 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:54:32.986 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:54:32.986 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:54:32.986 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:54:32.986 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:54:32.986 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:54:32.986 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:54:32.987 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:54:32.987 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:54:32.987 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:54:32.987 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:54:32.990 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:54:32.990 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:54:32.990 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:54:33.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:54:33.132+0000 7fb9b3711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:54:33.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:54:33.147+0000 7fb9b3711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:54:33.321 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:54:33.322 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:54:33.322 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:54:33.322 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:54:33.322 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:54:33.322 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:54:33.322 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:54:33.322 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:54:33.322 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:54:33.322 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:54:33.322 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:54:33.322 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:54:33.325 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:54:33.326 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:54:33.907 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:54:34.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:54:34.046+0000 7f9dee991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:54:34.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:54:34.055+0000 7f9dee991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:54:36.604 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:54:36.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:54:36.753+0000 7ff534e9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:54:36.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:54:36.761+0000 7ff534e9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:54:38.327 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:54:38.327 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:54:38.328 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:54:38.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:54:38.462+0000 7fb2e8b11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:54:38.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:54:38.472+0000 7fb2e8b11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:54:38.759 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:54:38.760 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-22T03:54:38.779 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":200,"stamp":"2024-09-22T03:54:37.031415+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":715260491,"num_objects":10910,"num_object_clones":0,"num_object_copies":32730,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":20261,"num_write_kb":995797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":20235,"ondisk_log_size":20235,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":405936,"kb_used_data":133416,"kb_used_omap":0,"kb_used_meta":272448,"kb_avail":377081424,"statfs":{"total":386547056640,"available":386131378176,"internally_reserved":0,"allocated":136617984,"data_stored":2161756053,"data_compressed":102633677,"data_compressed_allocated":135090176,"data_compressed_original":2161197056,"omap_allocated":0,"internal_metadata":278986752},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-177930240,"num_objects":-2715,"num_object_clones":0,"num_object_copies":-8145,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2715,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002554"},"pg_stats":[{"pgid":"4.f","version":"43'1284","reported_seq":1308,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:54:35.862025+0000","last_change":"2024-09-22T03:52:38.267363+0000","last_active":"2024-09-22T03:54:35.862025+0000","last_peered":"2024-09-22T03:54:35.862025+0000","last_clean":"2024-09-22T03:54:35.862025+0000","last_became_active":"2024-09-22T03:52:38.261984+0000","last_became_peered":"2024-09-22T03:52:38.261984+0000","last_unstale":"2024-09-22T03:54:35.862025+0000","last_undegraded":"2024-09-22T03:54:35.862025+0000","last_fullsized":"2024-09-22T03:54:35.862025+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1284,"log_dups_size":0,"ondisk_log_size":1284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42991616,"num_objects":656,"num_object_clones":0,"num_object_copies":1968,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1284,"num_write_kb":62080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"43'1279","reported_seq":1303,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:54:35.948588+0000","last_change":"2024-09-22T03:52:38.211390+0000","last_active":"2024-09-22T03:54:35.948588+0000","last_peered":"2024-09-22T03:54:35.948588+0000","last_clean":"2024-09-22T03:54:35.948588+0000","last_became_active":"2024-09-22T03:52:38.190969+0000","last_became_peered":"2024-09-22T03:52:38.190969+0000","last_unstale":"2024-09-22T03:54:35.948588+0000","last_undegraded":"2024-09-22T03:54:35.948588+0000","last_fullsized":"2024-09-22T03:54:35.948588+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1279,"log_dups_size":0,"ondisk_log_size":1279,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42795008,"num_objects":653,"num_object_clones":0,"num_object_copies":1959,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1279,"num_write_kb":61824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"43'1208","reported_seq":1233,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:54:34.775695+0000","last_change":"2024-09-22T03:52:38.196399+0000","last_active":"2024-09-22T03:54:34.775695+0000","last_peered":"2024-09-22T03:54:34.775695+0000","last_clean":"2024-09-22T03:54:34.775695+0000","last_became_active":"2024-09-22T03:52:38.183573+0000","last_became_peered":"2024-09-22T03:52:38.183573+0000","last_unstale":"2024-09-22T03:54:34.775695+0000","last_undegraded":"2024-09-22T03:54:34.775695+0000","last_fullsized":"2024-09-22T03:54:34.775695+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1208,"log_dups_size":0,"ondisk_log_size":1208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44105752,"num_objects":674,"num_object_clones":0,"num_object_copies":2022,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1208,"num_write_kb":60161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"43'1219","reported_seq":1243,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:54:34.633967+0000","last_change":"2024-09-22T03:52:38.241973+0000","last_active":"2024-09-22T03:54:34.633967+0000","last_peered":"2024-09-22T03:54:34.633967+0000","last_clean":"2024-09-22T03:54:34.633967+0000","last_became_active":"2024-09-22T03:52:38.234357+0000","last_became_peered":"2024-09-22T03:52:38.234357+0000","last_unstale":"2024-09-22T03:54:34.633967+0000","last_undegraded":"2024-09-22T03:54:34.633967+0000","last_fullsized":"2024-09-22T03:54:34.633967+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1219,"log_dups_size":0,"ondisk_log_size":1219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42663936,"num_objects":651,"num_object_clones":0,"num_object_copies":1953,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1219,"num_write_kb":59840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"43'1222","reported_seq":1246,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:54:34.814260+0000","last_change":"2024-09-22T03:52:38.234728+0000","last_active":"2024-09-22T03:54:34.814260+0000","last_peered":"2024-09-22T03:54:34.814260+0000","last_clean":"2024-09-22T03:54:34.814260+0000","last_became_active":"2024-09-22T03:52:38.221861+0000","last_became_peered":"2024-09-22T03:52:38.221861+0000","last_unstale":"2024-09-22T03:54:34.814260+0000","last_undegraded":"2024-09-22T03:54:34.814260+0000","last_fullsized":"2024-09-22T03:54:34.814260+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1222,"log_dups_size":0,"ondisk_log_size":1222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42336256,"num_objects":646,"num_object_clones":0,"num_object_copies":1938,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1222,"num_write_kb":59776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"43'1277","reported_seq":1301,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:54:34.890605+0000","last_change":"2024-09-22T03:52:38.235904+0000","last_active":"2024-09-22T03:54:34.890605+0000","last_peered":"2024-09-22T03:54:34.890605+0000","last_clean":"2024-09-22T03:54:34.890605+0000","last_became_active":"2024-09-22T03:52:38.225232+0000","last_became_peered":"2024-09-22T03:52:38.225232+0000","last_unstale":"2024-09-22T03:54:34.890605+0000","last_undegraded":"2024-09-22T03:54:34.890605+0000","last_fullsized":"2024-09-22T03:54:34.890605+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1277,"log_dups_size":0,"ondisk_log_size":1277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46071808,"num_objects":703,"num_object_clones":0,"num_object_copies":2109,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1277,"num_write_kb":63360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"43'1299","reported_seq":1323,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:54:34.990777+0000","last_change":"2024-09-22T03:52:38.200669+0000","last_active":"2024-09-22T03:54:34.990777+0000","last_peered":"2024-09-22T03:54:34.990777+0000","last_clean":"2024-09-22T03:54:34.990777+0000","last_became_active":"2024-09-22T03:52:38.190269+0000","last_became_peered":"2024-09-22T03:52:38.190269+0000","last_unstale":"2024-09-22T03:54:34.990777+0000","last_undegraded":"2024-09-22T03:54:34.990777+0000","last_fullsized":"2024-09-22T03:54:34.990777+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1299,"log_dups_size":0,"ondisk_log_size":1299,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45940736,"num_objects":701,"num_object_clones":0,"num_object_copies":2103,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1299,"num_write_kb":64000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"43'1268","reported_seq":1292,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:54:34.979904+0000","last_change":"2024-09-22T03:52:38.177831+0000","last_active":"2024-09-22T03:54:34.979904+0000","last_peered":"2024-09-22T03:54:34.979904+0000","last_clean":"2024-09-22T03:54:34.979904+0000","last_became_active":"2024-09-22T03:52:38.169555+0000","last_became_peered":"2024-09-22T03:52:38.169555+0000","last_unstale":"2024-09-22T03:54:34.979904+0000","last_undegraded":"2024-09-22T03:54:34.979904+0000","last_fullsized":"2024-09-22T03:54:34.979904+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1268,"log_dups_size":0,"ondisk_log_size":1268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46268416,"num_objects":706,"num_object_clones":0,"num_object_copies":2118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1268,"num_write_kb":63168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"43'1242","reported_seq":1266,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:54:34.759121+0000","last_change":"2024-09-22T03:52:38.267240+0000","last_active":"2024-09-22T03:54:34.759121+0000","last_peered":"2024-09-22T03:54:34.759121+0000","last_clean":"2024-09-22T03:54:34.759121+0000","last_became_active":"2024-09-22T03:52:38.252880+0000","last_became_peered":"2024-09-22T03:52:38.252880+0000","last_unstale":"2024-09-22T03:54:34.759121+0000","last_undegraded":"2024-09-22T03:54:34.759121+0000","last_fullsized":"2024-09-22T03:54:34.759121+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1242,"log_dups_size":0,"ondisk_log_size":1242,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44695552,"num_objects":682,"num_object_clones":0,"num_object_copies":2046,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1242,"num_write_kb":61568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":172,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:53:08.738004+0000","last_change":"2024-09-22T03:49:12.034704+0000","last_active":"2024-09-22T03:53:08.738004+0000","last_peered":"2024-09-22T03:53:08.738004+0000","last_clean":"2024-09-22T03:53:08.738004+0000","last_became_active":"2024-09-22T03:49:12.027470+0000","last_became_peered":"2024-09-22T03:49:12.027470+0000","last_unstale":"2024-09-22T03:53:08.738004+0000","last_undegraded":"2024-09-22T03:53:08.738004+0000","last_fullsized":"2024-09-22T03:53:08.738004+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_clean_scrub_stamp":"2024-09-22T03:49:10.979949+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":98,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:53:08.753153+0000","last_change":"2024-09-22T03:49:17.031458+0000","last_active":"2024-09-22T03:53:08.753153+0000","last_peered":"2024-09-22T03:53:08.753153+0000","last_clean":"2024-09-22T03:53:08.753153+0000","last_became_active":"2024-09-22T03:49:15.125490+0000","last_became_peered":"2024-09-22T03:49:15.125490+0000","last_unstale":"2024-09-22T03:53:08.753153+0000","last_undegraded":"2024-09-22T03:53:08.753153+0000","last_fullsized":"2024-09-22T03:53:08.753153+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"43'1189","reported_seq":1213,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:54:34.913571+0000","last_change":"2024-09-22T03:52:38.263115+0000","last_active":"2024-09-22T03:54:34.913571+0000","last_peered":"2024-09-22T03:54:34.913571+0000","last_clean":"2024-09-22T03:54:34.913571+0000","last_became_active":"2024-09-22T03:52:38.245622+0000","last_became_peered":"2024-09-22T03:52:38.245622+0000","last_unstale":"2024-09-22T03:54:34.913571+0000","last_undegraded":"2024-09-22T03:54:34.913571+0000","last_fullsized":"2024-09-22T03:54:34.913571+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1189,"log_dups_size":0,"ondisk_log_size":1189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45416448,"num_objects":693,"num_object_clones":0,"num_object_copies":2079,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1189,"num_write_kb":60224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:53:08.749573+0000","last_change":"2024-09-22T03:49:17.029339+0000","last_active":"2024-09-22T03:53:08.749573+0000","last_peered":"2024-09-22T03:53:08.749573+0000","last_clean":"2024-09-22T03:53:08.749573+0000","last_became_active":"2024-09-22T03:49:15.097304+0000","last_became_peered":"2024-09-22T03:49:15.097304+0000","last_unstale":"2024-09-22T03:53:08.749573+0000","last_undegraded":"2024-09-22T03:53:08.749573+0000","last_fullsized":"2024-09-22T03:53:08.749573+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"43'1314","reported_seq":1338,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:54:35.906805+0000","last_change":"2024-09-22T03:52:38.234061+0000","last_active":"2024-09-22T03:54:35.906805+0000","last_peered":"2024-09-22T03:54:35.906805+0000","last_clean":"2024-09-22T03:54:35.906805+0000","last_became_active":"2024-09-22T03:52:38.222894+0000","last_became_peered":"2024-09-22T03:52:38.222894+0000","last_unstale":"2024-09-22T03:54:35.906805+0000","last_undegraded":"2024-09-22T03:54:35.906805+0000","last_fullsized":"2024-09-22T03:54:35.906805+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1314,"log_dups_size":0,"ondisk_log_size":1314,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46006272,"num_objects":702,"num_object_clones":0,"num_object_copies":2106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1314,"num_write_kb":64512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:53:08.765557+0000","last_change":"2024-09-22T03:49:17.029349+0000","last_active":"2024-09-22T03:53:08.765557+0000","last_peered":"2024-09-22T03:53:08.765557+0000","last_clean":"2024-09-22T03:53:08.765557+0000","last_became_active":"2024-09-22T03:49:15.094890+0000","last_became_peered":"2024-09-22T03:49:15.094890+0000","last_unstale":"2024-09-22T03:53:08.765557+0000","last_undegraded":"2024-09-22T03:53:08.765557+0000","last_fullsized":"2024-09-22T03:53:08.765557+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"43'1352","reported_seq":1376,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:54:36.022214+0000","last_change":"2024-09-22T03:52:38.248145+0000","last_active":"2024-09-22T03:54:36.022214+0000","last_peered":"2024-09-22T03:54:36.022214+0000","last_clean":"2024-09-22T03:54:36.022214+0000","last_became_active":"2024-09-22T03:52:38.241420+0000","last_became_peered":"2024-09-22T03:52:38.241420+0000","last_unstale":"2024-09-22T03:54:36.022214+0000","last_undegraded":"2024-09-22T03:54:36.022214+0000","last_fullsized":"2024-09-22T03:54:36.022214+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1352,"log_dups_size":0,"ondisk_log_size":1352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46661632,"num_objects":712,"num_object_clones":0,"num_object_copies":2136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1352,"num_write_kb":66048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":99,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:53:08.758873+0000","last_change":"2024-09-22T03:49:17.031466+0000","last_active":"2024-09-22T03:53:08.758873+0000","last_peered":"2024-09-22T03:53:08.758873+0000","last_clean":"2024-09-22T03:53:08.758873+0000","last_became_active":"2024-09-22T03:49:15.098420+0000","last_became_peered":"2024-09-22T03:49:15.098420+0000","last_unstale":"2024-09-22T03:53:08.758873+0000","last_undegraded":"2024-09-22T03:53:08.758873+0000","last_fullsized":"2024-09-22T03:53:08.758873+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2","version":"43'1233","reported_seq":1257,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:54:34.694943+0000","last_change":"2024-09-22T03:52:38.215825+0000","last_active":"2024-09-22T03:54:34.694943+0000","last_peered":"2024-09-22T03:54:34.694943+0000","last_clean":"2024-09-22T03:54:34.694943+0000","last_became_active":"2024-09-22T03:52:38.203741+0000","last_became_peered":"2024-09-22T03:52:38.203741+0000","last_unstale":"2024-09-22T03:54:34.694943+0000","last_undegraded":"2024-09-22T03:54:34.694943+0000","last_fullsized":"2024-09-22T03:54:34.694943+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1233,"log_dups_size":0,"ondisk_log_size":1233,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45023232,"num_objects":687,"num_object_clones":0,"num_object_copies":2061,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1233,"num_write_kb":61440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:53:08.752323+0000","last_change":"2024-09-22T03:49:17.036954+0000","last_active":"2024-09-22T03:53:08.752323+0000","last_peered":"2024-09-22T03:53:08.752323+0000","last_clean":"2024-09-22T03:53:08.752323+0000","last_became_active":"2024-09-22T03:49:15.110506+0000","last_became_peered":"2024-09-22T03:49:15.110506+0000","last_unstale":"2024-09-22T03:53:08.752323+0000","last_undegraded":"2024-09-22T03:53:08.752323+0000","last_fullsized":"2024-09-22T03:53:08.752323+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"43'1290","reported_seq":1314,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:54:34.749398+0000","last_change":"2024-09-22T03:52:38.239558+0000","last_active":"2024-09-22T03:54:34.749398+0000","last_peered":"2024-09-22T03:54:34.749398+0000","last_clean":"2024-09-22T03:54:34.749398+0000","last_became_active":"2024-09-22T03:52:38.229931+0000","last_became_peered":"2024-09-22T03:52:38.229931+0000","last_unstale":"2024-09-22T03:54:34.749398+0000","last_undegraded":"2024-09-22T03:54:34.749398+0000","last_fullsized":"2024-09-22T03:54:34.749398+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1290,"log_dups_size":0,"ondisk_log_size":1290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45088768,"num_objects":688,"num_object_clones":0,"num_object_copies":2064,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1290,"num_write_kb":63296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:53:08.738470+0000","last_change":"2024-09-22T03:49:17.032989+0000","last_active":"2024-09-22T03:53:08.738470+0000","last_peered":"2024-09-22T03:53:08.738470+0000","last_clean":"2024-09-22T03:53:08.738470+0000","last_became_active":"2024-09-22T03:49:15.079260+0000","last_became_peered":"2024-09-22T03:49:15.079260+0000","last_unstale":"2024-09-22T03:53:08.738470+0000","last_undegraded":"2024-09-22T03:53:08.738470+0000","last_fullsized":"2024-09-22T03:53:08.738470+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"43'1276","reported_seq":1300,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:54:34.997901+0000","last_change":"2024-09-22T03:52:38.258650+0000","last_active":"2024-09-22T03:54:34.997901+0000","last_peered":"2024-09-22T03:54:34.997901+0000","last_clean":"2024-09-22T03:54:34.997901+0000","last_became_active":"2024-09-22T03:52:38.238553+0000","last_became_peered":"2024-09-22T03:52:38.238553+0000","last_unstale":"2024-09-22T03:54:34.997901+0000","last_undegraded":"2024-09-22T03:54:34.997901+0000","last_fullsized":"2024-09-22T03:54:34.997901+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1276,"log_dups_size":0,"ondisk_log_size":1276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45219840,"num_objects":690,"num_object_clones":0,"num_object_copies":2070,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1276,"num_write_kb":62912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:53:08.749614+0000","last_change":"2024-09-22T03:49:17.036402+0000","last_active":"2024-09-22T03:53:08.749614+0000","last_peered":"2024-09-22T03:53:08.749614+0000","last_clean":"2024-09-22T03:53:08.749614+0000","last_became_active":"2024-09-22T03:49:15.108430+0000","last_became_peered":"2024-09-22T03:49:15.108430+0000","last_unstale":"2024-09-22T03:53:08.749614+0000","last_undegraded":"2024-09-22T03:53:08.749614+0000","last_fullsized":"2024-09-22T03:53:08.749614+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"43'1228","reported_seq":1252,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:54:34.557910+0000","last_change":"2024-09-22T03:52:38.208326+0000","last_active":"2024-09-22T03:54:34.557910+0000","last_peered":"2024-09-22T03:54:34.557910+0000","last_clean":"2024-09-22T03:54:34.557910+0000","last_became_active":"2024-09-22T03:52:38.200509+0000","last_became_peered":"2024-09-22T03:52:38.200509+0000","last_unstale":"2024-09-22T03:54:34.557910+0000","last_undegraded":"2024-09-22T03:54:34.557910+0000","last_fullsized":"2024-09-22T03:54:34.557910+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1228,"log_dups_size":0,"ondisk_log_size":1228,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43384832,"num_objects":662,"num_object_clones":0,"num_object_copies":1986,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1228,"num_write_kb":60480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:53:08.752300+0000","last_change":"2024-09-22T03:49:17.029128+0000","last_active":"2024-09-22T03:53:08.752300+0000","last_peered":"2024-09-22T03:53:08.752300+0000","last_clean":"2024-09-22T03:53:08.752300+0000","last_became_active":"2024-09-22T03:49:15.113396+0000","last_became_peered":"2024-09-22T03:49:15.113396+0000","last_unstale":"2024-09-22T03:53:08.752300+0000","last_undegraded":"2024-09-22T03:53:08.752300+0000","last_fullsized":"2024-09-22T03:53:08.752300+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":714670104,"num_objects":10906,"num_object_clones":0,"num_object_copies":32718,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20180,"num_write_kb":994689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":134053888,"data_stored":2144665672,"data_compressed":101840197,"data_compressed_allocated":134041600,"data_compressed_original":2144665600,"omap_allocated":0,"internal_metadata":0},"log_size":20180,"ondisk_log_size":20180,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949673284,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":105608,"kb_used_data":30200,"kb_used_omap":0,"kb_used_meta":75392,"kb_avail":94266232,"statfs":{"total":96636764160,"available":96528621568,"internally_reserved":0,"allocated":30924800,"data_stored":488632952,"data_compressed":23198895,"data_compressed_allocated":30535680,"data_compressed_original":488488960,"omap_allocated":0,"internal_metadata":77201408},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654705988,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":106076,"kb_used_data":38980,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94265764,"statfs":{"total":96636764160,"available":96528142336,"internally_reserved":0,"allocated":39915520,"data_stored":632877144,"data_compressed":30046360,"data_compressed_allocated":39546880,"data_compressed_original":632750080,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705988,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":105892,"kb_used_data":38804,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94265948,"statfs":{"total":96636764160,"available":96528330752,"internally_reserved":0,"allocated":39735296,"data_stored":629600888,"data_compressed":29892807,"data_compressed_allocated":39346176,"data_compressed_original":629456896,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705988,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":88360,"kb_used_data":25432,"kb_used_omap":0,"kb_used_meta":62912,"kb_avail":94283480,"statfs":{"total":96636764160,"available":96546283520,"internally_reserved":0,"allocated":26042368,"data_stored":410645069,"data_compressed":19495615,"data_compressed_allocated":25661440,"data_compressed_original":410501120,"omap_allocated":0,"internal_metadata":64421888},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":25456640,"data_stored":407306240,"data_compressed":19341079,"data_compressed_allocated":25456640,"data_compressed_original":407306240,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":30285824,"data_stored":484507672,"data_compressed":23007015,"data_compressed_allocated":30281728,"data_compressed_original":484507648,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":39067648,"data_stored":625016856,"data_compressed":29679143,"data_compressed_allocated":39063552,"data_compressed_original":625016832,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":39243776,"data_stored":627834904,"data_compressed":29812960,"data_compressed_allocated":39239680,"data_compressed_original":627834880,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:54:39.078 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:54:39.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:54:39.228+0000 7f7dadabd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:54:39.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:54:39.236+0000 7f7dadabd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:54:41.936 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:54:42.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:54:42.083+0000 7f4fb0911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:54:42.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:54:42.092+0000 7f4fb0911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:54:43.780 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:54:43.781 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:54:43.781 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:54:43.781 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:54:43.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:54:43.924+0000 7f5fe9d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:54:43.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:54:43.937+0000 7f5fe9d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:54:43.959 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:54:43.959 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:54:43.959 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:54:43.959 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:54:43.959 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:54:43.959 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:54:43.959 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:54:43.959 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:54:43.959 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:54:43.959 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:54:43.959 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:54:43.959 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:54:43.962 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:54:43.963 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:54:43.963 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:54:44.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:54:44.117+0000 7fcea5f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:54:44.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:54:44.130+0000 7fcea5f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:54:44.164 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:54:44.164 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:54:44.164 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:54:44.164 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:54:44.164 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:54:44.164 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:54:44.165 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:54:44.165 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:54:44.165 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:54:44.165 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:54:44.165 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:54:44.165 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:54:44.167 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:54:44.167 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:54:44.168 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:54:44.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:54:44.323+0000 7f06ca8fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:54:44.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:54:44.339+0000 7f06ca8fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:54:44.454 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:54:44.454 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:54:44.454 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:54:44.454 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:54:44.454 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:54:44.455 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:54:44.455 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:54:44.455 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:54:44.455 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:54:44.455 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:54:44.455 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:54:44.455 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:54:44.458 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:54:44.458 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:54:44.458 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:54:44.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:54:44.610+0000 7f1ef4ca3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:54:44.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:54:44.623+0000 7f1ef4ca3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:54:44.818 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:54:44.818 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:54:44.819 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:54:44.819 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:54:44.819 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:54:44.819 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:54:44.819 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:54:44.819 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:54:44.819 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:54:44.819 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:54:44.819 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:54:44.819 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:54:44.822 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:54:44.822 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:54:44.948 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:54:45.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:54:45.098+0000 7fe337b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:54:45.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:54:45.105+0000 7fe337b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:54:47.740 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:54:47.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:54:47.884+0000 7fe8b444f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:54:47.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:54:47.893+0000 7fe8b444f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:54:49.823 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:54:49.823 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:54:49.824 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:54:49.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:54:49.962+0000 7f8cdb85a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:54:49.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:54:49.973+0000 7f8cdb85a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:54:50.268 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:54:50.268 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-22T03:54:50.286 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":206,"stamp":"2024-09-22T03:54:49.034034+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600244811,"num_objects":9155,"num_object_clones":0,"num_object_copies":27465,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":22016,"num_write_kb":995797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21990,"ondisk_log_size":21990,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":384776,"kb_used_data":112256,"kb_used_omap":0,"kb_used_meta":272448,"kb_avail":377102584,"statfs":{"total":386547056640,"available":386153046016,"internally_reserved":0,"allocated":114950144,"data_stored":1815070613,"data_compressed":86171197,"data_compressed_allocated":113422336,"data_compressed_original":1814511616,"omap_allocated":0,"internal_metadata":278986752},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-115015680,"num_objects":-1755,"num_object_clones":0,"num_object_copies":-5265,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1755,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002618"},"pg_stats":[{"pgid":"4.f","version":"43'1378","reported_seq":1402,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:54:45.824911+0000","last_change":"2024-09-22T03:52:38.267363+0000","last_active":"2024-09-22T03:54:45.824911+0000","last_peered":"2024-09-22T03:54:45.824911+0000","last_clean":"2024-09-22T03:54:45.824911+0000","last_became_active":"2024-09-22T03:52:38.261984+0000","last_became_peered":"2024-09-22T03:52:38.261984+0000","last_unstale":"2024-09-22T03:54:45.824911+0000","last_undegraded":"2024-09-22T03:54:45.824911+0000","last_fullsized":"2024-09-22T03:54:45.824911+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1378,"log_dups_size":0,"ondisk_log_size":1378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36831232,"num_objects":562,"num_object_clones":0,"num_object_copies":1686,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1378,"num_write_kb":62080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"43'1380","reported_seq":1404,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:54:45.929798+0000","last_change":"2024-09-22T03:52:38.211390+0000","last_active":"2024-09-22T03:54:45.929798+0000","last_peered":"2024-09-22T03:54:45.929798+0000","last_clean":"2024-09-22T03:54:45.929798+0000","last_became_active":"2024-09-22T03:52:38.190969+0000","last_became_peered":"2024-09-22T03:52:38.190969+0000","last_unstale":"2024-09-22T03:54:45.929798+0000","last_undegraded":"2024-09-22T03:54:45.929798+0000","last_fullsized":"2024-09-22T03:54:45.929798+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1380,"log_dups_size":0,"ondisk_log_size":1380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36175872,"num_objects":552,"num_object_clones":0,"num_object_copies":1656,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1380,"num_write_kb":61824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"43'1328","reported_seq":1353,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:54:45.011837+0000","last_change":"2024-09-22T03:52:38.196399+0000","last_active":"2024-09-22T03:54:45.011837+0000","last_peered":"2024-09-22T03:54:45.011837+0000","last_clean":"2024-09-22T03:54:45.011837+0000","last_became_active":"2024-09-22T03:52:38.183573+0000","last_became_peered":"2024-09-22T03:52:38.183573+0000","last_unstale":"2024-09-22T03:54:45.011837+0000","last_undegraded":"2024-09-22T03:54:45.011837+0000","last_fullsized":"2024-09-22T03:54:45.011837+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1328,"log_dups_size":0,"ondisk_log_size":1328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36241432,"num_objects":554,"num_object_clones":0,"num_object_copies":1662,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1328,"num_write_kb":60161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"43'1321","reported_seq":1345,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:54:45.032986+0000","last_change":"2024-09-22T03:52:38.241973+0000","last_active":"2024-09-22T03:54:45.032986+0000","last_peered":"2024-09-22T03:54:45.032986+0000","last_clean":"2024-09-22T03:54:45.032986+0000","last_became_active":"2024-09-22T03:52:38.234357+0000","last_became_peered":"2024-09-22T03:52:38.234357+0000","last_unstale":"2024-09-22T03:54:45.032986+0000","last_undegraded":"2024-09-22T03:54:45.032986+0000","last_fullsized":"2024-09-22T03:54:45.032986+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1321,"log_dups_size":0,"ondisk_log_size":1321,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35979264,"num_objects":549,"num_object_clones":0,"num_object_copies":1647,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1321,"num_write_kb":59840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"43'1327","reported_seq":1351,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:54:44.918755+0000","last_change":"2024-09-22T03:52:38.234728+0000","last_active":"2024-09-22T03:54:44.918755+0000","last_peered":"2024-09-22T03:54:44.918755+0000","last_clean":"2024-09-22T03:54:44.918755+0000","last_became_active":"2024-09-22T03:52:38.221861+0000","last_became_peered":"2024-09-22T03:52:38.221861+0000","last_unstale":"2024-09-22T03:54:44.918755+0000","last_undegraded":"2024-09-22T03:54:44.918755+0000","last_fullsized":"2024-09-22T03:54:44.918755+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1327,"log_dups_size":0,"ondisk_log_size":1327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35454976,"num_objects":541,"num_object_clones":0,"num_object_copies":1623,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1327,"num_write_kb":59776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"43'1400","reported_seq":1424,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:54:44.822998+0000","last_change":"2024-09-22T03:52:38.235904+0000","last_active":"2024-09-22T03:54:44.822998+0000","last_peered":"2024-09-22T03:54:44.822998+0000","last_clean":"2024-09-22T03:54:44.822998+0000","last_became_active":"2024-09-22T03:52:38.225232+0000","last_became_peered":"2024-09-22T03:52:38.225232+0000","last_unstale":"2024-09-22T03:54:44.822998+0000","last_undegraded":"2024-09-22T03:54:44.822998+0000","last_fullsized":"2024-09-22T03:54:44.822998+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1400,"log_dups_size":0,"ondisk_log_size":1400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38010880,"num_objects":580,"num_object_clones":0,"num_object_copies":1740,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1400,"num_write_kb":63360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"43'1413","reported_seq":1437,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:54:44.952462+0000","last_change":"2024-09-22T03:52:38.200669+0000","last_active":"2024-09-22T03:54:44.952462+0000","last_peered":"2024-09-22T03:54:44.952462+0000","last_clean":"2024-09-22T03:54:44.952462+0000","last_became_active":"2024-09-22T03:52:38.190269+0000","last_became_peered":"2024-09-22T03:52:38.190269+0000","last_unstale":"2024-09-22T03:54:44.952462+0000","last_undegraded":"2024-09-22T03:54:44.952462+0000","last_fullsized":"2024-09-22T03:54:44.952462+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1413,"log_dups_size":0,"ondisk_log_size":1413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38469632,"num_objects":587,"num_object_clones":0,"num_object_copies":1761,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1413,"num_write_kb":64000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"43'1372","reported_seq":1396,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:54:44.946167+0000","last_change":"2024-09-22T03:52:38.177831+0000","last_active":"2024-09-22T03:54:44.946167+0000","last_peered":"2024-09-22T03:54:44.946167+0000","last_clean":"2024-09-22T03:54:44.946167+0000","last_became_active":"2024-09-22T03:52:38.169555+0000","last_became_peered":"2024-09-22T03:52:38.169555+0000","last_unstale":"2024-09-22T03:54:44.946167+0000","last_undegraded":"2024-09-22T03:54:44.946167+0000","last_fullsized":"2024-09-22T03:54:44.946167+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1372,"log_dups_size":0,"ondisk_log_size":1372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39452672,"num_objects":602,"num_object_clones":0,"num_object_copies":1806,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1372,"num_write_kb":63168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"43'1349","reported_seq":1373,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:54:44.304143+0000","last_change":"2024-09-22T03:52:38.267240+0000","last_active":"2024-09-22T03:54:44.304143+0000","last_peered":"2024-09-22T03:54:44.304143+0000","last_clean":"2024-09-22T03:54:44.304143+0000","last_became_active":"2024-09-22T03:52:38.252880+0000","last_became_peered":"2024-09-22T03:52:38.252880+0000","last_unstale":"2024-09-22T03:54:44.304143+0000","last_undegraded":"2024-09-22T03:54:44.304143+0000","last_fullsized":"2024-09-22T03:54:44.304143+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1349,"log_dups_size":0,"ondisk_log_size":1349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37683200,"num_objects":575,"num_object_clones":0,"num_object_copies":1725,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1349,"num_write_kb":61568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":172,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:53:08.738004+0000","last_change":"2024-09-22T03:49:12.034704+0000","last_active":"2024-09-22T03:53:08.738004+0000","last_peered":"2024-09-22T03:53:08.738004+0000","last_clean":"2024-09-22T03:53:08.738004+0000","last_became_active":"2024-09-22T03:49:12.027470+0000","last_became_peered":"2024-09-22T03:49:12.027470+0000","last_unstale":"2024-09-22T03:53:08.738004+0000","last_undegraded":"2024-09-22T03:53:08.738004+0000","last_fullsized":"2024-09-22T03:53:08.738004+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_clean_scrub_stamp":"2024-09-22T03:49:10.979949+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":98,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:53:08.753153+0000","last_change":"2024-09-22T03:49:17.031458+0000","last_active":"2024-09-22T03:53:08.753153+0000","last_peered":"2024-09-22T03:53:08.753153+0000","last_clean":"2024-09-22T03:53:08.753153+0000","last_became_active":"2024-09-22T03:49:15.125490+0000","last_became_peered":"2024-09-22T03:49:15.125490+0000","last_unstale":"2024-09-22T03:53:08.753153+0000","last_undegraded":"2024-09-22T03:53:08.753153+0000","last_fullsized":"2024-09-22T03:53:08.753153+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"43'1312","reported_seq":1336,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:54:44.996388+0000","last_change":"2024-09-22T03:52:38.263115+0000","last_active":"2024-09-22T03:54:44.996388+0000","last_peered":"2024-09-22T03:54:44.996388+0000","last_clean":"2024-09-22T03:54:44.996388+0000","last_became_active":"2024-09-22T03:52:38.245622+0000","last_became_peered":"2024-09-22T03:52:38.245622+0000","last_unstale":"2024-09-22T03:54:44.996388+0000","last_undegraded":"2024-09-22T03:54:44.996388+0000","last_fullsized":"2024-09-22T03:54:44.996388+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1312,"log_dups_size":0,"ondisk_log_size":1312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37355520,"num_objects":570,"num_object_clones":0,"num_object_copies":1710,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1312,"num_write_kb":60224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:53:08.749573+0000","last_change":"2024-09-22T03:49:17.029339+0000","last_active":"2024-09-22T03:53:08.749573+0000","last_peered":"2024-09-22T03:53:08.749573+0000","last_clean":"2024-09-22T03:53:08.749573+0000","last_became_active":"2024-09-22T03:49:15.097304+0000","last_became_peered":"2024-09-22T03:49:15.097304+0000","last_unstale":"2024-09-22T03:53:08.749573+0000","last_undegraded":"2024-09-22T03:53:08.749573+0000","last_fullsized":"2024-09-22T03:53:08.749573+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"43'1423","reported_seq":1447,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:54:46.056491+0000","last_change":"2024-09-22T03:52:38.234061+0000","last_active":"2024-09-22T03:54:46.056491+0000","last_peered":"2024-09-22T03:54:46.056491+0000","last_clean":"2024-09-22T03:54:46.056491+0000","last_became_active":"2024-09-22T03:52:38.222894+0000","last_became_peered":"2024-09-22T03:52:38.222894+0000","last_unstale":"2024-09-22T03:54:46.056491+0000","last_undegraded":"2024-09-22T03:54:46.056491+0000","last_fullsized":"2024-09-22T03:54:46.056491+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1423,"log_dups_size":0,"ondisk_log_size":1423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38862848,"num_objects":593,"num_object_clones":0,"num_object_copies":1779,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1423,"num_write_kb":64512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:53:08.765557+0000","last_change":"2024-09-22T03:49:17.029349+0000","last_active":"2024-09-22T03:53:08.765557+0000","last_peered":"2024-09-22T03:53:08.765557+0000","last_clean":"2024-09-22T03:53:08.765557+0000","last_became_active":"2024-09-22T03:49:15.094890+0000","last_became_peered":"2024-09-22T03:49:15.094890+0000","last_unstale":"2024-09-22T03:53:08.765557+0000","last_undegraded":"2024-09-22T03:53:08.765557+0000","last_fullsized":"2024-09-22T03:53:08.765557+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"43'1473","reported_seq":1497,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:54:46.089974+0000","last_change":"2024-09-22T03:52:38.248145+0000","last_active":"2024-09-22T03:54:46.089974+0000","last_peered":"2024-09-22T03:54:46.089974+0000","last_clean":"2024-09-22T03:54:46.089974+0000","last_became_active":"2024-09-22T03:52:38.241420+0000","last_became_peered":"2024-09-22T03:52:38.241420+0000","last_unstale":"2024-09-22T03:54:46.089974+0000","last_undegraded":"2024-09-22T03:54:46.089974+0000","last_fullsized":"2024-09-22T03:54:46.089974+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1473,"log_dups_size":0,"ondisk_log_size":1473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38731776,"num_objects":591,"num_object_clones":0,"num_object_copies":1773,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1473,"num_write_kb":66048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":99,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:53:08.758873+0000","last_change":"2024-09-22T03:49:17.031466+0000","last_active":"2024-09-22T03:53:08.758873+0000","last_peered":"2024-09-22T03:53:08.758873+0000","last_clean":"2024-09-22T03:53:08.758873+0000","last_became_active":"2024-09-22T03:49:15.098420+0000","last_became_peered":"2024-09-22T03:49:15.098420+0000","last_unstale":"2024-09-22T03:53:08.758873+0000","last_undegraded":"2024-09-22T03:53:08.758873+0000","last_fullsized":"2024-09-22T03:53:08.758873+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2","version":"43'1338","reported_seq":1362,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:54:44.695529+0000","last_change":"2024-09-22T03:52:38.215825+0000","last_active":"2024-09-22T03:54:44.695529+0000","last_peered":"2024-09-22T03:54:44.695529+0000","last_clean":"2024-09-22T03:54:44.695529+0000","last_became_active":"2024-09-22T03:52:38.203741+0000","last_became_peered":"2024-09-22T03:52:38.203741+0000","last_unstale":"2024-09-22T03:54:44.695529+0000","last_undegraded":"2024-09-22T03:54:44.695529+0000","last_fullsized":"2024-09-22T03:54:44.695529+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1338,"log_dups_size":0,"ondisk_log_size":1338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38141952,"num_objects":582,"num_object_clones":0,"num_object_copies":1746,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1338,"num_write_kb":61440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:53:08.752323+0000","last_change":"2024-09-22T03:49:17.036954+0000","last_active":"2024-09-22T03:53:08.752323+0000","last_peered":"2024-09-22T03:53:08.752323+0000","last_clean":"2024-09-22T03:53:08.752323+0000","last_became_active":"2024-09-22T03:49:15.110506+0000","last_became_peered":"2024-09-22T03:49:15.110506+0000","last_unstale":"2024-09-22T03:53:08.752323+0000","last_undegraded":"2024-09-22T03:53:08.752323+0000","last_fullsized":"2024-09-22T03:53:08.752323+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"43'1400","reported_seq":1424,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:54:44.836608+0000","last_change":"2024-09-22T03:52:38.239558+0000","last_active":"2024-09-22T03:54:44.836608+0000","last_peered":"2024-09-22T03:54:44.836608+0000","last_clean":"2024-09-22T03:54:44.836608+0000","last_became_active":"2024-09-22T03:52:38.229931+0000","last_became_peered":"2024-09-22T03:52:38.229931+0000","last_unstale":"2024-09-22T03:54:44.836608+0000","last_undegraded":"2024-09-22T03:54:44.836608+0000","last_fullsized":"2024-09-22T03:54:44.836608+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1400,"log_dups_size":0,"ondisk_log_size":1400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37879808,"num_objects":578,"num_object_clones":0,"num_object_copies":1734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1400,"num_write_kb":63296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:53:08.738470+0000","last_change":"2024-09-22T03:49:17.032989+0000","last_active":"2024-09-22T03:53:08.738470+0000","last_peered":"2024-09-22T03:53:08.738470+0000","last_clean":"2024-09-22T03:53:08.738470+0000","last_became_active":"2024-09-22T03:49:15.079260+0000","last_became_peered":"2024-09-22T03:49:15.079260+0000","last_unstale":"2024-09-22T03:53:08.738470+0000","last_undegraded":"2024-09-22T03:53:08.738470+0000","last_fullsized":"2024-09-22T03:53:08.738470+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"43'1396","reported_seq":1420,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:54:45.031685+0000","last_change":"2024-09-22T03:52:38.258650+0000","last_active":"2024-09-22T03:54:45.031685+0000","last_peered":"2024-09-22T03:54:45.031685+0000","last_clean":"2024-09-22T03:54:45.031685+0000","last_became_active":"2024-09-22T03:52:38.238553+0000","last_became_peered":"2024-09-22T03:52:38.238553+0000","last_unstale":"2024-09-22T03:54:45.031685+0000","last_undegraded":"2024-09-22T03:54:45.031685+0000","last_fullsized":"2024-09-22T03:54:45.031685+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1396,"log_dups_size":0,"ondisk_log_size":1396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37355520,"num_objects":570,"num_object_clones":0,"num_object_copies":1710,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1396,"num_write_kb":62912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:53:08.749614+0000","last_change":"2024-09-22T03:49:17.036402+0000","last_active":"2024-09-22T03:53:08.749614+0000","last_peered":"2024-09-22T03:53:08.749614+0000","last_clean":"2024-09-22T03:53:08.749614+0000","last_became_active":"2024-09-22T03:49:15.108430+0000","last_became_peered":"2024-09-22T03:49:15.108430+0000","last_unstale":"2024-09-22T03:53:08.749614+0000","last_undegraded":"2024-09-22T03:53:08.749614+0000","last_fullsized":"2024-09-22T03:53:08.749614+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"43'1325","reported_seq":1349,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:54:44.965434+0000","last_change":"2024-09-22T03:52:38.208326+0000","last_active":"2024-09-22T03:54:44.965434+0000","last_peered":"2024-09-22T03:54:44.965434+0000","last_clean":"2024-09-22T03:54:44.965434+0000","last_became_active":"2024-09-22T03:52:38.200509+0000","last_became_peered":"2024-09-22T03:52:38.200509+0000","last_unstale":"2024-09-22T03:54:44.965434+0000","last_undegraded":"2024-09-22T03:54:44.965434+0000","last_fullsized":"2024-09-22T03:54:44.965434+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1325,"log_dups_size":0,"ondisk_log_size":1325,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37027840,"num_objects":565,"num_object_clones":0,"num_object_copies":1695,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1325,"num_write_kb":60480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:53:08.752300+0000","last_change":"2024-09-22T03:49:17.029128+0000","last_active":"2024-09-22T03:53:08.752300+0000","last_peered":"2024-09-22T03:53:08.752300+0000","last_clean":"2024-09-22T03:53:08.752300+0000","last_became_active":"2024-09-22T03:49:15.113396+0000","last_became_peered":"2024-09-22T03:49:15.113396+0000","last_unstale":"2024-09-22T03:53:08.752300+0000","last_undegraded":"2024-09-22T03:53:08.752300+0000","last_fullsized":"2024-09-22T03:53:08.752300+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":599654424,"num_objects":9151,"num_object_clones":0,"num_object_copies":27453,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":21935,"num_write_kb":994689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":112521216,"data_stored":1800142920,"data_compressed":85480413,"data_compressed_allocated":112508928,"data_compressed_original":1800142848,"omap_allocated":0,"internal_metadata":0},"log_size":21935,"ondisk_log_size":21935,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949673294,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":88272,"kb_used_data":25336,"kb_used_omap":0,"kb_used_meta":62912,"kb_avail":94283568,"statfs":{"total":96636764160,"available":96546373632,"internally_reserved":0,"allocated":25944064,"data_stored":408941176,"data_compressed":19414703,"data_compressed_allocated":25554944,"data_compressed_original":408797184,"omap_allocated":0,"internal_metadata":64421888},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654705998,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":103984,"kb_used_data":32736,"kb_used_omap":0,"kb_used_meta":71232,"kb_avail":94267856,"statfs":{"total":96636764160,"available":96530284544,"internally_reserved":0,"allocated":33521664,"data_stored":530575448,"data_compressed":25188528,"data_compressed_allocated":33153024,"data_compressed_original":530448384,"omap_allocated":0,"internal_metadata":72941568},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705998,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":103908,"kb_used_data":32660,"kb_used_omap":0,"kb_used_meta":71232,"kb_avail":94267932,"statfs":{"total":96636764160,"available":96530362368,"internally_reserved":0,"allocated":33443840,"data_stored":528937592,"data_compressed":25112775,"data_compressed_allocated":33054720,"data_compressed_original":528793600,"omap_allocated":0,"internal_metadata":72941568},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705998,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":88612,"kb_used_data":21524,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94283228,"statfs":{"total":96636764160,"available":96546025472,"internally_reserved":0,"allocated":22040576,"data_stored":346616397,"data_compressed":16455191,"data_compressed_allocated":21659648,"data_compressed_original":346472448,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":21471232,"data_stored":343539712,"data_compressed":16313103,"data_compressed_allocated":21471232,"data_compressed_original":343539712,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":25325568,"data_stored":405143576,"data_compressed":19238383,"data_compressed_allocated":25321472,"data_compressed_original":405143552,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32821248,"data_stored":525074456,"data_compressed":24933343,"data_compressed_allocated":32817152,"data_compressed_original":525074432,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":32903168,"data_stored":526385176,"data_compressed":24995584,"data_compressed_allocated":32899072,"data_compressed_original":526385152,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:54:50.351 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:54:50.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:54:50.502+0000 7f548589c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:54:50.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:54:50.510+0000 7f548589c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:54:52.861 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:54:53.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:54:53.009+0000 7f3ad2791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:54:53.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:54:53.019+0000 7f3ad2791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:54:55.287 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:54:55.288 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:54:55.288 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:54:55.288 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:54:55.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:54:55.423+0000 7faf4d591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:54:55.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:54:55.440+0000 7faf4d591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:54:55.460 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:54:55.460 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:54:55.460 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:54:55.460 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:54:55.460 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:54:55.460 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:54:55.460 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:54:55.460 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:54:55.460 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:54:55.460 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:54:55.461 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:54:55.461 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:54:55.465 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:54:55.465 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:54:55.466 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:54:55.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:54:55.595+0000 7ffaad6bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:54:55.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:54:55.612+0000 7ffaad6bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:54:55.655 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:54:55.658 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:54:55.658 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:54:55.658 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:54:55.658 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:54:55.659 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:54:55.659 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:54:55.659 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:54:55.659 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:54:55.659 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:54:55.659 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:54:55.659 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:54:55.659 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:54:55.662 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:54:55.663 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:54:55.663 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:54:55.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:54:55.796+0000 7fab34f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:54:55.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:54:55.808+0000 7fab34f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:54:55.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:54:55.846+0000 7faa0a311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:54:55.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:54:55.864+0000 7faa0a311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:54:55.928 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:54:55.928 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:54:55.928 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:54:55.928 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:54:55.928 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:54:55.929 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:54:55.929 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:54:55.929 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:54:55.929 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:54:55.929 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:54:55.929 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:54:55.929 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:54:55.932 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:54:55.933 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:54:55.933 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:54:56.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:54:56.091+0000 7fa8b8893640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:54:56.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:54:56.103+0000 7fa8b359e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:54:56.246 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:54:56.247 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:54:56.247 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:54:56.247 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:54:56.247 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:54:56.247 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:54:56.247 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:54:56.247 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:54:56.247 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:54:56.247 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:54:56.247 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:54:56.247 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:54:56.249 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:54:56.250 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:54:58.197 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:54:58.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:54:58.349+0000 7f15a5191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:54:58.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:54:58.357+0000 7f15a5191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:55:00.961 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:55:01.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:55:01.109+0000 7f0c10b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:55:01.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:55:01.117+0000 7f0c10b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:55:01.251 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:55:01.251 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:55:01.251 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:55:01.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:55:01.408+0000 7ff1bac9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:55:01.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:55:01.419+0000 7ff1bac9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:55:01.763 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:55:01.764 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-22T03:55:01.790 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":212,"stamp":"2024-09-22T03:55:01.036608+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":447087179,"num_objects":6818,"num_object_clones":0,"num_object_copies":20454,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":24353,"num_write_kb":995797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24327,"ondisk_log_size":24327,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":352220,"kb_used_data":83868,"kb_used_omap":0,"kb_used_meta":268288,"kb_avail":377135140,"statfs":{"total":386547056640,"available":386186383360,"internally_reserved":0,"allocated":85880832,"data_stored":1349961621,"data_compressed":64085333,"data_compressed_allocated":84353024,"data_compressed_original":1349402624,"omap_allocated":0,"internal_metadata":274726912},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-153157632,"num_objects":-2337,"num_object_clones":0,"num_object_copies":-7011,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2337,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002574"},"pg_stats":[{"pgid":"4.f","version":"43'1479","reported_seq":1503,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:54:56.048049+0000","last_change":"2024-09-22T03:52:38.267363+0000","last_active":"2024-09-22T03:54:56.048049+0000","last_peered":"2024-09-22T03:54:56.048049+0000","last_clean":"2024-09-22T03:54:56.048049+0000","last_became_active":"2024-09-22T03:52:38.261984+0000","last_became_peered":"2024-09-22T03:52:38.261984+0000","last_unstale":"2024-09-22T03:54:56.048049+0000","last_undegraded":"2024-09-22T03:54:56.048049+0000","last_fullsized":"2024-09-22T03:54:56.048049+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1479,"log_dups_size":0,"ondisk_log_size":1479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30212096,"num_objects":461,"num_object_clones":0,"num_object_copies":1383,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1479,"num_write_kb":62080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"43'1484","reported_seq":1508,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:54:55.934669+0000","last_change":"2024-09-22T03:52:38.211390+0000","last_active":"2024-09-22T03:54:55.934669+0000","last_peered":"2024-09-22T03:54:55.934669+0000","last_clean":"2024-09-22T03:54:55.934669+0000","last_became_active":"2024-09-22T03:52:38.190969+0000","last_became_peered":"2024-09-22T03:52:38.190969+0000","last_unstale":"2024-09-22T03:54:55.934669+0000","last_undegraded":"2024-09-22T03:54:55.934669+0000","last_fullsized":"2024-09-22T03:54:55.934669+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1484,"log_dups_size":0,"ondisk_log_size":1484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":448,"num_object_clones":0,"num_object_copies":1344,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1484,"num_write_kb":61824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"43'1480","reported_seq":1505,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:54:59.886791+0000","last_change":"2024-09-22T03:52:38.196399+0000","last_active":"2024-09-22T03:54:59.886791+0000","last_peered":"2024-09-22T03:54:59.886791+0000","last_clean":"2024-09-22T03:54:59.886791+0000","last_became_active":"2024-09-22T03:52:38.183573+0000","last_became_peered":"2024-09-22T03:52:38.183573+0000","last_unstale":"2024-09-22T03:54:59.886791+0000","last_undegraded":"2024-09-22T03:54:59.886791+0000","last_fullsized":"2024-09-22T03:54:59.886791+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1480,"log_dups_size":0,"ondisk_log_size":1480,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26279960,"num_objects":402,"num_object_clones":0,"num_object_copies":1206,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1480,"num_write_kb":60161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"43'1469","reported_seq":1493,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:55:00.000686+0000","last_change":"2024-09-22T03:52:38.241973+0000","last_active":"2024-09-22T03:55:00.000686+0000","last_peered":"2024-09-22T03:55:00.000686+0000","last_clean":"2024-09-22T03:55:00.000686+0000","last_became_active":"2024-09-22T03:52:38.234357+0000","last_became_peered":"2024-09-22T03:52:38.234357+0000","last_unstale":"2024-09-22T03:55:00.000686+0000","last_undegraded":"2024-09-22T03:55:00.000686+0000","last_fullsized":"2024-09-22T03:55:00.000686+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1469,"log_dups_size":0,"ondisk_log_size":1469,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26279936,"num_objects":401,"num_object_clones":0,"num_object_copies":1203,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1469,"num_write_kb":59840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"43'1454","reported_seq":1478,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:54:59.843327+0000","last_change":"2024-09-22T03:52:38.234728+0000","last_active":"2024-09-22T03:54:59.843327+0000","last_peered":"2024-09-22T03:54:59.843327+0000","last_clean":"2024-09-22T03:54:59.843327+0000","last_became_active":"2024-09-22T03:52:38.221861+0000","last_became_peered":"2024-09-22T03:52:38.221861+0000","last_unstale":"2024-09-22T03:54:59.843327+0000","last_undegraded":"2024-09-22T03:54:59.843327+0000","last_fullsized":"2024-09-22T03:54:59.843327+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1454,"log_dups_size":0,"ondisk_log_size":1454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27131904,"num_objects":414,"num_object_clones":0,"num_object_copies":1242,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1454,"num_write_kb":59776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"43'1547","reported_seq":1571,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:54:59.761556+0000","last_change":"2024-09-22T03:52:38.235904+0000","last_active":"2024-09-22T03:54:59.761556+0000","last_peered":"2024-09-22T03:54:59.761556+0000","last_clean":"2024-09-22T03:54:59.761556+0000","last_became_active":"2024-09-22T03:52:38.225232+0000","last_became_peered":"2024-09-22T03:52:38.225232+0000","last_unstale":"2024-09-22T03:54:59.761556+0000","last_undegraded":"2024-09-22T03:54:59.761556+0000","last_fullsized":"2024-09-22T03:54:59.761556+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1547,"log_dups_size":0,"ondisk_log_size":1547,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28377088,"num_objects":433,"num_object_clones":0,"num_object_copies":1299,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1547,"num_write_kb":63360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"43'1575","reported_seq":1599,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:54:59.831657+0000","last_change":"2024-09-22T03:52:38.200669+0000","last_active":"2024-09-22T03:54:59.831657+0000","last_peered":"2024-09-22T03:54:59.831657+0000","last_clean":"2024-09-22T03:54:59.831657+0000","last_became_active":"2024-09-22T03:52:38.190269+0000","last_became_peered":"2024-09-22T03:52:38.190269+0000","last_unstale":"2024-09-22T03:54:59.831657+0000","last_undegraded":"2024-09-22T03:54:59.831657+0000","last_fullsized":"2024-09-22T03:54:59.831657+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1575,"log_dups_size":0,"ondisk_log_size":1575,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27852800,"num_objects":425,"num_object_clones":0,"num_object_copies":1275,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1575,"num_write_kb":64000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"43'1541","reported_seq":1565,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:54:59.927360+0000","last_change":"2024-09-22T03:52:38.177831+0000","last_active":"2024-09-22T03:54:59.927360+0000","last_peered":"2024-09-22T03:54:59.927360+0000","last_clean":"2024-09-22T03:54:59.927360+0000","last_became_active":"2024-09-22T03:52:38.169555+0000","last_became_peered":"2024-09-22T03:52:38.169555+0000","last_unstale":"2024-09-22T03:54:59.927360+0000","last_undegraded":"2024-09-22T03:54:59.927360+0000","last_fullsized":"2024-09-22T03:54:59.927360+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1541,"log_dups_size":0,"ondisk_log_size":1541,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28377088,"num_objects":433,"num_object_clones":0,"num_object_copies":1299,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1541,"num_write_kb":63168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"43'1494","reported_seq":1518,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:54:59.954946+0000","last_change":"2024-09-22T03:52:38.267240+0000","last_active":"2024-09-22T03:54:59.954946+0000","last_peered":"2024-09-22T03:54:59.954946+0000","last_clean":"2024-09-22T03:54:59.954946+0000","last_became_active":"2024-09-22T03:52:38.252880+0000","last_became_peered":"2024-09-22T03:52:38.252880+0000","last_unstale":"2024-09-22T03:54:59.954946+0000","last_undegraded":"2024-09-22T03:54:59.954946+0000","last_fullsized":"2024-09-22T03:54:59.954946+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1494,"log_dups_size":0,"ondisk_log_size":1494,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28180480,"num_objects":430,"num_object_clones":0,"num_object_copies":1290,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1494,"num_write_kb":61568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":172,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:53:08.738004+0000","last_change":"2024-09-22T03:49:12.034704+0000","last_active":"2024-09-22T03:53:08.738004+0000","last_peered":"2024-09-22T03:53:08.738004+0000","last_clean":"2024-09-22T03:53:08.738004+0000","last_became_active":"2024-09-22T03:49:12.027470+0000","last_became_peered":"2024-09-22T03:49:12.027470+0000","last_unstale":"2024-09-22T03:53:08.738004+0000","last_undegraded":"2024-09-22T03:53:08.738004+0000","last_fullsized":"2024-09-22T03:53:08.738004+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_clean_scrub_stamp":"2024-09-22T03:49:10.979949+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":98,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:53:08.753153+0000","last_change":"2024-09-22T03:49:17.031458+0000","last_active":"2024-09-22T03:53:08.753153+0000","last_peered":"2024-09-22T03:53:08.753153+0000","last_clean":"2024-09-22T03:53:08.753153+0000","last_became_active":"2024-09-22T03:49:15.125490+0000","last_became_peered":"2024-09-22T03:49:15.125490+0000","last_unstale":"2024-09-22T03:53:08.753153+0000","last_undegraded":"2024-09-22T03:53:08.753153+0000","last_fullsized":"2024-09-22T03:53:08.753153+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"43'1461","reported_seq":1485,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:54:59.964787+0000","last_change":"2024-09-22T03:52:38.263115+0000","last_active":"2024-09-22T03:54:59.964787+0000","last_peered":"2024-09-22T03:54:59.964787+0000","last_clean":"2024-09-22T03:54:59.964787+0000","last_became_active":"2024-09-22T03:52:38.245622+0000","last_became_peered":"2024-09-22T03:52:38.245622+0000","last_unstale":"2024-09-22T03:54:59.964787+0000","last_undegraded":"2024-09-22T03:54:59.964787+0000","last_fullsized":"2024-09-22T03:54:59.964787+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1461,"log_dups_size":0,"ondisk_log_size":1461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27590656,"num_objects":421,"num_object_clones":0,"num_object_copies":1263,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1461,"num_write_kb":60224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:53:08.749573+0000","last_change":"2024-09-22T03:49:17.029339+0000","last_active":"2024-09-22T03:53:08.749573+0000","last_peered":"2024-09-22T03:53:08.749573+0000","last_clean":"2024-09-22T03:53:08.749573+0000","last_became_active":"2024-09-22T03:49:15.097304+0000","last_became_peered":"2024-09-22T03:49:15.097304+0000","last_unstale":"2024-09-22T03:53:08.749573+0000","last_undegraded":"2024-09-22T03:53:08.749573+0000","last_fullsized":"2024-09-22T03:53:08.749573+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"43'1543","reported_seq":1567,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:54:55.945535+0000","last_change":"2024-09-22T03:52:38.234061+0000","last_active":"2024-09-22T03:54:55.945535+0000","last_peered":"2024-09-22T03:54:55.945535+0000","last_clean":"2024-09-22T03:54:55.945535+0000","last_became_active":"2024-09-22T03:52:38.222894+0000","last_became_peered":"2024-09-22T03:52:38.222894+0000","last_unstale":"2024-09-22T03:54:55.945535+0000","last_undegraded":"2024-09-22T03:54:55.945535+0000","last_fullsized":"2024-09-22T03:54:55.945535+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1543,"log_dups_size":0,"ondisk_log_size":1543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30998528,"num_objects":473,"num_object_clones":0,"num_object_copies":1419,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1543,"num_write_kb":64512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:53:08.765557+0000","last_change":"2024-09-22T03:49:17.029349+0000","last_active":"2024-09-22T03:53:08.765557+0000","last_peered":"2024-09-22T03:53:08.765557+0000","last_clean":"2024-09-22T03:53:08.765557+0000","last_became_active":"2024-09-22T03:49:15.094890+0000","last_became_peered":"2024-09-22T03:49:15.094890+0000","last_unstale":"2024-09-22T03:53:08.765557+0000","last_undegraded":"2024-09-22T03:53:08.765557+0000","last_fullsized":"2024-09-22T03:53:08.765557+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"43'1594","reported_seq":1618,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:54:56.118718+0000","last_change":"2024-09-22T03:52:38.248145+0000","last_active":"2024-09-22T03:54:56.118718+0000","last_peered":"2024-09-22T03:54:56.118718+0000","last_clean":"2024-09-22T03:54:56.118718+0000","last_became_active":"2024-09-22T03:52:38.241420+0000","last_became_peered":"2024-09-22T03:52:38.241420+0000","last_unstale":"2024-09-22T03:54:56.118718+0000","last_undegraded":"2024-09-22T03:54:56.118718+0000","last_fullsized":"2024-09-22T03:54:56.118718+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1594,"log_dups_size":0,"ondisk_log_size":1594,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30801920,"num_objects":470,"num_object_clones":0,"num_object_copies":1410,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1594,"num_write_kb":66048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":99,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:53:08.758873+0000","last_change":"2024-09-22T03:49:17.031466+0000","last_active":"2024-09-22T03:53:08.758873+0000","last_peered":"2024-09-22T03:53:08.758873+0000","last_clean":"2024-09-22T03:53:08.758873+0000","last_became_active":"2024-09-22T03:49:15.098420+0000","last_became_peered":"2024-09-22T03:49:15.098420+0000","last_unstale":"2024-09-22T03:53:08.758873+0000","last_undegraded":"2024-09-22T03:53:08.758873+0000","last_fullsized":"2024-09-22T03:53:08.758873+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2","version":"43'1507","reported_seq":1531,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:55:00.028743+0000","last_change":"2024-09-22T03:52:38.215825+0000","last_active":"2024-09-22T03:55:00.028743+0000","last_peered":"2024-09-22T03:55:00.028743+0000","last_clean":"2024-09-22T03:55:00.028743+0000","last_became_active":"2024-09-22T03:52:38.203741+0000","last_became_peered":"2024-09-22T03:52:38.203741+0000","last_unstale":"2024-09-22T03:55:00.028743+0000","last_undegraded":"2024-09-22T03:55:00.028743+0000","last_fullsized":"2024-09-22T03:55:00.028743+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1507,"log_dups_size":0,"ondisk_log_size":1507,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27066368,"num_objects":413,"num_object_clones":0,"num_object_copies":1239,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1507,"num_write_kb":61440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:53:08.752323+0000","last_change":"2024-09-22T03:49:17.036954+0000","last_active":"2024-09-22T03:53:08.752323+0000","last_peered":"2024-09-22T03:53:08.752323+0000","last_clean":"2024-09-22T03:53:08.752323+0000","last_became_active":"2024-09-22T03:49:15.110506+0000","last_became_peered":"2024-09-22T03:49:15.110506+0000","last_unstale":"2024-09-22T03:53:08.752323+0000","last_undegraded":"2024-09-22T03:53:08.752323+0000","last_fullsized":"2024-09-22T03:53:08.752323+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"43'1563","reported_seq":1587,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:54:59.895340+0000","last_change":"2024-09-22T03:52:38.239558+0000","last_active":"2024-09-22T03:54:59.895340+0000","last_peered":"2024-09-22T03:54:59.895340+0000","last_clean":"2024-09-22T03:54:59.895340+0000","last_became_active":"2024-09-22T03:52:38.229931+0000","last_became_peered":"2024-09-22T03:52:38.229931+0000","last_unstale":"2024-09-22T03:54:59.895340+0000","last_undegraded":"2024-09-22T03:54:59.895340+0000","last_fullsized":"2024-09-22T03:54:59.895340+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1563,"log_dups_size":0,"ondisk_log_size":1563,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27197440,"num_objects":415,"num_object_clones":0,"num_object_copies":1245,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1563,"num_write_kb":63296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:53:08.738470+0000","last_change":"2024-09-22T03:49:17.032989+0000","last_active":"2024-09-22T03:53:08.738470+0000","last_peered":"2024-09-22T03:53:08.738470+0000","last_clean":"2024-09-22T03:53:08.738470+0000","last_became_active":"2024-09-22T03:49:15.079260+0000","last_became_peered":"2024-09-22T03:49:15.079260+0000","last_unstale":"2024-09-22T03:53:08.738470+0000","last_undegraded":"2024-09-22T03:53:08.738470+0000","last_fullsized":"2024-09-22T03:53:08.738470+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"43'1561","reported_seq":1585,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:54:59.894198+0000","last_change":"2024-09-22T03:52:38.258650+0000","last_active":"2024-09-22T03:54:59.894198+0000","last_peered":"2024-09-22T03:54:59.894198+0000","last_clean":"2024-09-22T03:54:59.894198+0000","last_became_active":"2024-09-22T03:52:38.238553+0000","last_became_peered":"2024-09-22T03:52:38.238553+0000","last_unstale":"2024-09-22T03:54:59.894198+0000","last_undegraded":"2024-09-22T03:54:59.894198+0000","last_fullsized":"2024-09-22T03:54:59.894198+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1561,"log_dups_size":0,"ondisk_log_size":1561,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26542080,"num_objects":405,"num_object_clones":0,"num_object_copies":1215,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1561,"num_write_kb":62912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:53:08.749614+0000","last_change":"2024-09-22T03:49:17.036402+0000","last_active":"2024-09-22T03:53:08.749614+0000","last_peered":"2024-09-22T03:53:08.749614+0000","last_clean":"2024-09-22T03:53:08.749614+0000","last_became_active":"2024-09-22T03:49:15.108430+0000","last_became_peered":"2024-09-22T03:49:15.108430+0000","last_unstale":"2024-09-22T03:53:08.749614+0000","last_undegraded":"2024-09-22T03:53:08.749614+0000","last_fullsized":"2024-09-22T03:53:08.749614+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"43'1520","reported_seq":1544,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:55:00.028117+0000","last_change":"2024-09-22T03:52:38.208326+0000","last_active":"2024-09-22T03:55:00.028117+0000","last_peered":"2024-09-22T03:55:00.028117+0000","last_clean":"2024-09-22T03:55:00.028117+0000","last_became_active":"2024-09-22T03:52:38.200509+0000","last_became_peered":"2024-09-22T03:52:38.200509+0000","last_unstale":"2024-09-22T03:55:00.028117+0000","last_undegraded":"2024-09-22T03:55:00.028117+0000","last_fullsized":"2024-09-22T03:55:00.028117+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1520,"log_dups_size":0,"ondisk_log_size":1520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24248320,"num_objects":370,"num_object_clones":0,"num_object_copies":1110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1520,"num_write_kb":60480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-22T03:53:08.752300+0000","last_change":"2024-09-22T03:49:17.029128+0000","last_active":"2024-09-22T03:53:08.752300+0000","last_peered":"2024-09-22T03:53:08.752300+0000","last_clean":"2024-09-22T03:53:08.752300+0000","last_became_active":"2024-09-22T03:49:15.113396+0000","last_became_peered":"2024-09-22T03:49:15.113396+0000","last_unstale":"2024-09-22T03:53:08.752300+0000","last_undegraded":"2024-09-22T03:53:08.752300+0000","last_fullsized":"2024-09-22T03:53:08.752300+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":446496792,"num_objects":6814,"num_object_clones":0,"num_object_copies":20442,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":24272,"num_write_kb":994689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":83574784,"data_stored":1337000008,"data_compressed":63487909,"data_compressed_allocated":83562496,"data_compressed_original":1336999936,"omap_allocated":0,"internal_metadata":0},"log_size":24272,"ondisk_log_size":24272,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949673304,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":87740,"kb_used_data":20652,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94284100,"statfs":{"total":96636764160,"available":96546918400,"internally_reserved":0,"allocated":21147648,"data_stored":332198520,"data_compressed":15770551,"data_compressed_allocated":20758528,"data_compressed_original":332054528,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654706013,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":86864,"kb_used_data":23936,"kb_used_omap":0,"kb_used_meta":62912,"kb_avail":94284976,"statfs":{"total":96636764160,"available":96547815424,"internally_reserved":0,"allocated":24510464,"data_stored":386396248,"data_compressed":18342128,"data_compressed_allocated":24141824,"data_compressed_original":386269184,"omap_allocated":0,"internal_metadata":64421888},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706013,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":86720,"kb_used_data":23792,"kb_used_omap":0,"kb_used_meta":62912,"kb_avail":94285120,"statfs":{"total":96636764160,"available":96547962880,"internally_reserved":0,"allocated":24363008,"data_stored":383644280,"data_compressed":18213471,"data_compressed_allocated":23973888,"data_compressed_original":383500288,"omap_allocated":0,"internal_metadata":64421888},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706013,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":90896,"kb_used_data":15488,"kb_used_omap":0,"kb_used_meta":75392,"kb_avail":94280944,"statfs":{"total":96636764160,"available":96543686656,"internally_reserved":0,"allocated":15859712,"data_stored":247722573,"data_compressed":11759183,"data_compressed_allocated":15478784,"data_compressed_original":247578624,"omap_allocated":0,"internal_metadata":77201408},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":15286272,"data_stored":244580352,"data_compressed":11613983,"data_compressed_allocated":15286272,"data_compressed_original":244580352,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20537344,"data_stored":328531992,"data_compressed":15600455,"data_compressed_allocated":20533248,"data_compressed_original":328531968,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":23777280,"data_stored":380370968,"data_compressed":18062047,"data_compressed_allocated":23773184,"data_compressed_original":380370944,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":23973888,"data_stored":383516696,"data_compressed":18211424,"data_compressed_allocated":23969792,"data_compressed_original":383516672,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:55:03.923 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:55:04.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:55:04.052+0000 7f60bbb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:55:04.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:55:04.061+0000 7f60bbb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:55:06.627 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:55:06.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:55:06.776+0000 7efd85391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:55:06.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:55:06.787+0000 7efd85391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:55:06.791 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:55:06.791 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:55:06.792 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:55:06.792 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:55:06.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:55:06.942+0000 7f3cbbf08640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:55:06.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:55:06.956+0000 7f3cbbf08640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:55:07.011 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:55:07.011 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:55:07.011 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:55:07.011 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:55:07.011 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:55:07.012 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:55:07.012 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:55:07.012 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:55:07.012 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:55:07.012 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:55:07.012 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:55:07.012 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:55:07.015 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:55:07.015 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:55:07.015 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:55:07.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:55:07.167+0000 7f7293f08640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:55:07.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:55:07.180+0000 7f7293f08640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:55:07.204 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:55:07.204 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:55:07.204 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:55:07.204 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:55:07.204 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:55:07.204 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:55:07.204 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:55:07.204 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:55:07.204 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:55:07.205 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:55:07.205 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:55:07.205 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:55:07.208 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:55:07.209 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:55:07.209 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:55:07.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:55:07.356+0000 7f9a1c67f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:55:07.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:55:07.374+0000 7f9a1c67f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:55:07.722 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:55:07.722 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:55:07.722 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:55:07.722 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:55:07.723 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:55:07.723 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:55:07.723 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:55:07.723 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:55:07.723 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:55:07.723 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:55:07.723 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:55:07.723 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:55:07.725 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:55:07.726 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:55:07.726 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:55:07.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:55:07.866+0000 7f38caa97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:55:07.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:55:07.880+0000 7f38caa97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:55:07.902 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:55:07.902 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:55:07.903 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:55:07.903 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:55:07.903 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:55:07.903 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:55:07.903 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:55:07.903 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:55:07.903 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:55:07.903 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:55:07.903 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:55:07.903 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:55:07.906 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:55:07.906 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:55:09.278 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:55:09.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:55:09.419+0000 7f2b4e511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:55:09.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:55:09.428+0000 7f2b4e511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:55:12.165 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:55:12.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:55:12.291+0000 7fea12063640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:55:12.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:55:12.302+0000 7fea12063640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:55:12.906 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:55:12.907 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-22T03:55:13.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:55:13.049+0000 7fdd7c591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:55:13.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:55:13.071+0000 7fdd7c591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:55:14.094 INFO:teuthology.orchestra.run.smithi037.stderr:reweighted osd.0 to 1 (10000) 2024-09-22T03:55:14.115 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-22T03:55:14.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:55:14.256+0000 7f8140d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:55:14.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:55:14.270+0000 7f8140d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:55:14.775 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:55:14.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:55:14.923+0000 7f734e67f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:55:14.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:55:14.933+0000 7f734e67f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:55:15.103 INFO:teuthology.orchestra.run.smithi037.stderr:reweighted osd.1 to 1 (10000) 2024-09-22T03:55:15.125 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-22T03:55:15.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:55:15.270+0000 7fda25efd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:55:15.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:55:15.285+0000 7fda25efd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:55:16.103 INFO:teuthology.orchestra.run.smithi037.stderr:reweighted osd.2 to 1 (10000) 2024-09-22T03:55:16.127 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-22T03:55:16.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:55:16.286+0000 7f1ea8aa3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:55:16.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:55:16.302+0000 7f1ea8aa3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:55:17.109 INFO:teuthology.orchestra.run.smithi037.stderr:reweighted osd.3 to 1 (10000) 2024-09-22T03:55:17.127 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-22T03:55:17.127 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:55:17.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:55:17.270+0000 7f8ad90a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:55:17.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:55:17.280+0000 7f8ad90a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:55:17.539 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:55:17.544 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:55:17.544 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-22T03:55:17.567 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":224,"stamp":"2024-09-22T03:55:17.111596+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":270467659,"num_objects":4123,"num_object_clones":0,"num_object_copies":12369,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":27048,"num_write_kb":995797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":27022,"ondisk_log_size":27022,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":332572,"kb_used_data":51740,"kb_used_omap":0,"kb_used_meta":280768,"kb_avail":377154788,"statfs":{"total":386547056640,"available":386206502912,"internally_reserved":0,"allocated":52981760,"data_stored":822937474,"data_compressed":39058632,"data_compressed_allocated":51412992,"data_compressed_original":822362112,"omap_allocated":0,"internal_metadata":287506432},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-53018624,"num_objects":-809,"num_object_clones":0,"num_object_copies":-2427,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":809,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.072232"},"pg_stats":[{"pgid":"4.f","version":"45'1669","reported_seq":1702,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:55:16.137840+0000","last_change":"2024-09-22T03:52:38.267363+0000","last_active":"2024-09-22T03:55:16.137840+0000","last_peered":"2024-09-22T03:55:16.137840+0000","last_clean":"2024-09-22T03:55:16.137840+0000","last_became_active":"2024-09-22T03:52:38.261984+0000","last_became_peered":"2024-09-22T03:52:38.261984+0000","last_unstale":"2024-09-22T03:55:16.137840+0000","last_undegraded":"2024-09-22T03:55:16.137840+0000","last_fullsized":"2024-09-22T03:55:16.137840+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1669,"log_dups_size":0,"ondisk_log_size":1669,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17760256,"num_objects":271,"num_object_clones":0,"num_object_copies":813,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1669,"num_write_kb":62080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"45'1685","reported_seq":1718,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:55:16.128351+0000","last_change":"2024-09-22T03:52:38.211390+0000","last_active":"2024-09-22T03:55:16.128351+0000","last_peered":"2024-09-22T03:55:16.128351+0000","last_clean":"2024-09-22T03:55:16.128351+0000","last_became_active":"2024-09-22T03:52:38.190969+0000","last_became_peered":"2024-09-22T03:52:38.190969+0000","last_unstale":"2024-09-22T03:55:16.128351+0000","last_undegraded":"2024-09-22T03:55:16.128351+0000","last_fullsized":"2024-09-22T03:55:16.128351+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1685,"log_dups_size":0,"ondisk_log_size":1685,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16187392,"num_objects":247,"num_object_clones":0,"num_object_copies":741,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1685,"num_write_kb":61824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"44'1630","reported_seq":1658,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-22T03:55:14.815614+0000","last_change":"2024-09-22T03:52:38.196399+0000","last_active":"2024-09-22T03:55:14.815614+0000","last_peered":"2024-09-22T03:55:14.815614+0000","last_clean":"2024-09-22T03:55:14.815614+0000","last_became_active":"2024-09-22T03:52:38.183573+0000","last_became_peered":"2024-09-22T03:52:38.183573+0000","last_unstale":"2024-09-22T03:55:14.815614+0000","last_undegraded":"2024-09-22T03:55:14.815614+0000","last_fullsized":"2024-09-22T03:55:14.815614+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1630,"log_dups_size":0,"ondisk_log_size":1630,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16449560,"num_objects":252,"num_object_clones":0,"num_object_copies":756,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1630,"num_write_kb":60161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"44'1627","reported_seq":1654,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-22T03:55:15.026530+0000","last_change":"2024-09-22T03:52:38.241973+0000","last_active":"2024-09-22T03:55:15.026530+0000","last_peered":"2024-09-22T03:55:15.026530+0000","last_clean":"2024-09-22T03:55:15.026530+0000","last_became_active":"2024-09-22T03:52:38.234357+0000","last_became_peered":"2024-09-22T03:52:38.234357+0000","last_unstale":"2024-09-22T03:55:15.026530+0000","last_undegraded":"2024-09-22T03:55:15.026530+0000","last_fullsized":"2024-09-22T03:55:15.026530+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1627,"log_dups_size":0,"ondisk_log_size":1627,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15925248,"num_objects":243,"num_object_clones":0,"num_object_copies":729,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1627,"num_write_kb":59840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"44'1598","reported_seq":1625,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-22T03:55:14.909625+0000","last_change":"2024-09-22T03:52:38.234728+0000","last_active":"2024-09-22T03:55:14.909625+0000","last_peered":"2024-09-22T03:55:14.909625+0000","last_clean":"2024-09-22T03:55:14.909625+0000","last_became_active":"2024-09-22T03:52:38.221861+0000","last_became_peered":"2024-09-22T03:52:38.221861+0000","last_unstale":"2024-09-22T03:55:14.909625+0000","last_undegraded":"2024-09-22T03:55:14.909625+0000","last_fullsized":"2024-09-22T03:55:14.909625+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1598,"log_dups_size":0,"ondisk_log_size":1598,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17694720,"num_objects":270,"num_object_clones":0,"num_object_copies":810,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1598,"num_write_kb":59776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"44'1715","reported_seq":1742,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-22T03:55:14.962709+0000","last_change":"2024-09-22T03:52:38.235904+0000","last_active":"2024-09-22T03:55:14.962709+0000","last_peered":"2024-09-22T03:55:14.962709+0000","last_clean":"2024-09-22T03:55:14.962709+0000","last_became_active":"2024-09-22T03:52:38.225232+0000","last_became_peered":"2024-09-22T03:52:38.225232+0000","last_unstale":"2024-09-22T03:55:14.962709+0000","last_undegraded":"2024-09-22T03:55:14.962709+0000","last_fullsized":"2024-09-22T03:55:14.962709+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1715,"log_dups_size":0,"ondisk_log_size":1715,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17367040,"num_objects":265,"num_object_clones":0,"num_object_copies":795,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1715,"num_write_kb":63360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"44'1746","reported_seq":1773,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-22T03:55:14.827714+0000","last_change":"2024-09-22T03:52:38.200669+0000","last_active":"2024-09-22T03:55:14.827714+0000","last_peered":"2024-09-22T03:55:14.827714+0000","last_clean":"2024-09-22T03:55:14.827714+0000","last_became_active":"2024-09-22T03:52:38.190269+0000","last_became_peered":"2024-09-22T03:52:38.190269+0000","last_unstale":"2024-09-22T03:55:14.827714+0000","last_undegraded":"2024-09-22T03:55:14.827714+0000","last_fullsized":"2024-09-22T03:55:14.827714+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1746,"log_dups_size":0,"ondisk_log_size":1746,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16646144,"num_objects":254,"num_object_clones":0,"num_object_copies":762,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1746,"num_write_kb":64000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"44'1698","reported_seq":1725,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-22T03:55:14.958039+0000","last_change":"2024-09-22T03:52:38.177831+0000","last_active":"2024-09-22T03:55:14.958039+0000","last_peered":"2024-09-22T03:55:14.958039+0000","last_clean":"2024-09-22T03:55:14.958039+0000","last_became_active":"2024-09-22T03:52:38.169555+0000","last_became_peered":"2024-09-22T03:52:38.169555+0000","last_unstale":"2024-09-22T03:55:14.958039+0000","last_undegraded":"2024-09-22T03:55:14.958039+0000","last_fullsized":"2024-09-22T03:55:14.958039+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1698,"log_dups_size":0,"ondisk_log_size":1698,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18087936,"num_objects":276,"num_object_clones":0,"num_object_copies":828,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1698,"num_write_kb":63168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"44'1649","reported_seq":1676,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-22T03:55:14.970652+0000","last_change":"2024-09-22T03:52:38.267240+0000","last_active":"2024-09-22T03:55:14.970652+0000","last_peered":"2024-09-22T03:55:14.970652+0000","last_clean":"2024-09-22T03:55:14.970652+0000","last_became_active":"2024-09-22T03:52:38.252880+0000","last_became_peered":"2024-09-22T03:52:38.252880+0000","last_unstale":"2024-09-22T03:55:14.970652+0000","last_undegraded":"2024-09-22T03:55:14.970652+0000","last_fullsized":"2024-09-22T03:55:14.970652+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1649,"log_dups_size":0,"ondisk_log_size":1649,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18022400,"num_objects":275,"num_object_clones":0,"num_object_copies":825,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1649,"num_write_kb":61568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":181,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:55:16.125721+0000","last_change":"2024-09-22T03:49:12.034704+0000","last_active":"2024-09-22T03:55:16.125721+0000","last_peered":"2024-09-22T03:55:16.125721+0000","last_clean":"2024-09-22T03:55:16.125721+0000","last_became_active":"2024-09-22T03:49:12.027470+0000","last_became_peered":"2024-09-22T03:49:12.027470+0000","last_unstale":"2024-09-22T03:55:16.125721+0000","last_undegraded":"2024-09-22T03:55:16.125721+0000","last_fullsized":"2024-09-22T03:55:16.125721+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_clean_scrub_stamp":"2024-09-22T03:49:10.979949+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":101,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-22T03:55:14.138147+0000","last_change":"2024-09-22T03:49:17.031458+0000","last_active":"2024-09-22T03:55:14.138147+0000","last_peered":"2024-09-22T03:55:14.138147+0000","last_clean":"2024-09-22T03:55:14.138147+0000","last_became_active":"2024-09-22T03:49:15.125490+0000","last_became_peered":"2024-09-22T03:49:15.125490+0000","last_unstale":"2024-09-22T03:55:14.138147+0000","last_undegraded":"2024-09-22T03:55:14.138147+0000","last_fullsized":"2024-09-22T03:55:14.138147+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"44'1604","reported_seq":1631,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-22T03:55:14.929796+0000","last_change":"2024-09-22T03:52:38.263115+0000","last_active":"2024-09-22T03:55:14.929796+0000","last_peered":"2024-09-22T03:55:14.929796+0000","last_clean":"2024-09-22T03:55:14.929796+0000","last_became_active":"2024-09-22T03:52:38.245622+0000","last_became_peered":"2024-09-22T03:52:38.245622+0000","last_unstale":"2024-09-22T03:55:14.929796+0000","last_undegraded":"2024-09-22T03:55:14.929796+0000","last_fullsized":"2024-09-22T03:55:14.929796+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1604,"log_dups_size":0,"ondisk_log_size":1604,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18219008,"num_objects":278,"num_object_clones":0,"num_object_copies":834,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1604,"num_write_kb":60224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":100,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-22T03:55:14.133720+0000","last_change":"2024-09-22T03:49:17.029339+0000","last_active":"2024-09-22T03:55:14.133720+0000","last_peered":"2024-09-22T03:55:14.133720+0000","last_clean":"2024-09-22T03:55:14.133720+0000","last_became_active":"2024-09-22T03:49:15.097304+0000","last_became_peered":"2024-09-22T03:49:15.097304+0000","last_unstale":"2024-09-22T03:55:14.133720+0000","last_undegraded":"2024-09-22T03:55:14.133720+0000","last_fullsized":"2024-09-22T03:55:14.133720+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"45'1776","reported_seq":1809,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:55:16.133679+0000","last_change":"2024-09-22T03:52:38.234061+0000","last_active":"2024-09-22T03:55:16.133679+0000","last_peered":"2024-09-22T03:55:16.133679+0000","last_clean":"2024-09-22T03:55:16.133679+0000","last_became_active":"2024-09-22T03:52:38.222894+0000","last_became_peered":"2024-09-22T03:52:38.222894+0000","last_unstale":"2024-09-22T03:55:16.133679+0000","last_undegraded":"2024-09-22T03:55:16.133679+0000","last_fullsized":"2024-09-22T03:55:16.133679+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1776,"log_dups_size":0,"ondisk_log_size":1776,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15728640,"num_objects":240,"num_object_clones":0,"num_object_copies":720,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1776,"num_write_kb":64512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":100,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-22T03:55:14.150462+0000","last_change":"2024-09-22T03:49:17.029349+0000","last_active":"2024-09-22T03:55:14.150462+0000","last_peered":"2024-09-22T03:55:14.150462+0000","last_clean":"2024-09-22T03:55:14.150462+0000","last_became_active":"2024-09-22T03:49:15.094890+0000","last_became_peered":"2024-09-22T03:49:15.094890+0000","last_unstale":"2024-09-22T03:55:14.150462+0000","last_undegraded":"2024-09-22T03:55:14.150462+0000","last_fullsized":"2024-09-22T03:55:14.150462+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"45'1808","reported_seq":1841,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:55:16.132291+0000","last_change":"2024-09-22T03:52:38.248145+0000","last_active":"2024-09-22T03:55:16.132291+0000","last_peered":"2024-09-22T03:55:16.132291+0000","last_clean":"2024-09-22T03:55:16.132291+0000","last_became_active":"2024-09-22T03:52:38.241420+0000","last_became_peered":"2024-09-22T03:52:38.241420+0000","last_unstale":"2024-09-22T03:55:16.132291+0000","last_undegraded":"2024-09-22T03:55:16.132291+0000","last_fullsized":"2024-09-22T03:55:16.132291+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1808,"log_dups_size":0,"ondisk_log_size":1808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":256,"num_object_clones":0,"num_object_copies":768,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1808,"num_write_kb":66048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":102,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-22T03:55:14.146347+0000","last_change":"2024-09-22T03:49:17.031466+0000","last_active":"2024-09-22T03:55:14.146347+0000","last_peered":"2024-09-22T03:55:14.146347+0000","last_clean":"2024-09-22T03:55:14.146347+0000","last_became_active":"2024-09-22T03:49:15.098420+0000","last_became_peered":"2024-09-22T03:49:15.098420+0000","last_unstale":"2024-09-22T03:55:14.146347+0000","last_undegraded":"2024-09-22T03:55:14.146347+0000","last_fullsized":"2024-09-22T03:55:14.146347+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2","version":"44'1663","reported_seq":1690,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-22T03:55:14.878608+0000","last_change":"2024-09-22T03:52:38.215825+0000","last_active":"2024-09-22T03:55:14.878608+0000","last_peered":"2024-09-22T03:55:14.878608+0000","last_clean":"2024-09-22T03:55:14.878608+0000","last_became_active":"2024-09-22T03:52:38.203741+0000","last_became_peered":"2024-09-22T03:52:38.203741+0000","last_unstale":"2024-09-22T03:55:14.878608+0000","last_undegraded":"2024-09-22T03:55:14.878608+0000","last_fullsized":"2024-09-22T03:55:14.878608+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1663,"log_dups_size":0,"ondisk_log_size":1663,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16842752,"num_objects":257,"num_object_clones":0,"num_object_copies":771,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1663,"num_write_kb":61440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":106,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:55:16.134809+0000","last_change":"2024-09-22T03:49:17.036954+0000","last_active":"2024-09-22T03:55:16.134809+0000","last_peered":"2024-09-22T03:55:16.134809+0000","last_clean":"2024-09-22T03:55:16.134809+0000","last_became_active":"2024-09-22T03:49:15.110506+0000","last_became_peered":"2024-09-22T03:49:15.110506+0000","last_unstale":"2024-09-22T03:55:16.134809+0000","last_undegraded":"2024-09-22T03:55:16.134809+0000","last_fullsized":"2024-09-22T03:55:16.134809+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"44'1728","reported_seq":1755,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-22T03:55:14.536775+0000","last_change":"2024-09-22T03:52:38.239558+0000","last_active":"2024-09-22T03:55:14.536775+0000","last_peered":"2024-09-22T03:55:14.536775+0000","last_clean":"2024-09-22T03:55:14.536775+0000","last_became_active":"2024-09-22T03:52:38.229931+0000","last_became_peered":"2024-09-22T03:52:38.229931+0000","last_unstale":"2024-09-22T03:55:14.536775+0000","last_undegraded":"2024-09-22T03:55:14.536775+0000","last_fullsized":"2024-09-22T03:55:14.536775+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1728,"log_dups_size":0,"ondisk_log_size":1728,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16384000,"num_objects":250,"num_object_clones":0,"num_object_copies":750,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1728,"num_write_kb":63296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":106,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:55:16.129585+0000","last_change":"2024-09-22T03:49:17.032989+0000","last_active":"2024-09-22T03:55:16.129585+0000","last_peered":"2024-09-22T03:55:16.129585+0000","last_clean":"2024-09-22T03:55:16.129585+0000","last_became_active":"2024-09-22T03:49:15.079260+0000","last_became_peered":"2024-09-22T03:49:15.079260+0000","last_unstale":"2024-09-22T03:55:16.129585+0000","last_undegraded":"2024-09-22T03:55:16.129585+0000","last_fullsized":"2024-09-22T03:55:16.129585+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"44'1711","reported_seq":1738,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-22T03:55:15.006594+0000","last_change":"2024-09-22T03:52:38.258650+0000","last_active":"2024-09-22T03:55:15.006594+0000","last_peered":"2024-09-22T03:55:15.006594+0000","last_clean":"2024-09-22T03:55:15.006594+0000","last_became_active":"2024-09-22T03:52:38.238553+0000","last_became_peered":"2024-09-22T03:52:38.238553+0000","last_unstale":"2024-09-22T03:55:15.006594+0000","last_undegraded":"2024-09-22T03:55:15.006594+0000","last_fullsized":"2024-09-22T03:55:15.006594+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1711,"log_dups_size":0,"ondisk_log_size":1711,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16711680,"num_objects":255,"num_object_clones":0,"num_object_copies":765,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1711,"num_write_kb":62912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":106,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:55:16.134603+0000","last_change":"2024-09-22T03:49:17.036402+0000","last_active":"2024-09-22T03:55:16.134603+0000","last_peered":"2024-09-22T03:55:16.134603+0000","last_clean":"2024-09-22T03:55:16.134603+0000","last_became_active":"2024-09-22T03:49:15.108430+0000","last_became_peered":"2024-09-22T03:49:15.108430+0000","last_unstale":"2024-09-22T03:55:16.134603+0000","last_undegraded":"2024-09-22T03:55:16.134603+0000","last_fullsized":"2024-09-22T03:55:16.134603+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"44'1660","reported_seq":1687,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-22T03:55:14.807309+0000","last_change":"2024-09-22T03:52:38.208326+0000","last_active":"2024-09-22T03:55:14.807309+0000","last_peered":"2024-09-22T03:55:14.807309+0000","last_clean":"2024-09-22T03:55:14.807309+0000","last_became_active":"2024-09-22T03:52:38.200509+0000","last_became_peered":"2024-09-22T03:52:38.200509+0000","last_unstale":"2024-09-22T03:55:14.807309+0000","last_undegraded":"2024-09-22T03:55:14.807309+0000","last_fullsized":"2024-09-22T03:55:14.807309+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1660,"log_dups_size":0,"ondisk_log_size":1660,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15073280,"num_objects":230,"num_object_clones":0,"num_object_copies":690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1660,"num_write_kb":60480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":100,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-22T03:55:14.134318+0000","last_change":"2024-09-22T03:49:17.029128+0000","last_active":"2024-09-22T03:55:14.134318+0000","last_peered":"2024-09-22T03:55:14.134318+0000","last_clean":"2024-09-22T03:55:14.134318+0000","last_became_active":"2024-09-22T03:49:15.113396+0000","last_became_peered":"2024-09-22T03:49:15.113396+0000","last_unstale":"2024-09-22T03:55:14.134318+0000","last_undegraded":"2024-09-22T03:55:14.134318+0000","last_fullsized":"2024-09-22T03:55:14.134318+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":269877272,"num_objects":4119,"num_object_clones":0,"num_object_copies":12357,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":26967,"num_write_kb":994689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":50728960,"data_stored":811466824,"data_compressed":38532784,"data_compressed_allocated":50716672,"data_compressed_original":811466752,"omap_allocated":0,"internal_metadata":0},"log_size":26967,"ondisk_log_size":26967,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949673324,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":86972,"kb_used_data":11564,"kb_used_omap":0,"kb_used_meta":75392,"kb_avail":94284868,"statfs":{"total":96636764160,"available":96547704832,"internally_reserved":0,"allocated":11841536,"data_stored":183045130,"data_compressed":8687640,"data_compressed_allocated":11436032,"data_compressed_original":182894592,"omap_allocated":0,"internal_metadata":77201408},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654706028,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":86552,"kb_used_data":15304,"kb_used_omap":0,"kb_used_meta":71232,"kb_avail":94285288,"statfs":{"total":96636764160,"available":96548134912,"internally_reserved":0,"allocated":15671296,"data_stored":244841761,"data_compressed":11620208,"data_compressed_allocated":15294464,"data_compressed_original":244711424,"omap_allocated":0,"internal_metadata":72941568},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706028,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":86360,"kb_used_data":15112,"kb_used_omap":0,"kb_used_meta":71232,"kb_avail":94285480,"statfs":{"total":96636764160,"available":96548331520,"internally_reserved":0,"allocated":15474688,"data_stored":241303361,"data_compressed":11454208,"data_compressed_allocated":15077376,"data_compressed_original":241156096,"omap_allocated":0,"internal_metadata":72941568},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706028,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":72688,"kb_used_data":9760,"kb_used_omap":0,"kb_used_meta":62912,"kb_avail":94299152,"statfs":{"total":96636764160,"available":96562331648,"internally_reserved":0,"allocated":9994240,"data_stored":153747222,"data_compressed":7296576,"data_compressed_allocated":9605120,"data_compressed_original":153600000,"omap_allocated":0,"internal_metadata":64421888},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":9433088,"data_stored":150929408,"data_compressed":7166936,"data_compressed_allocated":9433088,"data_compressed_original":150929408,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":11300864,"data_stored":180748312,"data_compressed":8582896,"data_compressed_allocated":11296768,"data_compressed_original":180748288,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":14901248,"data_stored":238354456,"data_compressed":11318344,"data_compressed_allocated":14897152,"data_compressed_original":238354432,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":15093760,"data_stored":241434648,"data_compressed":11464608,"data_compressed_allocated":15089664,"data_compressed_original":241434624,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:55:17.568 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:55:17.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:55:17.709+0000 7ff53e646640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:55:17.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:55:17.723+0000 7ff53e646640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:55:17.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:55:17.742+0000 7fefec991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:55:17.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:55:17.754+0000 7fefec991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:55:18.123 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:55:18.123 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-22T03:55:18.142 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":224,"stamp":"2024-09-22T03:55:17.111596+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":270467659,"num_objects":4123,"num_object_clones":0,"num_object_copies":12369,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":27048,"num_write_kb":995797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":27022,"ondisk_log_size":27022,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":332572,"kb_used_data":51740,"kb_used_omap":0,"kb_used_meta":280768,"kb_avail":377154788,"statfs":{"total":386547056640,"available":386206502912,"internally_reserved":0,"allocated":52981760,"data_stored":822937474,"data_compressed":39058632,"data_compressed_allocated":51412992,"data_compressed_original":822362112,"omap_allocated":0,"internal_metadata":287506432},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-53018624,"num_objects":-809,"num_object_clones":0,"num_object_copies":-2427,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":809,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.072232"},"pg_stats":[{"pgid":"4.f","version":"45'1669","reported_seq":1702,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:55:16.137840+0000","last_change":"2024-09-22T03:52:38.267363+0000","last_active":"2024-09-22T03:55:16.137840+0000","last_peered":"2024-09-22T03:55:16.137840+0000","last_clean":"2024-09-22T03:55:16.137840+0000","last_became_active":"2024-09-22T03:52:38.261984+0000","last_became_peered":"2024-09-22T03:52:38.261984+0000","last_unstale":"2024-09-22T03:55:16.137840+0000","last_undegraded":"2024-09-22T03:55:16.137840+0000","last_fullsized":"2024-09-22T03:55:16.137840+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1669,"log_dups_size":0,"ondisk_log_size":1669,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17760256,"num_objects":271,"num_object_clones":0,"num_object_copies":813,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1669,"num_write_kb":62080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"45'1685","reported_seq":1718,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:55:16.128351+0000","last_change":"2024-09-22T03:52:38.211390+0000","last_active":"2024-09-22T03:55:16.128351+0000","last_peered":"2024-09-22T03:55:16.128351+0000","last_clean":"2024-09-22T03:55:16.128351+0000","last_became_active":"2024-09-22T03:52:38.190969+0000","last_became_peered":"2024-09-22T03:52:38.190969+0000","last_unstale":"2024-09-22T03:55:16.128351+0000","last_undegraded":"2024-09-22T03:55:16.128351+0000","last_fullsized":"2024-09-22T03:55:16.128351+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1685,"log_dups_size":0,"ondisk_log_size":1685,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16187392,"num_objects":247,"num_object_clones":0,"num_object_copies":741,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1685,"num_write_kb":61824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"44'1630","reported_seq":1658,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-22T03:55:14.815614+0000","last_change":"2024-09-22T03:52:38.196399+0000","last_active":"2024-09-22T03:55:14.815614+0000","last_peered":"2024-09-22T03:55:14.815614+0000","last_clean":"2024-09-22T03:55:14.815614+0000","last_became_active":"2024-09-22T03:52:38.183573+0000","last_became_peered":"2024-09-22T03:52:38.183573+0000","last_unstale":"2024-09-22T03:55:14.815614+0000","last_undegraded":"2024-09-22T03:55:14.815614+0000","last_fullsized":"2024-09-22T03:55:14.815614+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1630,"log_dups_size":0,"ondisk_log_size":1630,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16449560,"num_objects":252,"num_object_clones":0,"num_object_copies":756,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1630,"num_write_kb":60161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"44'1627","reported_seq":1654,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-22T03:55:15.026530+0000","last_change":"2024-09-22T03:52:38.241973+0000","last_active":"2024-09-22T03:55:15.026530+0000","last_peered":"2024-09-22T03:55:15.026530+0000","last_clean":"2024-09-22T03:55:15.026530+0000","last_became_active":"2024-09-22T03:52:38.234357+0000","last_became_peered":"2024-09-22T03:52:38.234357+0000","last_unstale":"2024-09-22T03:55:15.026530+0000","last_undegraded":"2024-09-22T03:55:15.026530+0000","last_fullsized":"2024-09-22T03:55:15.026530+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1627,"log_dups_size":0,"ondisk_log_size":1627,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15925248,"num_objects":243,"num_object_clones":0,"num_object_copies":729,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1627,"num_write_kb":59840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"44'1598","reported_seq":1625,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-22T03:55:14.909625+0000","last_change":"2024-09-22T03:52:38.234728+0000","last_active":"2024-09-22T03:55:14.909625+0000","last_peered":"2024-09-22T03:55:14.909625+0000","last_clean":"2024-09-22T03:55:14.909625+0000","last_became_active":"2024-09-22T03:52:38.221861+0000","last_became_peered":"2024-09-22T03:52:38.221861+0000","last_unstale":"2024-09-22T03:55:14.909625+0000","last_undegraded":"2024-09-22T03:55:14.909625+0000","last_fullsized":"2024-09-22T03:55:14.909625+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1598,"log_dups_size":0,"ondisk_log_size":1598,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17694720,"num_objects":270,"num_object_clones":0,"num_object_copies":810,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1598,"num_write_kb":59776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"44'1715","reported_seq":1742,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-22T03:55:14.962709+0000","last_change":"2024-09-22T03:52:38.235904+0000","last_active":"2024-09-22T03:55:14.962709+0000","last_peered":"2024-09-22T03:55:14.962709+0000","last_clean":"2024-09-22T03:55:14.962709+0000","last_became_active":"2024-09-22T03:52:38.225232+0000","last_became_peered":"2024-09-22T03:52:38.225232+0000","last_unstale":"2024-09-22T03:55:14.962709+0000","last_undegraded":"2024-09-22T03:55:14.962709+0000","last_fullsized":"2024-09-22T03:55:14.962709+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1715,"log_dups_size":0,"ondisk_log_size":1715,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17367040,"num_objects":265,"num_object_clones":0,"num_object_copies":795,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1715,"num_write_kb":63360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"44'1746","reported_seq":1773,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-22T03:55:14.827714+0000","last_change":"2024-09-22T03:52:38.200669+0000","last_active":"2024-09-22T03:55:14.827714+0000","last_peered":"2024-09-22T03:55:14.827714+0000","last_clean":"2024-09-22T03:55:14.827714+0000","last_became_active":"2024-09-22T03:52:38.190269+0000","last_became_peered":"2024-09-22T03:52:38.190269+0000","last_unstale":"2024-09-22T03:55:14.827714+0000","last_undegraded":"2024-09-22T03:55:14.827714+0000","last_fullsized":"2024-09-22T03:55:14.827714+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1746,"log_dups_size":0,"ondisk_log_size":1746,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16646144,"num_objects":254,"num_object_clones":0,"num_object_copies":762,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1746,"num_write_kb":64000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"44'1698","reported_seq":1725,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-22T03:55:14.958039+0000","last_change":"2024-09-22T03:52:38.177831+0000","last_active":"2024-09-22T03:55:14.958039+0000","last_peered":"2024-09-22T03:55:14.958039+0000","last_clean":"2024-09-22T03:55:14.958039+0000","last_became_active":"2024-09-22T03:52:38.169555+0000","last_became_peered":"2024-09-22T03:52:38.169555+0000","last_unstale":"2024-09-22T03:55:14.958039+0000","last_undegraded":"2024-09-22T03:55:14.958039+0000","last_fullsized":"2024-09-22T03:55:14.958039+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1698,"log_dups_size":0,"ondisk_log_size":1698,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18087936,"num_objects":276,"num_object_clones":0,"num_object_copies":828,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1698,"num_write_kb":63168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"44'1649","reported_seq":1676,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-22T03:55:14.970652+0000","last_change":"2024-09-22T03:52:38.267240+0000","last_active":"2024-09-22T03:55:14.970652+0000","last_peered":"2024-09-22T03:55:14.970652+0000","last_clean":"2024-09-22T03:55:14.970652+0000","last_became_active":"2024-09-22T03:52:38.252880+0000","last_became_peered":"2024-09-22T03:52:38.252880+0000","last_unstale":"2024-09-22T03:55:14.970652+0000","last_undegraded":"2024-09-22T03:55:14.970652+0000","last_fullsized":"2024-09-22T03:55:14.970652+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1649,"log_dups_size":0,"ondisk_log_size":1649,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18022400,"num_objects":275,"num_object_clones":0,"num_object_copies":825,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1649,"num_write_kb":61568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":181,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:55:16.125721+0000","last_change":"2024-09-22T03:49:12.034704+0000","last_active":"2024-09-22T03:55:16.125721+0000","last_peered":"2024-09-22T03:55:16.125721+0000","last_clean":"2024-09-22T03:55:16.125721+0000","last_became_active":"2024-09-22T03:49:12.027470+0000","last_became_peered":"2024-09-22T03:49:12.027470+0000","last_unstale":"2024-09-22T03:55:16.125721+0000","last_undegraded":"2024-09-22T03:55:16.125721+0000","last_fullsized":"2024-09-22T03:55:16.125721+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_clean_scrub_stamp":"2024-09-22T03:49:10.979949+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":101,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-22T03:55:14.138147+0000","last_change":"2024-09-22T03:49:17.031458+0000","last_active":"2024-09-22T03:55:14.138147+0000","last_peered":"2024-09-22T03:55:14.138147+0000","last_clean":"2024-09-22T03:55:14.138147+0000","last_became_active":"2024-09-22T03:49:15.125490+0000","last_became_peered":"2024-09-22T03:49:15.125490+0000","last_unstale":"2024-09-22T03:55:14.138147+0000","last_undegraded":"2024-09-22T03:55:14.138147+0000","last_fullsized":"2024-09-22T03:55:14.138147+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"44'1604","reported_seq":1631,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-22T03:55:14.929796+0000","last_change":"2024-09-22T03:52:38.263115+0000","last_active":"2024-09-22T03:55:14.929796+0000","last_peered":"2024-09-22T03:55:14.929796+0000","last_clean":"2024-09-22T03:55:14.929796+0000","last_became_active":"2024-09-22T03:52:38.245622+0000","last_became_peered":"2024-09-22T03:52:38.245622+0000","last_unstale":"2024-09-22T03:55:14.929796+0000","last_undegraded":"2024-09-22T03:55:14.929796+0000","last_fullsized":"2024-09-22T03:55:14.929796+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1604,"log_dups_size":0,"ondisk_log_size":1604,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18219008,"num_objects":278,"num_object_clones":0,"num_object_copies":834,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1604,"num_write_kb":60224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":100,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-22T03:55:14.133720+0000","last_change":"2024-09-22T03:49:17.029339+0000","last_active":"2024-09-22T03:55:14.133720+0000","last_peered":"2024-09-22T03:55:14.133720+0000","last_clean":"2024-09-22T03:55:14.133720+0000","last_became_active":"2024-09-22T03:49:15.097304+0000","last_became_peered":"2024-09-22T03:49:15.097304+0000","last_unstale":"2024-09-22T03:55:14.133720+0000","last_undegraded":"2024-09-22T03:55:14.133720+0000","last_fullsized":"2024-09-22T03:55:14.133720+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"45'1776","reported_seq":1809,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:55:16.133679+0000","last_change":"2024-09-22T03:52:38.234061+0000","last_active":"2024-09-22T03:55:16.133679+0000","last_peered":"2024-09-22T03:55:16.133679+0000","last_clean":"2024-09-22T03:55:16.133679+0000","last_became_active":"2024-09-22T03:52:38.222894+0000","last_became_peered":"2024-09-22T03:52:38.222894+0000","last_unstale":"2024-09-22T03:55:16.133679+0000","last_undegraded":"2024-09-22T03:55:16.133679+0000","last_fullsized":"2024-09-22T03:55:16.133679+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1776,"log_dups_size":0,"ondisk_log_size":1776,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15728640,"num_objects":240,"num_object_clones":0,"num_object_copies":720,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1776,"num_write_kb":64512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":100,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-22T03:55:14.150462+0000","last_change":"2024-09-22T03:49:17.029349+0000","last_active":"2024-09-22T03:55:14.150462+0000","last_peered":"2024-09-22T03:55:14.150462+0000","last_clean":"2024-09-22T03:55:14.150462+0000","last_became_active":"2024-09-22T03:49:15.094890+0000","last_became_peered":"2024-09-22T03:49:15.094890+0000","last_unstale":"2024-09-22T03:55:14.150462+0000","last_undegraded":"2024-09-22T03:55:14.150462+0000","last_fullsized":"2024-09-22T03:55:14.150462+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"45'1808","reported_seq":1841,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:55:16.132291+0000","last_change":"2024-09-22T03:52:38.248145+0000","last_active":"2024-09-22T03:55:16.132291+0000","last_peered":"2024-09-22T03:55:16.132291+0000","last_clean":"2024-09-22T03:55:16.132291+0000","last_became_active":"2024-09-22T03:52:38.241420+0000","last_became_peered":"2024-09-22T03:52:38.241420+0000","last_unstale":"2024-09-22T03:55:16.132291+0000","last_undegraded":"2024-09-22T03:55:16.132291+0000","last_fullsized":"2024-09-22T03:55:16.132291+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1808,"log_dups_size":0,"ondisk_log_size":1808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":256,"num_object_clones":0,"num_object_copies":768,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1808,"num_write_kb":66048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":102,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-22T03:55:14.146347+0000","last_change":"2024-09-22T03:49:17.031466+0000","last_active":"2024-09-22T03:55:14.146347+0000","last_peered":"2024-09-22T03:55:14.146347+0000","last_clean":"2024-09-22T03:55:14.146347+0000","last_became_active":"2024-09-22T03:49:15.098420+0000","last_became_peered":"2024-09-22T03:49:15.098420+0000","last_unstale":"2024-09-22T03:55:14.146347+0000","last_undegraded":"2024-09-22T03:55:14.146347+0000","last_fullsized":"2024-09-22T03:55:14.146347+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2","version":"44'1663","reported_seq":1690,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-22T03:55:14.878608+0000","last_change":"2024-09-22T03:52:38.215825+0000","last_active":"2024-09-22T03:55:14.878608+0000","last_peered":"2024-09-22T03:55:14.878608+0000","last_clean":"2024-09-22T03:55:14.878608+0000","last_became_active":"2024-09-22T03:52:38.203741+0000","last_became_peered":"2024-09-22T03:52:38.203741+0000","last_unstale":"2024-09-22T03:55:14.878608+0000","last_undegraded":"2024-09-22T03:55:14.878608+0000","last_fullsized":"2024-09-22T03:55:14.878608+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1663,"log_dups_size":0,"ondisk_log_size":1663,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16842752,"num_objects":257,"num_object_clones":0,"num_object_copies":771,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1663,"num_write_kb":61440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":106,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:55:16.134809+0000","last_change":"2024-09-22T03:49:17.036954+0000","last_active":"2024-09-22T03:55:16.134809+0000","last_peered":"2024-09-22T03:55:16.134809+0000","last_clean":"2024-09-22T03:55:16.134809+0000","last_became_active":"2024-09-22T03:49:15.110506+0000","last_became_peered":"2024-09-22T03:49:15.110506+0000","last_unstale":"2024-09-22T03:55:16.134809+0000","last_undegraded":"2024-09-22T03:55:16.134809+0000","last_fullsized":"2024-09-22T03:55:16.134809+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"44'1728","reported_seq":1755,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-22T03:55:14.536775+0000","last_change":"2024-09-22T03:52:38.239558+0000","last_active":"2024-09-22T03:55:14.536775+0000","last_peered":"2024-09-22T03:55:14.536775+0000","last_clean":"2024-09-22T03:55:14.536775+0000","last_became_active":"2024-09-22T03:52:38.229931+0000","last_became_peered":"2024-09-22T03:52:38.229931+0000","last_unstale":"2024-09-22T03:55:14.536775+0000","last_undegraded":"2024-09-22T03:55:14.536775+0000","last_fullsized":"2024-09-22T03:55:14.536775+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1728,"log_dups_size":0,"ondisk_log_size":1728,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16384000,"num_objects":250,"num_object_clones":0,"num_object_copies":750,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1728,"num_write_kb":63296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":106,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:55:16.129585+0000","last_change":"2024-09-22T03:49:17.032989+0000","last_active":"2024-09-22T03:55:16.129585+0000","last_peered":"2024-09-22T03:55:16.129585+0000","last_clean":"2024-09-22T03:55:16.129585+0000","last_became_active":"2024-09-22T03:49:15.079260+0000","last_became_peered":"2024-09-22T03:49:15.079260+0000","last_unstale":"2024-09-22T03:55:16.129585+0000","last_undegraded":"2024-09-22T03:55:16.129585+0000","last_fullsized":"2024-09-22T03:55:16.129585+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"44'1711","reported_seq":1738,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-22T03:55:15.006594+0000","last_change":"2024-09-22T03:52:38.258650+0000","last_active":"2024-09-22T03:55:15.006594+0000","last_peered":"2024-09-22T03:55:15.006594+0000","last_clean":"2024-09-22T03:55:15.006594+0000","last_became_active":"2024-09-22T03:52:38.238553+0000","last_became_peered":"2024-09-22T03:52:38.238553+0000","last_unstale":"2024-09-22T03:55:15.006594+0000","last_undegraded":"2024-09-22T03:55:15.006594+0000","last_fullsized":"2024-09-22T03:55:15.006594+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1711,"log_dups_size":0,"ondisk_log_size":1711,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16711680,"num_objects":255,"num_object_clones":0,"num_object_copies":765,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1711,"num_write_kb":62912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":106,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:55:16.134603+0000","last_change":"2024-09-22T03:49:17.036402+0000","last_active":"2024-09-22T03:55:16.134603+0000","last_peered":"2024-09-22T03:55:16.134603+0000","last_clean":"2024-09-22T03:55:16.134603+0000","last_became_active":"2024-09-22T03:49:15.108430+0000","last_became_peered":"2024-09-22T03:49:15.108430+0000","last_unstale":"2024-09-22T03:55:16.134603+0000","last_undegraded":"2024-09-22T03:55:16.134603+0000","last_fullsized":"2024-09-22T03:55:16.134603+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"44'1660","reported_seq":1687,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-22T03:55:14.807309+0000","last_change":"2024-09-22T03:52:38.208326+0000","last_active":"2024-09-22T03:55:14.807309+0000","last_peered":"2024-09-22T03:55:14.807309+0000","last_clean":"2024-09-22T03:55:14.807309+0000","last_became_active":"2024-09-22T03:52:38.200509+0000","last_became_peered":"2024-09-22T03:52:38.200509+0000","last_unstale":"2024-09-22T03:55:14.807309+0000","last_undegraded":"2024-09-22T03:55:14.807309+0000","last_fullsized":"2024-09-22T03:55:14.807309+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1660,"log_dups_size":0,"ondisk_log_size":1660,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15073280,"num_objects":230,"num_object_clones":0,"num_object_copies":690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1660,"num_write_kb":60480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":100,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-22T03:55:14.134318+0000","last_change":"2024-09-22T03:49:17.029128+0000","last_active":"2024-09-22T03:55:14.134318+0000","last_peered":"2024-09-22T03:55:14.134318+0000","last_clean":"2024-09-22T03:55:14.134318+0000","last_became_active":"2024-09-22T03:49:15.113396+0000","last_became_peered":"2024-09-22T03:49:15.113396+0000","last_unstale":"2024-09-22T03:55:14.134318+0000","last_undegraded":"2024-09-22T03:55:14.134318+0000","last_fullsized":"2024-09-22T03:55:14.134318+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":269877272,"num_objects":4119,"num_object_clones":0,"num_object_copies":12357,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":26967,"num_write_kb":994689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":50728960,"data_stored":811466824,"data_compressed":38532784,"data_compressed_allocated":50716672,"data_compressed_original":811466752,"omap_allocated":0,"internal_metadata":0},"log_size":26967,"ondisk_log_size":26967,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949673324,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":86972,"kb_used_data":11564,"kb_used_omap":0,"kb_used_meta":75392,"kb_avail":94284868,"statfs":{"total":96636764160,"available":96547704832,"internally_reserved":0,"allocated":11841536,"data_stored":183045130,"data_compressed":8687640,"data_compressed_allocated":11436032,"data_compressed_original":182894592,"omap_allocated":0,"internal_metadata":77201408},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654706028,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":86552,"kb_used_data":15304,"kb_used_omap":0,"kb_used_meta":71232,"kb_avail":94285288,"statfs":{"total":96636764160,"available":96548134912,"internally_reserved":0,"allocated":15671296,"data_stored":244841761,"data_compressed":11620208,"data_compressed_allocated":15294464,"data_compressed_original":244711424,"omap_allocated":0,"internal_metadata":72941568},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706028,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":86360,"kb_used_data":15112,"kb_used_omap":0,"kb_used_meta":71232,"kb_avail":94285480,"statfs":{"total":96636764160,"available":96548331520,"internally_reserved":0,"allocated":15474688,"data_stored":241303361,"data_compressed":11454208,"data_compressed_allocated":15077376,"data_compressed_original":241156096,"omap_allocated":0,"internal_metadata":72941568},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706028,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":72688,"kb_used_data":9760,"kb_used_omap":0,"kb_used_meta":62912,"kb_avail":94299152,"statfs":{"total":96636764160,"available":96562331648,"internally_reserved":0,"allocated":9994240,"data_stored":153747222,"data_compressed":7296576,"data_compressed_allocated":9605120,"data_compressed_original":153600000,"omap_allocated":0,"internal_metadata":64421888},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":9433088,"data_stored":150929408,"data_compressed":7166936,"data_compressed_allocated":9433088,"data_compressed_original":150929408,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":11300864,"data_stored":180748312,"data_compressed":8582896,"data_compressed_allocated":11296768,"data_compressed_original":180748288,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":14901248,"data_stored":238354456,"data_compressed":11318344,"data_compressed_allocated":14897152,"data_compressed_original":238354432,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":15093760,"data_stored":241434648,"data_compressed":11464608,"data_compressed_allocated":15089664,"data_compressed_original":241434624,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:55:18.143 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-22T03:55:18.143 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:55:18.143 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:55:18.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:55:18.335+0000 7ff4d3391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:55:18.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:55:18.345+0000 7ff4d3391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:55:18.733 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:55:18.734 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-22T03:55:18.751 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":224,"stamp":"2024-09-22T03:55:17.111596+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":270467659,"num_objects":4123,"num_object_clones":0,"num_object_copies":12369,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":27048,"num_write_kb":995797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":27022,"ondisk_log_size":27022,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":332572,"kb_used_data":51740,"kb_used_omap":0,"kb_used_meta":280768,"kb_avail":377154788,"statfs":{"total":386547056640,"available":386206502912,"internally_reserved":0,"allocated":52981760,"data_stored":822937474,"data_compressed":39058632,"data_compressed_allocated":51412992,"data_compressed_original":822362112,"omap_allocated":0,"internal_metadata":287506432},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-53018624,"num_objects":-809,"num_object_clones":0,"num_object_copies":-2427,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":809,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.072232"},"pg_stats":[{"pgid":"4.f","version":"45'1669","reported_seq":1702,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:55:16.137840+0000","last_change":"2024-09-22T03:52:38.267363+0000","last_active":"2024-09-22T03:55:16.137840+0000","last_peered":"2024-09-22T03:55:16.137840+0000","last_clean":"2024-09-22T03:55:16.137840+0000","last_became_active":"2024-09-22T03:52:38.261984+0000","last_became_peered":"2024-09-22T03:52:38.261984+0000","last_unstale":"2024-09-22T03:55:16.137840+0000","last_undegraded":"2024-09-22T03:55:16.137840+0000","last_fullsized":"2024-09-22T03:55:16.137840+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1669,"log_dups_size":0,"ondisk_log_size":1669,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17760256,"num_objects":271,"num_object_clones":0,"num_object_copies":813,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1669,"num_write_kb":62080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"45'1685","reported_seq":1718,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:55:16.128351+0000","last_change":"2024-09-22T03:52:38.211390+0000","last_active":"2024-09-22T03:55:16.128351+0000","last_peered":"2024-09-22T03:55:16.128351+0000","last_clean":"2024-09-22T03:55:16.128351+0000","last_became_active":"2024-09-22T03:52:38.190969+0000","last_became_peered":"2024-09-22T03:52:38.190969+0000","last_unstale":"2024-09-22T03:55:16.128351+0000","last_undegraded":"2024-09-22T03:55:16.128351+0000","last_fullsized":"2024-09-22T03:55:16.128351+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1685,"log_dups_size":0,"ondisk_log_size":1685,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16187392,"num_objects":247,"num_object_clones":0,"num_object_copies":741,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1685,"num_write_kb":61824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"44'1630","reported_seq":1658,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-22T03:55:14.815614+0000","last_change":"2024-09-22T03:52:38.196399+0000","last_active":"2024-09-22T03:55:14.815614+0000","last_peered":"2024-09-22T03:55:14.815614+0000","last_clean":"2024-09-22T03:55:14.815614+0000","last_became_active":"2024-09-22T03:52:38.183573+0000","last_became_peered":"2024-09-22T03:52:38.183573+0000","last_unstale":"2024-09-22T03:55:14.815614+0000","last_undegraded":"2024-09-22T03:55:14.815614+0000","last_fullsized":"2024-09-22T03:55:14.815614+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1630,"log_dups_size":0,"ondisk_log_size":1630,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16449560,"num_objects":252,"num_object_clones":0,"num_object_copies":756,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1630,"num_write_kb":60161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"44'1627","reported_seq":1654,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-22T03:55:15.026530+0000","last_change":"2024-09-22T03:52:38.241973+0000","last_active":"2024-09-22T03:55:15.026530+0000","last_peered":"2024-09-22T03:55:15.026530+0000","last_clean":"2024-09-22T03:55:15.026530+0000","last_became_active":"2024-09-22T03:52:38.234357+0000","last_became_peered":"2024-09-22T03:52:38.234357+0000","last_unstale":"2024-09-22T03:55:15.026530+0000","last_undegraded":"2024-09-22T03:55:15.026530+0000","last_fullsized":"2024-09-22T03:55:15.026530+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1627,"log_dups_size":0,"ondisk_log_size":1627,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15925248,"num_objects":243,"num_object_clones":0,"num_object_copies":729,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1627,"num_write_kb":59840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"44'1598","reported_seq":1625,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-22T03:55:14.909625+0000","last_change":"2024-09-22T03:52:38.234728+0000","last_active":"2024-09-22T03:55:14.909625+0000","last_peered":"2024-09-22T03:55:14.909625+0000","last_clean":"2024-09-22T03:55:14.909625+0000","last_became_active":"2024-09-22T03:52:38.221861+0000","last_became_peered":"2024-09-22T03:52:38.221861+0000","last_unstale":"2024-09-22T03:55:14.909625+0000","last_undegraded":"2024-09-22T03:55:14.909625+0000","last_fullsized":"2024-09-22T03:55:14.909625+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1598,"log_dups_size":0,"ondisk_log_size":1598,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17694720,"num_objects":270,"num_object_clones":0,"num_object_copies":810,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1598,"num_write_kb":59776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"44'1715","reported_seq":1742,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-22T03:55:14.962709+0000","last_change":"2024-09-22T03:52:38.235904+0000","last_active":"2024-09-22T03:55:14.962709+0000","last_peered":"2024-09-22T03:55:14.962709+0000","last_clean":"2024-09-22T03:55:14.962709+0000","last_became_active":"2024-09-22T03:52:38.225232+0000","last_became_peered":"2024-09-22T03:52:38.225232+0000","last_unstale":"2024-09-22T03:55:14.962709+0000","last_undegraded":"2024-09-22T03:55:14.962709+0000","last_fullsized":"2024-09-22T03:55:14.962709+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1715,"log_dups_size":0,"ondisk_log_size":1715,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17367040,"num_objects":265,"num_object_clones":0,"num_object_copies":795,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1715,"num_write_kb":63360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"44'1746","reported_seq":1773,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-22T03:55:14.827714+0000","last_change":"2024-09-22T03:52:38.200669+0000","last_active":"2024-09-22T03:55:14.827714+0000","last_peered":"2024-09-22T03:55:14.827714+0000","last_clean":"2024-09-22T03:55:14.827714+0000","last_became_active":"2024-09-22T03:52:38.190269+0000","last_became_peered":"2024-09-22T03:52:38.190269+0000","last_unstale":"2024-09-22T03:55:14.827714+0000","last_undegraded":"2024-09-22T03:55:14.827714+0000","last_fullsized":"2024-09-22T03:55:14.827714+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1746,"log_dups_size":0,"ondisk_log_size":1746,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16646144,"num_objects":254,"num_object_clones":0,"num_object_copies":762,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1746,"num_write_kb":64000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"44'1698","reported_seq":1725,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-22T03:55:14.958039+0000","last_change":"2024-09-22T03:52:38.177831+0000","last_active":"2024-09-22T03:55:14.958039+0000","last_peered":"2024-09-22T03:55:14.958039+0000","last_clean":"2024-09-22T03:55:14.958039+0000","last_became_active":"2024-09-22T03:52:38.169555+0000","last_became_peered":"2024-09-22T03:52:38.169555+0000","last_unstale":"2024-09-22T03:55:14.958039+0000","last_undegraded":"2024-09-22T03:55:14.958039+0000","last_fullsized":"2024-09-22T03:55:14.958039+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1698,"log_dups_size":0,"ondisk_log_size":1698,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18087936,"num_objects":276,"num_object_clones":0,"num_object_copies":828,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1698,"num_write_kb":63168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"44'1649","reported_seq":1676,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-22T03:55:14.970652+0000","last_change":"2024-09-22T03:52:38.267240+0000","last_active":"2024-09-22T03:55:14.970652+0000","last_peered":"2024-09-22T03:55:14.970652+0000","last_clean":"2024-09-22T03:55:14.970652+0000","last_became_active":"2024-09-22T03:52:38.252880+0000","last_became_peered":"2024-09-22T03:52:38.252880+0000","last_unstale":"2024-09-22T03:55:14.970652+0000","last_undegraded":"2024-09-22T03:55:14.970652+0000","last_fullsized":"2024-09-22T03:55:14.970652+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1649,"log_dups_size":0,"ondisk_log_size":1649,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18022400,"num_objects":275,"num_object_clones":0,"num_object_copies":825,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1649,"num_write_kb":61568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":181,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:55:16.125721+0000","last_change":"2024-09-22T03:49:12.034704+0000","last_active":"2024-09-22T03:55:16.125721+0000","last_peered":"2024-09-22T03:55:16.125721+0000","last_clean":"2024-09-22T03:55:16.125721+0000","last_became_active":"2024-09-22T03:49:12.027470+0000","last_became_peered":"2024-09-22T03:49:12.027470+0000","last_unstale":"2024-09-22T03:55:16.125721+0000","last_undegraded":"2024-09-22T03:55:16.125721+0000","last_fullsized":"2024-09-22T03:55:16.125721+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_clean_scrub_stamp":"2024-09-22T03:49:10.979949+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":101,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-22T03:55:14.138147+0000","last_change":"2024-09-22T03:49:17.031458+0000","last_active":"2024-09-22T03:55:14.138147+0000","last_peered":"2024-09-22T03:55:14.138147+0000","last_clean":"2024-09-22T03:55:14.138147+0000","last_became_active":"2024-09-22T03:49:15.125490+0000","last_became_peered":"2024-09-22T03:49:15.125490+0000","last_unstale":"2024-09-22T03:55:14.138147+0000","last_undegraded":"2024-09-22T03:55:14.138147+0000","last_fullsized":"2024-09-22T03:55:14.138147+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"44'1604","reported_seq":1631,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-22T03:55:14.929796+0000","last_change":"2024-09-22T03:52:38.263115+0000","last_active":"2024-09-22T03:55:14.929796+0000","last_peered":"2024-09-22T03:55:14.929796+0000","last_clean":"2024-09-22T03:55:14.929796+0000","last_became_active":"2024-09-22T03:52:38.245622+0000","last_became_peered":"2024-09-22T03:52:38.245622+0000","last_unstale":"2024-09-22T03:55:14.929796+0000","last_undegraded":"2024-09-22T03:55:14.929796+0000","last_fullsized":"2024-09-22T03:55:14.929796+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1604,"log_dups_size":0,"ondisk_log_size":1604,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18219008,"num_objects":278,"num_object_clones":0,"num_object_copies":834,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1604,"num_write_kb":60224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":100,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-22T03:55:14.133720+0000","last_change":"2024-09-22T03:49:17.029339+0000","last_active":"2024-09-22T03:55:14.133720+0000","last_peered":"2024-09-22T03:55:14.133720+0000","last_clean":"2024-09-22T03:55:14.133720+0000","last_became_active":"2024-09-22T03:49:15.097304+0000","last_became_peered":"2024-09-22T03:49:15.097304+0000","last_unstale":"2024-09-22T03:55:14.133720+0000","last_undegraded":"2024-09-22T03:55:14.133720+0000","last_fullsized":"2024-09-22T03:55:14.133720+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"45'1776","reported_seq":1809,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:55:16.133679+0000","last_change":"2024-09-22T03:52:38.234061+0000","last_active":"2024-09-22T03:55:16.133679+0000","last_peered":"2024-09-22T03:55:16.133679+0000","last_clean":"2024-09-22T03:55:16.133679+0000","last_became_active":"2024-09-22T03:52:38.222894+0000","last_became_peered":"2024-09-22T03:52:38.222894+0000","last_unstale":"2024-09-22T03:55:16.133679+0000","last_undegraded":"2024-09-22T03:55:16.133679+0000","last_fullsized":"2024-09-22T03:55:16.133679+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1776,"log_dups_size":0,"ondisk_log_size":1776,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15728640,"num_objects":240,"num_object_clones":0,"num_object_copies":720,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1776,"num_write_kb":64512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":100,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-22T03:55:14.150462+0000","last_change":"2024-09-22T03:49:17.029349+0000","last_active":"2024-09-22T03:55:14.150462+0000","last_peered":"2024-09-22T03:55:14.150462+0000","last_clean":"2024-09-22T03:55:14.150462+0000","last_became_active":"2024-09-22T03:49:15.094890+0000","last_became_peered":"2024-09-22T03:49:15.094890+0000","last_unstale":"2024-09-22T03:55:14.150462+0000","last_undegraded":"2024-09-22T03:55:14.150462+0000","last_fullsized":"2024-09-22T03:55:14.150462+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"45'1808","reported_seq":1841,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:55:16.132291+0000","last_change":"2024-09-22T03:52:38.248145+0000","last_active":"2024-09-22T03:55:16.132291+0000","last_peered":"2024-09-22T03:55:16.132291+0000","last_clean":"2024-09-22T03:55:16.132291+0000","last_became_active":"2024-09-22T03:52:38.241420+0000","last_became_peered":"2024-09-22T03:52:38.241420+0000","last_unstale":"2024-09-22T03:55:16.132291+0000","last_undegraded":"2024-09-22T03:55:16.132291+0000","last_fullsized":"2024-09-22T03:55:16.132291+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1808,"log_dups_size":0,"ondisk_log_size":1808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":256,"num_object_clones":0,"num_object_copies":768,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1808,"num_write_kb":66048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":102,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-22T03:55:14.146347+0000","last_change":"2024-09-22T03:49:17.031466+0000","last_active":"2024-09-22T03:55:14.146347+0000","last_peered":"2024-09-22T03:55:14.146347+0000","last_clean":"2024-09-22T03:55:14.146347+0000","last_became_active":"2024-09-22T03:49:15.098420+0000","last_became_peered":"2024-09-22T03:49:15.098420+0000","last_unstale":"2024-09-22T03:55:14.146347+0000","last_undegraded":"2024-09-22T03:55:14.146347+0000","last_fullsized":"2024-09-22T03:55:14.146347+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2","version":"44'1663","reported_seq":1690,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-22T03:55:14.878608+0000","last_change":"2024-09-22T03:52:38.215825+0000","last_active":"2024-09-22T03:55:14.878608+0000","last_peered":"2024-09-22T03:55:14.878608+0000","last_clean":"2024-09-22T03:55:14.878608+0000","last_became_active":"2024-09-22T03:52:38.203741+0000","last_became_peered":"2024-09-22T03:52:38.203741+0000","last_unstale":"2024-09-22T03:55:14.878608+0000","last_undegraded":"2024-09-22T03:55:14.878608+0000","last_fullsized":"2024-09-22T03:55:14.878608+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1663,"log_dups_size":0,"ondisk_log_size":1663,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16842752,"num_objects":257,"num_object_clones":0,"num_object_copies":771,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1663,"num_write_kb":61440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":106,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:55:16.134809+0000","last_change":"2024-09-22T03:49:17.036954+0000","last_active":"2024-09-22T03:55:16.134809+0000","last_peered":"2024-09-22T03:55:16.134809+0000","last_clean":"2024-09-22T03:55:16.134809+0000","last_became_active":"2024-09-22T03:49:15.110506+0000","last_became_peered":"2024-09-22T03:49:15.110506+0000","last_unstale":"2024-09-22T03:55:16.134809+0000","last_undegraded":"2024-09-22T03:55:16.134809+0000","last_fullsized":"2024-09-22T03:55:16.134809+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"44'1728","reported_seq":1755,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-22T03:55:14.536775+0000","last_change":"2024-09-22T03:52:38.239558+0000","last_active":"2024-09-22T03:55:14.536775+0000","last_peered":"2024-09-22T03:55:14.536775+0000","last_clean":"2024-09-22T03:55:14.536775+0000","last_became_active":"2024-09-22T03:52:38.229931+0000","last_became_peered":"2024-09-22T03:52:38.229931+0000","last_unstale":"2024-09-22T03:55:14.536775+0000","last_undegraded":"2024-09-22T03:55:14.536775+0000","last_fullsized":"2024-09-22T03:55:14.536775+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1728,"log_dups_size":0,"ondisk_log_size":1728,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16384000,"num_objects":250,"num_object_clones":0,"num_object_copies":750,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1728,"num_write_kb":63296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":106,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:55:16.129585+0000","last_change":"2024-09-22T03:49:17.032989+0000","last_active":"2024-09-22T03:55:16.129585+0000","last_peered":"2024-09-22T03:55:16.129585+0000","last_clean":"2024-09-22T03:55:16.129585+0000","last_became_active":"2024-09-22T03:49:15.079260+0000","last_became_peered":"2024-09-22T03:49:15.079260+0000","last_unstale":"2024-09-22T03:55:16.129585+0000","last_undegraded":"2024-09-22T03:55:16.129585+0000","last_fullsized":"2024-09-22T03:55:16.129585+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"44'1711","reported_seq":1738,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-22T03:55:15.006594+0000","last_change":"2024-09-22T03:52:38.258650+0000","last_active":"2024-09-22T03:55:15.006594+0000","last_peered":"2024-09-22T03:55:15.006594+0000","last_clean":"2024-09-22T03:55:15.006594+0000","last_became_active":"2024-09-22T03:52:38.238553+0000","last_became_peered":"2024-09-22T03:52:38.238553+0000","last_unstale":"2024-09-22T03:55:15.006594+0000","last_undegraded":"2024-09-22T03:55:15.006594+0000","last_fullsized":"2024-09-22T03:55:15.006594+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1711,"log_dups_size":0,"ondisk_log_size":1711,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16711680,"num_objects":255,"num_object_clones":0,"num_object_copies":765,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1711,"num_write_kb":62912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":106,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-22T03:55:16.134603+0000","last_change":"2024-09-22T03:49:17.036402+0000","last_active":"2024-09-22T03:55:16.134603+0000","last_peered":"2024-09-22T03:55:16.134603+0000","last_clean":"2024-09-22T03:55:16.134603+0000","last_became_active":"2024-09-22T03:49:15.108430+0000","last_became_peered":"2024-09-22T03:49:15.108430+0000","last_unstale":"2024-09-22T03:55:16.134603+0000","last_undegraded":"2024-09-22T03:55:16.134603+0000","last_fullsized":"2024-09-22T03:55:16.134603+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"44'1660","reported_seq":1687,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-22T03:55:14.807309+0000","last_change":"2024-09-22T03:52:38.208326+0000","last_active":"2024-09-22T03:55:14.807309+0000","last_peered":"2024-09-22T03:55:14.807309+0000","last_clean":"2024-09-22T03:55:14.807309+0000","last_became_active":"2024-09-22T03:52:38.200509+0000","last_became_peered":"2024-09-22T03:52:38.200509+0000","last_unstale":"2024-09-22T03:55:14.807309+0000","last_undegraded":"2024-09-22T03:55:14.807309+0000","last_fullsized":"2024-09-22T03:55:14.807309+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1660,"log_dups_size":0,"ondisk_log_size":1660,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15073280,"num_objects":230,"num_object_clones":0,"num_object_copies":690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1660,"num_write_kb":60480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":100,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-22T03:55:14.134318+0000","last_change":"2024-09-22T03:49:17.029128+0000","last_active":"2024-09-22T03:55:14.134318+0000","last_peered":"2024-09-22T03:55:14.134318+0000","last_clean":"2024-09-22T03:55:14.134318+0000","last_became_active":"2024-09-22T03:49:15.113396+0000","last_became_peered":"2024-09-22T03:49:15.113396+0000","last_unstale":"2024-09-22T03:55:14.134318+0000","last_undegraded":"2024-09-22T03:55:14.134318+0000","last_fullsized":"2024-09-22T03:55:14.134318+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":269877272,"num_objects":4119,"num_object_clones":0,"num_object_copies":12357,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":26967,"num_write_kb":994689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":50728960,"data_stored":811466824,"data_compressed":38532784,"data_compressed_allocated":50716672,"data_compressed_original":811466752,"omap_allocated":0,"internal_metadata":0},"log_size":26967,"ondisk_log_size":26967,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949673324,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":86972,"kb_used_data":11564,"kb_used_omap":0,"kb_used_meta":75392,"kb_avail":94284868,"statfs":{"total":96636764160,"available":96547704832,"internally_reserved":0,"allocated":11841536,"data_stored":183045130,"data_compressed":8687640,"data_compressed_allocated":11436032,"data_compressed_original":182894592,"omap_allocated":0,"internal_metadata":77201408},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654706028,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":86552,"kb_used_data":15304,"kb_used_omap":0,"kb_used_meta":71232,"kb_avail":94285288,"statfs":{"total":96636764160,"available":96548134912,"internally_reserved":0,"allocated":15671296,"data_stored":244841761,"data_compressed":11620208,"data_compressed_allocated":15294464,"data_compressed_original":244711424,"omap_allocated":0,"internal_metadata":72941568},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706028,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":86360,"kb_used_data":15112,"kb_used_omap":0,"kb_used_meta":71232,"kb_avail":94285480,"statfs":{"total":96636764160,"available":96548331520,"internally_reserved":0,"allocated":15474688,"data_stored":241303361,"data_compressed":11454208,"data_compressed_allocated":15077376,"data_compressed_original":241156096,"omap_allocated":0,"internal_metadata":72941568},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706028,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":72688,"kb_used_data":9760,"kb_used_omap":0,"kb_used_meta":62912,"kb_avail":94299152,"statfs":{"total":96636764160,"available":96562331648,"internally_reserved":0,"allocated":9994240,"data_stored":153747222,"data_compressed":7296576,"data_compressed_allocated":9605120,"data_compressed_original":153600000,"omap_allocated":0,"internal_metadata":64421888},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":9433088,"data_stored":150929408,"data_compressed":7166936,"data_compressed_allocated":9433088,"data_compressed_original":150929408,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":11300864,"data_stored":180748312,"data_compressed":8582896,"data_compressed_allocated":11296768,"data_compressed_original":180748288,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":14901248,"data_stored":238354456,"data_compressed":11318344,"data_compressed_allocated":14897152,"data_compressed_original":238354432,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":15093760,"data_stored":241434648,"data_compressed":11464608,"data_compressed_allocated":15089664,"data_compressed_original":241434624,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:55:20.121 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:55:20.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:55:20.263+0000 7f6b7e0c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:55:20.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:55:20.271+0000 7f6b7e0c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:55:23.003 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:55:23.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:55:23.142+0000 7f58f10fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:55:23.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:55:23.151+0000 7f58f10fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:55:23.753 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:55:23.753 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:55:23.754 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:55:23.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:55:23.882+0000 7fe800ca3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:55:23.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:55:23.894+0000 7fe800ca3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:55:24.192 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:55:24.193 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-22T03:55:24.209 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":227,"stamp":"2024-09-22T03:55:23.041543+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":217973323,"num_objects":3322,"num_object_clones":0,"num_object_copies":9966,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":27849,"num_write_kb":995797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":27823,"ondisk_log_size":27823,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":335624,"kb_used_data":42308,"kb_used_omap":0,"kb_used_meta":293248,"kb_avail":377151736,"statfs":{"total":386547056640,"available":386203377664,"internally_reserved":0,"allocated":43323392,"data_stored":666997797,"data_compressed":31652072,"data_compressed_allocated":41664512,"data_compressed_original":666386432,"omap_allocated":0,"internal_metadata":300285952},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-85131264,"num_objects":-1299,"num_object_clones":0,"num_object_copies":-3897,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1299,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.938322"},"pg_stats":[{"pgid":"4.f","version":"47'1722","reported_seq":1758,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-22T03:55:20.926661+0000","last_change":"2024-09-22T03:52:38.267363+0000","last_active":"2024-09-22T03:55:20.926661+0000","last_peered":"2024-09-22T03:55:20.926661+0000","last_clean":"2024-09-22T03:55:20.926661+0000","last_became_active":"2024-09-22T03:52:38.261984+0000","last_became_peered":"2024-09-22T03:52:38.261984+0000","last_unstale":"2024-09-22T03:55:20.926661+0000","last_undegraded":"2024-09-22T03:55:20.926661+0000","last_fullsized":"2024-09-22T03:55:20.926661+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1722,"log_dups_size":0,"ondisk_log_size":1722,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14286848,"num_objects":218,"num_object_clones":0,"num_object_copies":654,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1722,"num_write_kb":62080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"47'1737","reported_seq":1773,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-22T03:55:20.766439+0000","last_change":"2024-09-22T03:52:38.211390+0000","last_active":"2024-09-22T03:55:20.766439+0000","last_peered":"2024-09-22T03:55:20.766439+0000","last_clean":"2024-09-22T03:55:20.766439+0000","last_became_active":"2024-09-22T03:52:38.190969+0000","last_became_peered":"2024-09-22T03:52:38.190969+0000","last_unstale":"2024-09-22T03:55:20.766439+0000","last_undegraded":"2024-09-22T03:55:20.766439+0000","last_fullsized":"2024-09-22T03:55:20.766439+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1737,"log_dups_size":0,"ondisk_log_size":1737,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12779520,"num_objects":195,"num_object_clones":0,"num_object_copies":585,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1737,"num_write_kb":61824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"47'1678","reported_seq":1715,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-22T03:55:20.023315+0000","last_change":"2024-09-22T03:52:38.196399+0000","last_active":"2024-09-22T03:55:20.023315+0000","last_peered":"2024-09-22T03:55:20.023315+0000","last_clean":"2024-09-22T03:55:20.023315+0000","last_became_active":"2024-09-22T03:52:38.183573+0000","last_became_peered":"2024-09-22T03:52:38.183573+0000","last_unstale":"2024-09-22T03:55:20.023315+0000","last_undegraded":"2024-09-22T03:55:20.023315+0000","last_fullsized":"2024-09-22T03:55:20.023315+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1678,"log_dups_size":0,"ondisk_log_size":1678,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13303832,"num_objects":204,"num_object_clones":0,"num_object_copies":612,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1678,"num_write_kb":60161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"47'1680","reported_seq":1716,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-22T03:55:20.013070+0000","last_change":"2024-09-22T03:52:38.241973+0000","last_active":"2024-09-22T03:55:20.013070+0000","last_peered":"2024-09-22T03:55:20.013070+0000","last_clean":"2024-09-22T03:55:20.013070+0000","last_became_active":"2024-09-22T03:52:38.234357+0000","last_became_peered":"2024-09-22T03:52:38.234357+0000","last_unstale":"2024-09-22T03:55:20.013070+0000","last_undegraded":"2024-09-22T03:55:20.013070+0000","last_fullsized":"2024-09-22T03:55:20.013070+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1680,"log_dups_size":0,"ondisk_log_size":1680,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12451840,"num_objects":190,"num_object_clones":0,"num_object_copies":570,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1680,"num_write_kb":59840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"47'1650","reported_seq":1686,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-22T03:55:19.873385+0000","last_change":"2024-09-22T03:52:38.234728+0000","last_active":"2024-09-22T03:55:19.873385+0000","last_peered":"2024-09-22T03:55:19.873385+0000","last_clean":"2024-09-22T03:55:19.873385+0000","last_became_active":"2024-09-22T03:52:38.221861+0000","last_became_peered":"2024-09-22T03:52:38.221861+0000","last_unstale":"2024-09-22T03:55:19.873385+0000","last_undegraded":"2024-09-22T03:55:19.873385+0000","last_fullsized":"2024-09-22T03:55:19.873385+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1650,"log_dups_size":0,"ondisk_log_size":1650,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14286848,"num_objects":218,"num_object_clones":0,"num_object_copies":654,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1650,"num_write_kb":59776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"47'1770","reported_seq":1806,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-22T03:55:19.978696+0000","last_change":"2024-09-22T03:52:38.235904+0000","last_active":"2024-09-22T03:55:19.978696+0000","last_peered":"2024-09-22T03:55:19.978696+0000","last_clean":"2024-09-22T03:55:19.978696+0000","last_became_active":"2024-09-22T03:52:38.225232+0000","last_became_peered":"2024-09-22T03:52:38.225232+0000","last_unstale":"2024-09-22T03:55:19.978696+0000","last_undegraded":"2024-09-22T03:55:19.978696+0000","last_fullsized":"2024-09-22T03:55:19.978696+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1770,"log_dups_size":0,"ondisk_log_size":1770,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13762560,"num_objects":210,"num_object_clones":0,"num_object_copies":630,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1770,"num_write_kb":63360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"47'1788","reported_seq":1824,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-22T03:55:19.662178+0000","last_change":"2024-09-22T03:52:38.200669+0000","last_active":"2024-09-22T03:55:19.662178+0000","last_peered":"2024-09-22T03:55:19.662178+0000","last_clean":"2024-09-22T03:55:19.662178+0000","last_became_active":"2024-09-22T03:52:38.190269+0000","last_became_peered":"2024-09-22T03:52:38.190269+0000","last_unstale":"2024-09-22T03:55:19.662178+0000","last_undegraded":"2024-09-22T03:55:19.662178+0000","last_fullsized":"2024-09-22T03:55:19.662178+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1788,"log_dups_size":0,"ondisk_log_size":1788,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13893632,"num_objects":212,"num_object_clones":0,"num_object_copies":636,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1788,"num_write_kb":64000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"47'1749","reported_seq":1785,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-22T03:55:19.863181+0000","last_change":"2024-09-22T03:52:38.177831+0000","last_active":"2024-09-22T03:55:19.863181+0000","last_peered":"2024-09-22T03:55:19.863181+0000","last_clean":"2024-09-22T03:55:19.863181+0000","last_became_active":"2024-09-22T03:52:38.169555+0000","last_became_peered":"2024-09-22T03:52:38.169555+0000","last_unstale":"2024-09-22T03:55:19.863181+0000","last_undegraded":"2024-09-22T03:55:19.863181+0000","last_fullsized":"2024-09-22T03:55:19.863181+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1749,"log_dups_size":0,"ondisk_log_size":1749,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14745600,"num_objects":225,"num_object_clones":0,"num_object_copies":675,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1749,"num_write_kb":63168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"47'1710","reported_seq":1746,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-22T03:55:19.945102+0000","last_change":"2024-09-22T03:52:38.267240+0000","last_active":"2024-09-22T03:55:19.945102+0000","last_peered":"2024-09-22T03:55:19.945102+0000","last_clean":"2024-09-22T03:55:19.945102+0000","last_became_active":"2024-09-22T03:52:38.252880+0000","last_became_peered":"2024-09-22T03:52:38.252880+0000","last_unstale":"2024-09-22T03:55:19.945102+0000","last_undegraded":"2024-09-22T03:55:19.945102+0000","last_fullsized":"2024-09-22T03:55:19.945102+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1710,"log_dups_size":0,"ondisk_log_size":1710,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14024704,"num_objects":214,"num_object_clones":0,"num_object_copies":642,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1710,"num_write_kb":61568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":184,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-22T03:55:17.137984+0000","last_change":"2024-09-22T03:49:12.034704+0000","last_active":"2024-09-22T03:55:17.137984+0000","last_peered":"2024-09-22T03:55:17.137984+0000","last_clean":"2024-09-22T03:55:17.137984+0000","last_became_active":"2024-09-22T03:49:12.027470+0000","last_became_peered":"2024-09-22T03:49:12.027470+0000","last_unstale":"2024-09-22T03:55:17.137984+0000","last_undegraded":"2024-09-22T03:55:17.137984+0000","last_fullsized":"2024-09-22T03:55:17.137984+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_clean_scrub_stamp":"2024-09-22T03:49:10.979949+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":110,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-22T03:55:17.150414+0000","last_change":"2024-09-22T03:49:17.031458+0000","last_active":"2024-09-22T03:55:17.150414+0000","last_peered":"2024-09-22T03:55:17.150414+0000","last_clean":"2024-09-22T03:55:17.150414+0000","last_became_active":"2024-09-22T03:49:15.125490+0000","last_became_peered":"2024-09-22T03:49:15.125490+0000","last_unstale":"2024-09-22T03:55:17.150414+0000","last_undegraded":"2024-09-22T03:55:17.150414+0000","last_fullsized":"2024-09-22T03:55:17.150414+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"47'1659","reported_seq":1695,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-22T03:55:19.826508+0000","last_change":"2024-09-22T03:52:38.263115+0000","last_active":"2024-09-22T03:55:19.826508+0000","last_peered":"2024-09-22T03:55:19.826508+0000","last_clean":"2024-09-22T03:55:19.826508+0000","last_became_active":"2024-09-22T03:52:38.245622+0000","last_became_peered":"2024-09-22T03:52:38.245622+0000","last_unstale":"2024-09-22T03:55:19.826508+0000","last_undegraded":"2024-09-22T03:55:19.826508+0000","last_fullsized":"2024-09-22T03:55:19.826508+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1659,"log_dups_size":0,"ondisk_log_size":1659,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14614528,"num_objects":223,"num_object_clones":0,"num_object_copies":669,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1659,"num_write_kb":60224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":109,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-22T03:55:17.144337+0000","last_change":"2024-09-22T03:49:17.029339+0000","last_active":"2024-09-22T03:55:17.144337+0000","last_peered":"2024-09-22T03:55:17.144337+0000","last_clean":"2024-09-22T03:55:17.144337+0000","last_became_active":"2024-09-22T03:49:15.097304+0000","last_became_peered":"2024-09-22T03:49:15.097304+0000","last_unstale":"2024-09-22T03:55:17.144337+0000","last_undegraded":"2024-09-22T03:55:17.144337+0000","last_fullsized":"2024-09-22T03:55:17.144337+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"47'1832","reported_seq":1868,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-22T03:55:21.086998+0000","last_change":"2024-09-22T03:52:38.234061+0000","last_active":"2024-09-22T03:55:21.086998+0000","last_peered":"2024-09-22T03:55:21.086998+0000","last_clean":"2024-09-22T03:55:21.086998+0000","last_became_active":"2024-09-22T03:52:38.222894+0000","last_became_peered":"2024-09-22T03:52:38.222894+0000","last_unstale":"2024-09-22T03:55:21.086998+0000","last_undegraded":"2024-09-22T03:55:21.086998+0000","last_fullsized":"2024-09-22T03:55:21.086998+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1832,"log_dups_size":0,"ondisk_log_size":1832,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12058624,"num_objects":184,"num_object_clones":0,"num_object_copies":552,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1832,"num_write_kb":64512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":109,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-22T03:55:17.175666+0000","last_change":"2024-09-22T03:49:17.029349+0000","last_active":"2024-09-22T03:55:17.175666+0000","last_peered":"2024-09-22T03:55:17.175666+0000","last_clean":"2024-09-22T03:55:17.175666+0000","last_became_active":"2024-09-22T03:49:15.094890+0000","last_became_peered":"2024-09-22T03:49:15.094890+0000","last_unstale":"2024-09-22T03:55:17.175666+0000","last_undegraded":"2024-09-22T03:55:17.175666+0000","last_fullsized":"2024-09-22T03:55:17.175666+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"47'1861","reported_seq":1897,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-22T03:55:20.936392+0000","last_change":"2024-09-22T03:52:38.248145+0000","last_active":"2024-09-22T03:55:20.936392+0000","last_peered":"2024-09-22T03:55:20.936392+0000","last_clean":"2024-09-22T03:55:20.936392+0000","last_became_active":"2024-09-22T03:52:38.241420+0000","last_became_peered":"2024-09-22T03:52:38.241420+0000","last_unstale":"2024-09-22T03:55:20.936392+0000","last_undegraded":"2024-09-22T03:55:20.936392+0000","last_fullsized":"2024-09-22T03:55:20.936392+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1861,"log_dups_size":0,"ondisk_log_size":1861,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13303808,"num_objects":203,"num_object_clones":0,"num_object_copies":609,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1861,"num_write_kb":66048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":111,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-22T03:55:17.155540+0000","last_change":"2024-09-22T03:49:17.031466+0000","last_active":"2024-09-22T03:55:17.155540+0000","last_peered":"2024-09-22T03:55:17.155540+0000","last_clean":"2024-09-22T03:55:17.155540+0000","last_became_active":"2024-09-22T03:49:15.098420+0000","last_became_peered":"2024-09-22T03:49:15.098420+0000","last_unstale":"2024-09-22T03:55:17.155540+0000","last_undegraded":"2024-09-22T03:55:17.155540+0000","last_fullsized":"2024-09-22T03:55:17.155540+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2","version":"47'1710","reported_seq":1746,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-22T03:55:19.906179+0000","last_change":"2024-09-22T03:52:38.215825+0000","last_active":"2024-09-22T03:55:19.906179+0000","last_peered":"2024-09-22T03:55:19.906179+0000","last_clean":"2024-09-22T03:55:19.906179+0000","last_became_active":"2024-09-22T03:52:38.203741+0000","last_became_peered":"2024-09-22T03:52:38.203741+0000","last_unstale":"2024-09-22T03:55:19.906179+0000","last_undegraded":"2024-09-22T03:55:19.906179+0000","last_fullsized":"2024-09-22T03:55:19.906179+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1710,"log_dups_size":0,"ondisk_log_size":1710,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13762560,"num_objects":210,"num_object_clones":0,"num_object_copies":630,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1710,"num_write_kb":61440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":109,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-22T03:55:17.144675+0000","last_change":"2024-09-22T03:49:17.036954+0000","last_active":"2024-09-22T03:55:17.144675+0000","last_peered":"2024-09-22T03:55:17.144675+0000","last_clean":"2024-09-22T03:55:17.144675+0000","last_became_active":"2024-09-22T03:49:15.110506+0000","last_became_peered":"2024-09-22T03:49:15.110506+0000","last_unstale":"2024-09-22T03:55:17.144675+0000","last_undegraded":"2024-09-22T03:55:17.144675+0000","last_fullsized":"2024-09-22T03:55:17.144675+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"47'1769","reported_seq":1805,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-22T03:55:19.993103+0000","last_change":"2024-09-22T03:52:38.239558+0000","last_active":"2024-09-22T03:55:19.993103+0000","last_peered":"2024-09-22T03:55:19.993103+0000","last_clean":"2024-09-22T03:55:19.993103+0000","last_became_active":"2024-09-22T03:52:38.229931+0000","last_became_peered":"2024-09-22T03:52:38.229931+0000","last_unstale":"2024-09-22T03:55:19.993103+0000","last_undegraded":"2024-09-22T03:55:19.993103+0000","last_fullsized":"2024-09-22T03:55:19.993103+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1769,"log_dups_size":0,"ondisk_log_size":1769,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13697024,"num_objects":209,"num_object_clones":0,"num_object_copies":627,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1769,"num_write_kb":63296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":109,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-22T03:55:17.135172+0000","last_change":"2024-09-22T03:49:17.032989+0000","last_active":"2024-09-22T03:55:17.135172+0000","last_peered":"2024-09-22T03:55:17.135172+0000","last_clean":"2024-09-22T03:55:17.135172+0000","last_became_active":"2024-09-22T03:49:15.079260+0000","last_became_peered":"2024-09-22T03:49:15.079260+0000","last_unstale":"2024-09-22T03:55:17.135172+0000","last_undegraded":"2024-09-22T03:55:17.135172+0000","last_fullsized":"2024-09-22T03:55:17.135172+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"47'1756","reported_seq":1792,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-22T03:55:19.781445+0000","last_change":"2024-09-22T03:52:38.258650+0000","last_active":"2024-09-22T03:55:19.781445+0000","last_peered":"2024-09-22T03:55:19.781445+0000","last_clean":"2024-09-22T03:55:19.781445+0000","last_became_active":"2024-09-22T03:52:38.238553+0000","last_became_peered":"2024-09-22T03:52:38.238553+0000","last_unstale":"2024-09-22T03:55:19.781445+0000","last_undegraded":"2024-09-22T03:55:19.781445+0000","last_fullsized":"2024-09-22T03:55:19.781445+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1756,"log_dups_size":0,"ondisk_log_size":1756,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13762560,"num_objects":210,"num_object_clones":0,"num_object_copies":630,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1756,"num_write_kb":62912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":109,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-22T03:55:17.139778+0000","last_change":"2024-09-22T03:49:17.036402+0000","last_active":"2024-09-22T03:55:17.139778+0000","last_peered":"2024-09-22T03:55:17.139778+0000","last_clean":"2024-09-22T03:55:17.139778+0000","last_became_active":"2024-09-22T03:49:15.108430+0000","last_became_peered":"2024-09-22T03:49:15.108430+0000","last_unstale":"2024-09-22T03:55:17.139778+0000","last_undegraded":"2024-09-22T03:55:17.139778+0000","last_fullsized":"2024-09-22T03:55:17.139778+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"47'1697","reported_seq":1733,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-22T03:55:19.923456+0000","last_change":"2024-09-22T03:52:38.208326+0000","last_active":"2024-09-22T03:55:19.923456+0000","last_peered":"2024-09-22T03:55:19.923456+0000","last_clean":"2024-09-22T03:55:19.923456+0000","last_became_active":"2024-09-22T03:52:38.200509+0000","last_became_peered":"2024-09-22T03:52:38.200509+0000","last_unstale":"2024-09-22T03:55:19.923456+0000","last_undegraded":"2024-09-22T03:55:19.923456+0000","last_fullsized":"2024-09-22T03:55:19.923456+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1697,"log_dups_size":0,"ondisk_log_size":1697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12648448,"num_objects":193,"num_object_clones":0,"num_object_copies":579,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1697,"num_write_kb":60480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":109,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-22T03:55:17.143293+0000","last_change":"2024-09-22T03:49:17.029128+0000","last_active":"2024-09-22T03:55:17.143293+0000","last_peered":"2024-09-22T03:55:17.143293+0000","last_clean":"2024-09-22T03:55:17.143293+0000","last_became_active":"2024-09-22T03:49:15.113396+0000","last_became_peered":"2024-09-22T03:49:15.113396+0000","last_unstale":"2024-09-22T03:55:17.143293+0000","last_undegraded":"2024-09-22T03:55:17.143293+0000","last_fullsized":"2024-09-22T03:55:17.143293+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":217382936,"num_objects":3318,"num_object_clones":0,"num_object_copies":9954,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":27768,"num_write_kb":994689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":40898560,"data_stored":654180424,"data_compressed":31063984,"data_compressed_allocated":40886272,"data_compressed_original":654180352,"omap_allocated":0,"internal_metadata":0},"log_size":27768,"ondisk_log_size":27768,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949673329,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":88956,"kb_used_data":9388,"kb_used_omap":0,"kb_used_meta":79552,"kb_avail":94282884,"statfs":{"total":96636764160,"available":96545673216,"internally_reserved":0,"allocated":9613312,"data_stored":147137948,"data_compressed":6982264,"data_compressed_allocated":9191424,"data_compressed_original":146980864,"omap_allocated":0,"internal_metadata":81461248},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654706033,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":87940,"kb_used_data":12532,"kb_used_omap":0,"kb_used_meta":75392,"kb_avail":94283900,"statfs":{"total":96636764160,"available":96546713600,"internally_reserved":0,"allocated":12832768,"data_stored":199041916,"data_compressed":9444920,"data_compressed_allocated":12431360,"data_compressed_original":198901760,"omap_allocated":0,"internal_metadata":77201408},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706033,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":87768,"kb_used_data":12356,"kb_used_omap":0,"kb_used_meta":75392,"kb_avail":94284072,"statfs":{"total":96636764160,"available":96546889728,"internally_reserved":0,"allocated":12652544,"data_stored":195765660,"data_compressed":9291368,"data_compressed_allocated":12230656,"data_compressed_original":195608576,"omap_allocated":0,"internal_metadata":77201408},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706033,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":70960,"kb_used_data":8032,"kb_used_omap":0,"kb_used_meta":62912,"kb_avail":94300880,"statfs":{"total":96636764160,"available":96564101120,"internally_reserved":0,"allocated":8224768,"data_stored":125052273,"data_compressed":5933520,"data_compressed_allocated":7811072,"data_compressed_original":124895232,"omap_allocated":0,"internal_metadata":64421888},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":7626752,"data_stored":122028032,"data_compressed":5794544,"data_compressed_allocated":7626752,"data_compressed_original":122028032,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9015296,"data_stored":144179224,"data_compressed":6846400,"data_compressed_allocated":9011200,"data_compressed_original":144179200,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12050432,"data_stored":192741400,"data_compressed":9152392,"data_compressed_allocated":12046336,"data_compressed_original":192741376,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12206080,"data_stored":195231768,"data_compressed":9270648,"data_compressed_allocated":12201984,"data_compressed_original":195231744,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:55:25.604 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:55:25.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:55:25.745+0000 7f431af91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:55:25.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:55:25.755+0000 7f431af91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:55:28.306 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:55:28.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:55:28.450+0000 7f9977d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:55:28.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:55:28.460+0000 7f9977d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:55:29.212 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:55:29.212 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:55:29.212 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:55:29.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:55:29.354+0000 7f9c25a46640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:55:29.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:55:29.366+0000 7f9c25a46640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:55:29.603 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:55:29.603 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-22T03:55:29.621 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":230,"stamp":"2024-09-22T03:55:29.042854+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":166986315,"num_objects":2544,"num_object_clones":0,"num_object_copies":7632,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":28627,"num_write_kb":995797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28601,"ondisk_log_size":28601,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":317976,"kb_used_data":32984,"kb_used_omap":0,"kb_used_meta":284928,"kb_avail":377169384,"statfs":{"total":386547056640,"available":386221449216,"internally_reserved":0,"allocated":33775616,"data_stored":514233381,"data_compressed":24398000,"data_compressed_allocated":32116736,"data_compressed_original":513622016,"omap_allocated":0,"internal_metadata":291766272},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-103481344,"num_objects":-1579,"num_object_clones":0,"num_object_copies":-4737,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1579,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.931257"},"pg_stats":[{"pgid":"4.f","version":"47'1780","reported_seq":1816,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-22T03:55:25.993008+0000","last_change":"2024-09-22T03:52:38.267363+0000","last_active":"2024-09-22T03:55:25.993008+0000","last_peered":"2024-09-22T03:55:25.993008+0000","last_clean":"2024-09-22T03:55:25.993008+0000","last_became_active":"2024-09-22T03:52:38.261984+0000","last_became_peered":"2024-09-22T03:52:38.261984+0000","last_unstale":"2024-09-22T03:55:25.993008+0000","last_undegraded":"2024-09-22T03:55:25.993008+0000","last_fullsized":"2024-09-22T03:55:25.993008+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1780,"log_dups_size":0,"ondisk_log_size":1780,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":160,"num_object_clones":0,"num_object_copies":480,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1780,"num_write_kb":62080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"47'1787","reported_seq":1823,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-22T03:55:25.958080+0000","last_change":"2024-09-22T03:52:38.211390+0000","last_active":"2024-09-22T03:55:25.958080+0000","last_peered":"2024-09-22T03:55:25.958080+0000","last_clean":"2024-09-22T03:55:25.958080+0000","last_became_active":"2024-09-22T03:52:38.190969+0000","last_became_peered":"2024-09-22T03:52:38.190969+0000","last_unstale":"2024-09-22T03:55:25.958080+0000","last_undegraded":"2024-09-22T03:55:25.958080+0000","last_fullsized":"2024-09-22T03:55:25.958080+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1787,"log_dups_size":0,"ondisk_log_size":1787,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9502720,"num_objects":145,"num_object_clones":0,"num_object_copies":435,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1787,"num_write_kb":61824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"47'1718","reported_seq":1755,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-22T03:55:24.713212+0000","last_change":"2024-09-22T03:52:38.196399+0000","last_active":"2024-09-22T03:55:24.713212+0000","last_peered":"2024-09-22T03:55:24.713212+0000","last_clean":"2024-09-22T03:55:24.713212+0000","last_became_active":"2024-09-22T03:52:38.183573+0000","last_became_peered":"2024-09-22T03:52:38.183573+0000","last_unstale":"2024-09-22T03:55:24.713212+0000","last_undegraded":"2024-09-22T03:55:24.713212+0000","last_fullsized":"2024-09-22T03:55:24.713212+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1718,"log_dups_size":0,"ondisk_log_size":1718,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10682392,"num_objects":164,"num_object_clones":0,"num_object_copies":492,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1718,"num_write_kb":60161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"47'1728","reported_seq":1764,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-22T03:55:24.990403+0000","last_change":"2024-09-22T03:52:38.241973+0000","last_active":"2024-09-22T03:55:24.990403+0000","last_peered":"2024-09-22T03:55:24.990403+0000","last_clean":"2024-09-22T03:55:24.990403+0000","last_became_active":"2024-09-22T03:52:38.234357+0000","last_became_peered":"2024-09-22T03:52:38.234357+0000","last_unstale":"2024-09-22T03:55:24.990403+0000","last_undegraded":"2024-09-22T03:55:24.990403+0000","last_fullsized":"2024-09-22T03:55:24.990403+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1728,"log_dups_size":0,"ondisk_log_size":1728,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9306112,"num_objects":142,"num_object_clones":0,"num_object_copies":426,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1728,"num_write_kb":59840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"47'1694","reported_seq":1730,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-22T03:55:24.839848+0000","last_change":"2024-09-22T03:52:38.234728+0000","last_active":"2024-09-22T03:55:24.839848+0000","last_peered":"2024-09-22T03:55:24.839848+0000","last_clean":"2024-09-22T03:55:24.839848+0000","last_became_active":"2024-09-22T03:52:38.221861+0000","last_became_peered":"2024-09-22T03:52:38.221861+0000","last_unstale":"2024-09-22T03:55:24.839848+0000","last_undegraded":"2024-09-22T03:55:24.839848+0000","last_fullsized":"2024-09-22T03:55:24.839848+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1694,"log_dups_size":0,"ondisk_log_size":1694,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11403264,"num_objects":174,"num_object_clones":0,"num_object_copies":522,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1694,"num_write_kb":59776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"47'1815","reported_seq":1851,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-22T03:55:24.866149+0000","last_change":"2024-09-22T03:52:38.235904+0000","last_active":"2024-09-22T03:55:24.866149+0000","last_peered":"2024-09-22T03:55:24.866149+0000","last_clean":"2024-09-22T03:55:24.866149+0000","last_became_active":"2024-09-22T03:52:38.225232+0000","last_became_peered":"2024-09-22T03:52:38.225232+0000","last_unstale":"2024-09-22T03:55:24.866149+0000","last_undegraded":"2024-09-22T03:55:24.866149+0000","last_fullsized":"2024-09-22T03:55:24.866149+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1815,"log_dups_size":0,"ondisk_log_size":1815,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10813440,"num_objects":165,"num_object_clones":0,"num_object_copies":495,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1815,"num_write_kb":63360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"47'1835","reported_seq":1871,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-22T03:55:24.389882+0000","last_change":"2024-09-22T03:52:38.200669+0000","last_active":"2024-09-22T03:55:24.389882+0000","last_peered":"2024-09-22T03:55:24.389882+0000","last_clean":"2024-09-22T03:55:24.389882+0000","last_became_active":"2024-09-22T03:52:38.190269+0000","last_became_peered":"2024-09-22T03:52:38.190269+0000","last_unstale":"2024-09-22T03:55:24.389882+0000","last_undegraded":"2024-09-22T03:55:24.389882+0000","last_fullsized":"2024-09-22T03:55:24.389882+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1835,"log_dups_size":0,"ondisk_log_size":1835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10813440,"num_objects":165,"num_object_clones":0,"num_object_copies":495,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1835,"num_write_kb":64000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"47'1805","reported_seq":1841,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-22T03:55:24.729598+0000","last_change":"2024-09-22T03:52:38.177831+0000","last_active":"2024-09-22T03:55:24.729598+0000","last_peered":"2024-09-22T03:55:24.729598+0000","last_clean":"2024-09-22T03:55:24.729598+0000","last_became_active":"2024-09-22T03:52:38.169555+0000","last_became_peered":"2024-09-22T03:52:38.169555+0000","last_unstale":"2024-09-22T03:55:24.729598+0000","last_undegraded":"2024-09-22T03:55:24.729598+0000","last_fullsized":"2024-09-22T03:55:24.729598+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1805,"log_dups_size":0,"ondisk_log_size":1805,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11075584,"num_objects":169,"num_object_clones":0,"num_object_copies":507,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1805,"num_write_kb":63168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"47'1760","reported_seq":1796,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-22T03:55:24.925756+0000","last_change":"2024-09-22T03:52:38.267240+0000","last_active":"2024-09-22T03:55:24.925756+0000","last_peered":"2024-09-22T03:55:24.925756+0000","last_clean":"2024-09-22T03:55:24.925756+0000","last_became_active":"2024-09-22T03:52:38.252880+0000","last_became_peered":"2024-09-22T03:52:38.252880+0000","last_unstale":"2024-09-22T03:55:24.925756+0000","last_undegraded":"2024-09-22T03:55:24.925756+0000","last_fullsized":"2024-09-22T03:55:24.925756+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1760,"log_dups_size":0,"ondisk_log_size":1760,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10747904,"num_objects":164,"num_object_clones":0,"num_object_copies":492,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1760,"num_write_kb":61568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":184,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-22T03:55:17.137984+0000","last_change":"2024-09-22T03:49:12.034704+0000","last_active":"2024-09-22T03:55:17.137984+0000","last_peered":"2024-09-22T03:55:17.137984+0000","last_clean":"2024-09-22T03:55:17.137984+0000","last_became_active":"2024-09-22T03:49:12.027470+0000","last_became_peered":"2024-09-22T03:49:12.027470+0000","last_unstale":"2024-09-22T03:55:17.137984+0000","last_undegraded":"2024-09-22T03:55:17.137984+0000","last_fullsized":"2024-09-22T03:55:17.137984+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_clean_scrub_stamp":"2024-09-22T03:49:10.979949+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":110,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-22T03:55:17.150414+0000","last_change":"2024-09-22T03:49:17.031458+0000","last_active":"2024-09-22T03:55:17.150414+0000","last_peered":"2024-09-22T03:55:17.150414+0000","last_clean":"2024-09-22T03:55:17.150414+0000","last_became_active":"2024-09-22T03:49:15.125490+0000","last_became_peered":"2024-09-22T03:49:15.125490+0000","last_unstale":"2024-09-22T03:55:17.150414+0000","last_undegraded":"2024-09-22T03:55:17.150414+0000","last_fullsized":"2024-09-22T03:55:17.150414+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"47'1706","reported_seq":1742,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-22T03:55:24.975551+0000","last_change":"2024-09-22T03:52:38.263115+0000","last_active":"2024-09-22T03:55:24.975551+0000","last_peered":"2024-09-22T03:55:24.975551+0000","last_clean":"2024-09-22T03:55:24.975551+0000","last_became_active":"2024-09-22T03:52:38.245622+0000","last_became_peered":"2024-09-22T03:52:38.245622+0000","last_unstale":"2024-09-22T03:55:24.975551+0000","last_undegraded":"2024-09-22T03:55:24.975551+0000","last_fullsized":"2024-09-22T03:55:24.975551+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1706,"log_dups_size":0,"ondisk_log_size":1706,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11534336,"num_objects":176,"num_object_clones":0,"num_object_copies":528,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1706,"num_write_kb":60224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":109,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-22T03:55:17.144337+0000","last_change":"2024-09-22T03:49:17.029339+0000","last_active":"2024-09-22T03:55:17.144337+0000","last_peered":"2024-09-22T03:55:17.144337+0000","last_clean":"2024-09-22T03:55:17.144337+0000","last_became_active":"2024-09-22T03:49:15.097304+0000","last_became_peered":"2024-09-22T03:49:15.097304+0000","last_unstale":"2024-09-22T03:55:17.144337+0000","last_undegraded":"2024-09-22T03:55:17.144337+0000","last_fullsized":"2024-09-22T03:55:17.144337+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"47'1879","reported_seq":1915,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-22T03:55:26.118597+0000","last_change":"2024-09-22T03:52:38.234061+0000","last_active":"2024-09-22T03:55:26.118597+0000","last_peered":"2024-09-22T03:55:26.118597+0000","last_clean":"2024-09-22T03:55:26.118597+0000","last_became_active":"2024-09-22T03:52:38.222894+0000","last_became_peered":"2024-09-22T03:52:38.222894+0000","last_unstale":"2024-09-22T03:55:26.118597+0000","last_undegraded":"2024-09-22T03:55:26.118597+0000","last_fullsized":"2024-09-22T03:55:26.118597+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1879,"log_dups_size":0,"ondisk_log_size":1879,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8978432,"num_objects":137,"num_object_clones":0,"num_object_copies":411,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1879,"num_write_kb":64512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":109,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-22T03:55:17.175666+0000","last_change":"2024-09-22T03:49:17.029349+0000","last_active":"2024-09-22T03:55:17.175666+0000","last_peered":"2024-09-22T03:55:17.175666+0000","last_clean":"2024-09-22T03:55:17.175666+0000","last_became_active":"2024-09-22T03:49:15.094890+0000","last_became_peered":"2024-09-22T03:49:15.094890+0000","last_unstale":"2024-09-22T03:55:17.175666+0000","last_undegraded":"2024-09-22T03:55:17.175666+0000","last_fullsized":"2024-09-22T03:55:17.175666+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"47'1918","reported_seq":1954,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-22T03:55:26.023871+0000","last_change":"2024-09-22T03:52:38.248145+0000","last_active":"2024-09-22T03:55:26.023871+0000","last_peered":"2024-09-22T03:55:26.023871+0000","last_clean":"2024-09-22T03:55:26.023871+0000","last_became_active":"2024-09-22T03:52:38.241420+0000","last_became_peered":"2024-09-22T03:52:38.241420+0000","last_unstale":"2024-09-22T03:55:26.023871+0000","last_undegraded":"2024-09-22T03:55:26.023871+0000","last_fullsized":"2024-09-22T03:55:26.023871+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1918,"log_dups_size":0,"ondisk_log_size":1918,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9568256,"num_objects":146,"num_object_clones":0,"num_object_copies":438,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1918,"num_write_kb":66048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":111,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-22T03:55:17.155540+0000","last_change":"2024-09-22T03:49:17.031466+0000","last_active":"2024-09-22T03:55:17.155540+0000","last_peered":"2024-09-22T03:55:17.155540+0000","last_clean":"2024-09-22T03:55:17.155540+0000","last_became_active":"2024-09-22T03:49:15.098420+0000","last_became_peered":"2024-09-22T03:49:15.098420+0000","last_unstale":"2024-09-22T03:55:17.155540+0000","last_undegraded":"2024-09-22T03:55:17.155540+0000","last_fullsized":"2024-09-22T03:55:17.155540+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2","version":"47'1766","reported_seq":1802,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-22T03:55:25.048258+0000","last_change":"2024-09-22T03:52:38.215825+0000","last_active":"2024-09-22T03:55:25.048258+0000","last_peered":"2024-09-22T03:55:25.048258+0000","last_clean":"2024-09-22T03:55:25.048258+0000","last_became_active":"2024-09-22T03:52:38.203741+0000","last_became_peered":"2024-09-22T03:52:38.203741+0000","last_unstale":"2024-09-22T03:55:25.048258+0000","last_undegraded":"2024-09-22T03:55:25.048258+0000","last_fullsized":"2024-09-22T03:55:25.048258+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1766,"log_dups_size":0,"ondisk_log_size":1766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10092544,"num_objects":154,"num_object_clones":0,"num_object_copies":462,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1766,"num_write_kb":61440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":109,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-22T03:55:17.144675+0000","last_change":"2024-09-22T03:49:17.036954+0000","last_active":"2024-09-22T03:55:17.144675+0000","last_peered":"2024-09-22T03:55:17.144675+0000","last_clean":"2024-09-22T03:55:17.144675+0000","last_became_active":"2024-09-22T03:49:15.110506+0000","last_became_peered":"2024-09-22T03:49:15.110506+0000","last_unstale":"2024-09-22T03:55:17.144675+0000","last_undegraded":"2024-09-22T03:55:17.144675+0000","last_fullsized":"2024-09-22T03:55:17.144675+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"47'1812","reported_seq":1848,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-22T03:55:24.890304+0000","last_change":"2024-09-22T03:52:38.239558+0000","last_active":"2024-09-22T03:55:24.890304+0000","last_peered":"2024-09-22T03:55:24.890304+0000","last_clean":"2024-09-22T03:55:24.890304+0000","last_became_active":"2024-09-22T03:52:38.229931+0000","last_became_peered":"2024-09-22T03:52:38.229931+0000","last_unstale":"2024-09-22T03:55:24.890304+0000","last_undegraded":"2024-09-22T03:55:24.890304+0000","last_fullsized":"2024-09-22T03:55:24.890304+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1812,"log_dups_size":0,"ondisk_log_size":1812,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10878976,"num_objects":166,"num_object_clones":0,"num_object_copies":498,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1812,"num_write_kb":63296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":109,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-22T03:55:17.135172+0000","last_change":"2024-09-22T03:49:17.032989+0000","last_active":"2024-09-22T03:55:17.135172+0000","last_peered":"2024-09-22T03:55:17.135172+0000","last_clean":"2024-09-22T03:55:17.135172+0000","last_became_active":"2024-09-22T03:49:15.079260+0000","last_became_peered":"2024-09-22T03:49:15.079260+0000","last_unstale":"2024-09-22T03:55:17.135172+0000","last_undegraded":"2024-09-22T03:55:17.135172+0000","last_fullsized":"2024-09-22T03:55:17.135172+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"47'1801","reported_seq":1837,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-22T03:55:24.911603+0000","last_change":"2024-09-22T03:52:38.258650+0000","last_active":"2024-09-22T03:55:24.911603+0000","last_peered":"2024-09-22T03:55:24.911603+0000","last_clean":"2024-09-22T03:55:24.911603+0000","last_became_active":"2024-09-22T03:52:38.238553+0000","last_became_peered":"2024-09-22T03:52:38.238553+0000","last_unstale":"2024-09-22T03:55:24.911603+0000","last_undegraded":"2024-09-22T03:55:24.911603+0000","last_fullsized":"2024-09-22T03:55:24.911603+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1801,"log_dups_size":0,"ondisk_log_size":1801,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10813440,"num_objects":165,"num_object_clones":0,"num_object_copies":495,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1801,"num_write_kb":62912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":109,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-22T03:55:17.139778+0000","last_change":"2024-09-22T03:49:17.036402+0000","last_active":"2024-09-22T03:55:17.139778+0000","last_peered":"2024-09-22T03:55:17.139778+0000","last_clean":"2024-09-22T03:55:17.139778+0000","last_became_active":"2024-09-22T03:49:15.108430+0000","last_became_peered":"2024-09-22T03:49:15.108430+0000","last_unstale":"2024-09-22T03:55:17.139778+0000","last_undegraded":"2024-09-22T03:55:17.139778+0000","last_fullsized":"2024-09-22T03:55:17.139778+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"47'1742","reported_seq":1778,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-22T03:55:24.975979+0000","last_change":"2024-09-22T03:52:38.208326+0000","last_active":"2024-09-22T03:55:24.975979+0000","last_peered":"2024-09-22T03:55:24.975979+0000","last_clean":"2024-09-22T03:55:24.975979+0000","last_became_active":"2024-09-22T03:52:38.200509+0000","last_became_peered":"2024-09-22T03:52:38.200509+0000","last_unstale":"2024-09-22T03:55:24.975979+0000","last_undegraded":"2024-09-22T03:55:24.975979+0000","last_fullsized":"2024-09-22T03:55:24.975979+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1742,"log_dups_size":0,"ondisk_log_size":1742,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9699328,"num_objects":148,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1742,"num_write_kb":60480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":109,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-22T03:55:17.143293+0000","last_change":"2024-09-22T03:49:17.029128+0000","last_active":"2024-09-22T03:55:17.143293+0000","last_peered":"2024-09-22T03:55:17.143293+0000","last_clean":"2024-09-22T03:55:17.143293+0000","last_became_active":"2024-09-22T03:49:15.113396+0000","last_became_peered":"2024-09-22T03:49:15.113396+0000","last_unstale":"2024-09-22T03:55:17.143293+0000","last_undegraded":"2024-09-22T03:55:17.143293+0000","last_fullsized":"2024-09-22T03:55:17.143293+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":166395928,"num_objects":2540,"num_object_clones":0,"num_object_copies":7620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":28546,"num_write_kb":994689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":31453184,"data_stored":503054408,"data_compressed":23887712,"data_compressed_allocated":31440896,"data_compressed_original":503054336,"omap_allocated":0,"internal_metadata":0},"log_size":28546,"ondisk_log_size":28546,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949673334,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":70228,"kb_used_data":7300,"kb_used_omap":0,"kb_used_meta":62912,"kb_avail":94301612,"statfs":{"total":96636764160,"available":96564850688,"internally_reserved":0,"allocated":7475200,"data_stored":112928156,"data_compressed":5357800,"data_compressed_allocated":7053312,"data_compressed_original":112771072,"omap_allocated":0,"internal_metadata":64421888},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654706038,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":85188,"kb_used_data":9780,"kb_used_omap":0,"kb_used_meta":75392,"kb_avail":94286652,"statfs":{"total":96636764160,"available":96549531648,"internally_reserved":0,"allocated":10014720,"data_stored":153953148,"data_compressed":7303864,"data_compressed_allocated":9613312,"data_compressed_original":153812992,"omap_allocated":0,"internal_metadata":77201408},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706038,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":89256,"kb_used_data":9688,"kb_used_omap":0,"kb_used_meta":79552,"kb_avail":94282584,"statfs":{"total":96636764160,"available":96545366016,"internally_reserved":0,"allocated":9920512,"data_stored":152053148,"data_compressed":7215664,"data_compressed_allocated":9498624,"data_compressed_original":151896064,"omap_allocated":0,"internal_metadata":81461248},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706038,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":73304,"kb_used_data":6216,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94298536,"statfs":{"total":96636764160,"available":96561700864,"internally_reserved":0,"allocated":6365184,"data_stored":95298929,"data_compressed":4520672,"data_compressed_allocated":5951488,"data_compressed_original":95141888,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5824512,"data_stored":93192192,"data_compressed":4425264,"data_compressed_allocated":5824512,"data_compressed_original":93192192,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":6848512,"data_stored":109510680,"data_compressed":5200152,"data_compressed_allocated":6844416,"data_compressed_original":109510656,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":9342976,"data_stored":149422104,"data_compressed":7095360,"data_compressed_allocated":9338880,"data_compressed_original":149422080,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":9437184,"data_stored":150929432,"data_compressed":7166936,"data_compressed_allocated":9433088,"data_compressed_original":150929408,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:55:31.163 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:55:31.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:55:31.289+0000 7fa07e551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:55:31.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:55:31.297+0000 7fa07e551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:55:33.938 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:55:34.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:55:34.105+0000 7fbe30511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:55:34.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:55:34.113+0000 7fbe30511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:55:34.624 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:55:34.624 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:55:34.624 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:55:34.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:55:34.764+0000 7fa500791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:55:34.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:55:34.776+0000 7fa500791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:55:35.122 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:55:35.123 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-22T03:55:35.139 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":233,"stamp":"2024-09-22T03:55:35.044064+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":119276107,"num_objects":1816,"num_object_clones":0,"num_object_copies":5448,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":29355,"num_write_kb":995797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29329,"ondisk_log_size":29329,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":283968,"kb_used_data":23924,"kb_used_omap":0,"kb_used_meta":259968,"kb_avail":377203392,"statfs":{"total":386547056640,"available":386256273408,"internally_reserved":0,"allocated":24498176,"data_stored":365794341,"data_compressed":17349320,"data_compressed_allocated":22839296,"data_compressed_original":365182976,"omap_allocated":0,"internal_metadata":266207232},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-98697216,"num_objects":-1506,"num_object_clones":0,"num_object_copies":-4518,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1506,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002520"},"pg_stats":[{"pgid":"4.f","version":"47'1824","reported_seq":1860,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-22T03:55:30.888886+0000","last_change":"2024-09-22T03:52:38.267363+0000","last_active":"2024-09-22T03:55:30.888886+0000","last_peered":"2024-09-22T03:55:30.888886+0000","last_clean":"2024-09-22T03:55:30.888886+0000","last_became_active":"2024-09-22T03:52:38.261984+0000","last_became_peered":"2024-09-22T03:52:38.261984+0000","last_unstale":"2024-09-22T03:55:30.888886+0000","last_undegraded":"2024-09-22T03:55:30.888886+0000","last_fullsized":"2024-09-22T03:55:30.888886+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1824,"log_dups_size":0,"ondisk_log_size":1824,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7602176,"num_objects":116,"num_object_clones":0,"num_object_copies":348,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1824,"num_write_kb":62080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"47'1835","reported_seq":1871,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-22T03:55:30.476923+0000","last_change":"2024-09-22T03:52:38.211390+0000","last_active":"2024-09-22T03:55:30.476923+0000","last_peered":"2024-09-22T03:55:30.476923+0000","last_clean":"2024-09-22T03:55:30.476923+0000","last_became_active":"2024-09-22T03:52:38.190969+0000","last_became_peered":"2024-09-22T03:52:38.190969+0000","last_unstale":"2024-09-22T03:55:30.476923+0000","last_undegraded":"2024-09-22T03:55:30.476923+0000","last_fullsized":"2024-09-22T03:55:30.476923+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1835,"log_dups_size":0,"ondisk_log_size":1835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6356992,"num_objects":97,"num_object_clones":0,"num_object_copies":291,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1835,"num_write_kb":61824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"47'1753","reported_seq":1790,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-22T03:55:29.994820+0000","last_change":"2024-09-22T03:52:38.196399+0000","last_active":"2024-09-22T03:55:29.994820+0000","last_peered":"2024-09-22T03:55:29.994820+0000","last_clean":"2024-09-22T03:55:29.994820+0000","last_became_active":"2024-09-22T03:52:38.183573+0000","last_became_peered":"2024-09-22T03:52:38.183573+0000","last_unstale":"2024-09-22T03:55:29.994820+0000","last_undegraded":"2024-09-22T03:55:29.994820+0000","last_fullsized":"2024-09-22T03:55:29.994820+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1753,"log_dups_size":0,"ondisk_log_size":1753,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388632,"num_objects":129,"num_object_clones":0,"num_object_copies":387,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1753,"num_write_kb":60161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"47'1774","reported_seq":1810,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-22T03:55:29.842212+0000","last_change":"2024-09-22T03:52:38.241973+0000","last_active":"2024-09-22T03:55:29.842212+0000","last_peered":"2024-09-22T03:55:29.842212+0000","last_clean":"2024-09-22T03:55:29.842212+0000","last_became_active":"2024-09-22T03:52:38.234357+0000","last_became_peered":"2024-09-22T03:52:38.234357+0000","last_unstale":"2024-09-22T03:55:29.842212+0000","last_undegraded":"2024-09-22T03:55:29.842212+0000","last_fullsized":"2024-09-22T03:55:29.842212+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1774,"log_dups_size":0,"ondisk_log_size":1774,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":96,"num_object_clones":0,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1774,"num_write_kb":59840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"47'1748","reported_seq":1784,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-22T03:55:30.023242+0000","last_change":"2024-09-22T03:52:38.234728+0000","last_active":"2024-09-22T03:55:30.023242+0000","last_peered":"2024-09-22T03:55:30.023242+0000","last_clean":"2024-09-22T03:55:30.023242+0000","last_became_active":"2024-09-22T03:52:38.221861+0000","last_became_peered":"2024-09-22T03:52:38.221861+0000","last_unstale":"2024-09-22T03:55:30.023242+0000","last_undegraded":"2024-09-22T03:55:30.023242+0000","last_fullsized":"2024-09-22T03:55:30.023242+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1748,"log_dups_size":0,"ondisk_log_size":1748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7864320,"num_objects":120,"num_object_clones":0,"num_object_copies":360,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1748,"num_write_kb":59776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"47'1865","reported_seq":1901,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-22T03:55:30.018693+0000","last_change":"2024-09-22T03:52:38.235904+0000","last_active":"2024-09-22T03:55:30.018693+0000","last_peered":"2024-09-22T03:55:30.018693+0000","last_clean":"2024-09-22T03:55:30.018693+0000","last_became_active":"2024-09-22T03:52:38.225232+0000","last_became_peered":"2024-09-22T03:52:38.225232+0000","last_unstale":"2024-09-22T03:55:30.018693+0000","last_undegraded":"2024-09-22T03:55:30.018693+0000","last_fullsized":"2024-09-22T03:55:30.018693+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1865,"log_dups_size":0,"ondisk_log_size":1865,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7536640,"num_objects":115,"num_object_clones":0,"num_object_copies":345,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1865,"num_write_kb":63360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"47'1873","reported_seq":1909,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-22T03:55:29.784374+0000","last_change":"2024-09-22T03:52:38.200669+0000","last_active":"2024-09-22T03:55:29.784374+0000","last_peered":"2024-09-22T03:55:29.784374+0000","last_clean":"2024-09-22T03:55:29.784374+0000","last_became_active":"2024-09-22T03:52:38.190269+0000","last_became_peered":"2024-09-22T03:52:38.190269+0000","last_unstale":"2024-09-22T03:55:29.784374+0000","last_undegraded":"2024-09-22T03:55:29.784374+0000","last_fullsized":"2024-09-22T03:55:29.784374+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1873,"log_dups_size":0,"ondisk_log_size":1873,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8323072,"num_objects":127,"num_object_clones":0,"num_object_copies":381,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1873,"num_write_kb":64000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"47'1855","reported_seq":1891,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-22T03:55:29.905419+0000","last_change":"2024-09-22T03:52:38.177831+0000","last_active":"2024-09-22T03:55:29.905419+0000","last_peered":"2024-09-22T03:55:29.905419+0000","last_clean":"2024-09-22T03:55:29.905419+0000","last_became_active":"2024-09-22T03:52:38.169555+0000","last_became_peered":"2024-09-22T03:52:38.169555+0000","last_unstale":"2024-09-22T03:55:29.905419+0000","last_undegraded":"2024-09-22T03:55:29.905419+0000","last_fullsized":"2024-09-22T03:55:29.905419+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1855,"log_dups_size":0,"ondisk_log_size":1855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7798784,"num_objects":119,"num_object_clones":0,"num_object_copies":357,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1855,"num_write_kb":63168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"47'1808","reported_seq":1844,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-22T03:55:29.889008+0000","last_change":"2024-09-22T03:52:38.267240+0000","last_active":"2024-09-22T03:55:29.889008+0000","last_peered":"2024-09-22T03:55:29.889008+0000","last_clean":"2024-09-22T03:55:29.889008+0000","last_became_active":"2024-09-22T03:52:38.252880+0000","last_became_peered":"2024-09-22T03:52:38.252880+0000","last_unstale":"2024-09-22T03:55:29.889008+0000","last_undegraded":"2024-09-22T03:55:29.889008+0000","last_fullsized":"2024-09-22T03:55:29.889008+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1808,"log_dups_size":0,"ondisk_log_size":1808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7602176,"num_objects":116,"num_object_clones":0,"num_object_copies":348,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1808,"num_write_kb":61568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":184,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-22T03:55:17.137984+0000","last_change":"2024-09-22T03:49:12.034704+0000","last_active":"2024-09-22T03:55:17.137984+0000","last_peered":"2024-09-22T03:55:17.137984+0000","last_clean":"2024-09-22T03:55:17.137984+0000","last_became_active":"2024-09-22T03:49:12.027470+0000","last_became_peered":"2024-09-22T03:49:12.027470+0000","last_unstale":"2024-09-22T03:55:17.137984+0000","last_undegraded":"2024-09-22T03:55:17.137984+0000","last_fullsized":"2024-09-22T03:55:17.137984+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_clean_scrub_stamp":"2024-09-22T03:49:10.979949+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":110,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-22T03:55:17.150414+0000","last_change":"2024-09-22T03:49:17.031458+0000","last_active":"2024-09-22T03:55:17.150414+0000","last_peered":"2024-09-22T03:55:17.150414+0000","last_clean":"2024-09-22T03:55:17.150414+0000","last_became_active":"2024-09-22T03:49:15.125490+0000","last_became_peered":"2024-09-22T03:49:15.125490+0000","last_unstale":"2024-09-22T03:55:17.150414+0000","last_undegraded":"2024-09-22T03:55:17.150414+0000","last_fullsized":"2024-09-22T03:55:17.150414+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"47'1756","reported_seq":1792,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-22T03:55:29.815008+0000","last_change":"2024-09-22T03:52:38.263115+0000","last_active":"2024-09-22T03:55:29.815008+0000","last_peered":"2024-09-22T03:55:29.815008+0000","last_clean":"2024-09-22T03:55:29.815008+0000","last_became_active":"2024-09-22T03:52:38.245622+0000","last_became_peered":"2024-09-22T03:52:38.245622+0000","last_unstale":"2024-09-22T03:55:29.815008+0000","last_undegraded":"2024-09-22T03:55:29.815008+0000","last_fullsized":"2024-09-22T03:55:29.815008+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1756,"log_dups_size":0,"ondisk_log_size":1756,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8257536,"num_objects":126,"num_object_clones":0,"num_object_copies":378,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1756,"num_write_kb":60224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":109,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-22T03:55:17.144337+0000","last_change":"2024-09-22T03:49:17.029339+0000","last_active":"2024-09-22T03:55:17.144337+0000","last_peered":"2024-09-22T03:55:17.144337+0000","last_clean":"2024-09-22T03:55:17.144337+0000","last_became_active":"2024-09-22T03:49:15.097304+0000","last_became_peered":"2024-09-22T03:49:15.097304+0000","last_unstale":"2024-09-22T03:55:17.144337+0000","last_undegraded":"2024-09-22T03:55:17.144337+0000","last_fullsized":"2024-09-22T03:55:17.144337+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"47'1914","reported_seq":1950,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-22T03:55:30.734066+0000","last_change":"2024-09-22T03:52:38.234061+0000","last_active":"2024-09-22T03:55:30.734066+0000","last_peered":"2024-09-22T03:55:30.734066+0000","last_clean":"2024-09-22T03:55:30.734066+0000","last_became_active":"2024-09-22T03:52:38.222894+0000","last_became_peered":"2024-09-22T03:52:38.222894+0000","last_unstale":"2024-09-22T03:55:30.734066+0000","last_undegraded":"2024-09-22T03:55:30.734066+0000","last_fullsized":"2024-09-22T03:55:30.734066+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1914,"log_dups_size":0,"ondisk_log_size":1914,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6684672,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1914,"num_write_kb":64512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":109,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-22T03:55:17.175666+0000","last_change":"2024-09-22T03:49:17.029349+0000","last_active":"2024-09-22T03:55:17.175666+0000","last_peered":"2024-09-22T03:55:17.175666+0000","last_clean":"2024-09-22T03:55:17.175666+0000","last_became_active":"2024-09-22T03:49:15.094890+0000","last_became_peered":"2024-09-22T03:49:15.094890+0000","last_unstale":"2024-09-22T03:55:17.175666+0000","last_undegraded":"2024-09-22T03:55:17.175666+0000","last_fullsized":"2024-09-22T03:55:17.175666+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"47'1957","reported_seq":1993,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-22T03:55:30.955769+0000","last_change":"2024-09-22T03:52:38.248145+0000","last_active":"2024-09-22T03:55:30.955769+0000","last_peered":"2024-09-22T03:55:30.955769+0000","last_clean":"2024-09-22T03:55:30.955769+0000","last_became_active":"2024-09-22T03:52:38.241420+0000","last_became_peered":"2024-09-22T03:52:38.241420+0000","last_unstale":"2024-09-22T03:55:30.955769+0000","last_undegraded":"2024-09-22T03:55:30.955769+0000","last_fullsized":"2024-09-22T03:55:30.955769+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1957,"log_dups_size":0,"ondisk_log_size":1957,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7012352,"num_objects":107,"num_object_clones":0,"num_object_copies":321,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1957,"num_write_kb":66048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":111,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-22T03:55:17.155540+0000","last_change":"2024-09-22T03:49:17.031466+0000","last_active":"2024-09-22T03:55:17.155540+0000","last_peered":"2024-09-22T03:55:17.155540+0000","last_clean":"2024-09-22T03:55:17.155540+0000","last_became_active":"2024-09-22T03:49:15.098420+0000","last_became_peered":"2024-09-22T03:49:15.098420+0000","last_unstale":"2024-09-22T03:55:17.155540+0000","last_undegraded":"2024-09-22T03:55:17.155540+0000","last_fullsized":"2024-09-22T03:55:17.155540+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2","version":"47'1812","reported_seq":1848,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-22T03:55:30.012699+0000","last_change":"2024-09-22T03:52:38.215825+0000","last_active":"2024-09-22T03:55:30.012699+0000","last_peered":"2024-09-22T03:55:30.012699+0000","last_clean":"2024-09-22T03:55:30.012699+0000","last_became_active":"2024-09-22T03:52:38.203741+0000","last_became_peered":"2024-09-22T03:52:38.203741+0000","last_unstale":"2024-09-22T03:55:30.012699+0000","last_undegraded":"2024-09-22T03:55:30.012699+0000","last_fullsized":"2024-09-22T03:55:30.012699+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1812,"log_dups_size":0,"ondisk_log_size":1812,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7077888,"num_objects":108,"num_object_clones":0,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1812,"num_write_kb":61440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":109,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-22T03:55:17.144675+0000","last_change":"2024-09-22T03:49:17.036954+0000","last_active":"2024-09-22T03:55:17.144675+0000","last_peered":"2024-09-22T03:55:17.144675+0000","last_clean":"2024-09-22T03:55:17.144675+0000","last_became_active":"2024-09-22T03:49:15.110506+0000","last_became_peered":"2024-09-22T03:49:15.110506+0000","last_unstale":"2024-09-22T03:55:17.144675+0000","last_undegraded":"2024-09-22T03:55:17.144675+0000","last_fullsized":"2024-09-22T03:55:17.144675+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"47'1856","reported_seq":1892,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-22T03:55:30.052639+0000","last_change":"2024-09-22T03:52:38.239558+0000","last_active":"2024-09-22T03:55:30.052639+0000","last_peered":"2024-09-22T03:55:30.052639+0000","last_clean":"2024-09-22T03:55:30.052639+0000","last_became_active":"2024-09-22T03:52:38.229931+0000","last_became_peered":"2024-09-22T03:52:38.229931+0000","last_unstale":"2024-09-22T03:55:30.052639+0000","last_undegraded":"2024-09-22T03:55:30.052639+0000","last_fullsized":"2024-09-22T03:55:30.052639+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1856,"log_dups_size":0,"ondisk_log_size":1856,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7995392,"num_objects":122,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1856,"num_write_kb":63296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":109,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-22T03:55:17.135172+0000","last_change":"2024-09-22T03:49:17.032989+0000","last_active":"2024-09-22T03:55:17.135172+0000","last_peered":"2024-09-22T03:55:17.135172+0000","last_clean":"2024-09-22T03:55:17.135172+0000","last_became_active":"2024-09-22T03:49:15.079260+0000","last_became_peered":"2024-09-22T03:49:15.079260+0000","last_unstale":"2024-09-22T03:55:17.135172+0000","last_undegraded":"2024-09-22T03:55:17.135172+0000","last_fullsized":"2024-09-22T03:55:17.135172+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"47'1853","reported_seq":1889,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-22T03:55:29.823975+0000","last_change":"2024-09-22T03:52:38.258650+0000","last_active":"2024-09-22T03:55:29.823975+0000","last_peered":"2024-09-22T03:55:29.823975+0000","last_clean":"2024-09-22T03:55:29.823975+0000","last_became_active":"2024-09-22T03:52:38.238553+0000","last_became_peered":"2024-09-22T03:52:38.238553+0000","last_unstale":"2024-09-22T03:55:29.823975+0000","last_undegraded":"2024-09-22T03:55:29.823975+0000","last_fullsized":"2024-09-22T03:55:29.823975+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1853,"log_dups_size":0,"ondisk_log_size":1853,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7405568,"num_objects":113,"num_object_clones":0,"num_object_copies":339,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1853,"num_write_kb":62912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":109,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-22T03:55:17.139778+0000","last_change":"2024-09-22T03:49:17.036402+0000","last_active":"2024-09-22T03:55:17.139778+0000","last_peered":"2024-09-22T03:55:17.139778+0000","last_clean":"2024-09-22T03:55:17.139778+0000","last_became_active":"2024-09-22T03:49:15.108430+0000","last_became_peered":"2024-09-22T03:49:15.108430+0000","last_unstale":"2024-09-22T03:55:17.139778+0000","last_undegraded":"2024-09-22T03:55:17.139778+0000","last_fullsized":"2024-09-22T03:55:17.139778+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"47'1791","reported_seq":1827,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-22T03:55:30.023330+0000","last_change":"2024-09-22T03:52:38.208326+0000","last_active":"2024-09-22T03:55:30.023330+0000","last_peered":"2024-09-22T03:55:30.023330+0000","last_clean":"2024-09-22T03:55:30.023330+0000","last_became_active":"2024-09-22T03:52:38.200509+0000","last_became_peered":"2024-09-22T03:52:38.200509+0000","last_unstale":"2024-09-22T03:55:30.023330+0000","last_undegraded":"2024-09-22T03:55:30.023330+0000","last_fullsized":"2024-09-22T03:55:30.023330+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:52:37.061276+0000","last_clean_scrub_stamp":"2024-09-22T03:52:37.061276+0000","objects_scrubbed":0,"log_size":1791,"log_dups_size":0,"ondisk_log_size":1791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6488064,"num_objects":99,"num_object_clones":0,"num_object_copies":297,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1791,"num_write_kb":60480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":109,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-22T03:55:17.143293+0000","last_change":"2024-09-22T03:49:17.029128+0000","last_active":"2024-09-22T03:55:17.143293+0000","last_peered":"2024-09-22T03:55:17.143293+0000","last_clean":"2024-09-22T03:55:17.143293+0000","last_became_active":"2024-09-22T03:49:15.113396+0000","last_became_peered":"2024-09-22T03:49:15.113396+0000","last_unstale":"2024-09-22T03:55:17.143293+0000","last_undegraded":"2024-09-22T03:55:17.143293+0000","last_fullsized":"2024-09-22T03:55:17.143293+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":118685720,"num_objects":1812,"num_object_clones":0,"num_object_copies":5436,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":29274,"num_write_kb":994689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":22216704,"data_stored":355270728,"data_compressed":16870152,"data_compressed_allocated":22204416,"data_compressed_original":355270656,"omap_allocated":0,"internal_metadata":0},"log_size":29274,"ondisk_log_size":29274,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949673339,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":72324,"kb_used_data":5236,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94299516,"statfs":{"total":96636764160,"available":96562704384,"internally_reserved":0,"allocated":5361664,"data_stored":79111580,"data_compressed":3752008,"data_compressed_allocated":4939776,"data_compressed_original":78954496,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654706043,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":70044,"kb_used_data":7116,"kb_used_omap":0,"kb_used_meta":62912,"kb_avail":94301796,"statfs":{"total":96636764160,"available":96565039104,"internally_reserved":0,"allocated":7286784,"data_stored":110306172,"data_compressed":5231272,"data_compressed_allocated":6885376,"data_compressed_original":110166016,"omap_allocated":0,"internal_metadata":64421888},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706043,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":69972,"kb_used_data":7040,"kb_used_omap":0,"kb_used_meta":62912,"kb_avail":94301868,"statfs":{"total":96636764160,"available":96565112832,"internally_reserved":0,"allocated":7208960,"data_stored":108668316,"data_compressed":5155520,"data_compressed_allocated":6787072,"data_compressed_original":108511232,"omap_allocated":0,"internal_metadata":64421888},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706043,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":71628,"kb_used_data":4532,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94300212,"statfs":{"total":96636764160,"available":96563417088,"internally_reserved":0,"allocated":4640768,"data_stored":67708273,"data_compressed":3210520,"data_compressed_allocated":4227072,"data_compressed_original":67551232,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4087808,"data_stored":65404928,"data_compressed":3105776,"data_compressed_allocated":4087808,"data_compressed_original":65404928,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4771840,"data_stored":76283928,"data_compressed":3622368,"data_compressed_allocated":4767744,"data_compressed_original":76283904,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6631424,"data_stored":106037272,"data_compressed":5035216,"data_compressed_allocated":6627328,"data_compressed_original":106037248,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":6725632,"data_stored":107544600,"data_compressed":5106792,"data_compressed_allocated":6721536,"data_compressed_original":107544576,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:55:36.559 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:55:36.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:55:36.709+0000 7f6b02b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:55:36.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:55:36.717+0000 7f6b02b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:55:39.022 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:55:39.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:55:39.163+0000 7f9b55f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:55:39.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:55:39.171+0000 7f9b55f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:55:40.141 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:55:40.142 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:55:40.142 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:55:40.142 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:55:40.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:55:40.283+0000 7f217a911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:55:40.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:55:40.296+0000 7f217a911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:55:40.338 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:55:40.339 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:55:40.339 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:55:40.339 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:55:40.339 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:55:40.339 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:55:40.339 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:55:40.339 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:55:40.339 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:55:40.339 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:55:40.339 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:55:40.339 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:55:40.342 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:55:40.343 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:55:40.343 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:55:40.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:55:40.478+0000 7f46ec391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:55:40.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:55:40.491+0000 7f46ec391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:55:40.540 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:55:40.540 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:55:40.540 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:55:40.540 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:55:40.540 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:55:40.540 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:55:40.540 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:55:40.540 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:55:40.540 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:55:40.541 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:55:40.541 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:55:40.541 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:55:40.544 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:55:40.544 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:55:40.544 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:55:40.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:55:40.671+0000 7f6900ea3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:55:40.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:55:40.685+0000 7f6900ea3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:55:41.015 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:55:41.015 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:55:41.015 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:55:41.015 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:55:41.015 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:55:41.015 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:55:41.015 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:55:41.015 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:55:41.015 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:55:41.015 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:55:41.015 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:55:41.016 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:55:41.018 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:55:41.019 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:55:41.019 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:55:41.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:55:41.163+0000 7fa21eed1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:55:41.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:55:41.181+0000 7fa21eed1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:55:41.434 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:55:41.434 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:55:41.434 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:55:41.434 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:55:41.434 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:55:41.434 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:55:41.434 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:55:41.434 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:55:41.434 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:55:41.434 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:55:41.435 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:55:41.435 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:55:41.438 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:55:41.439 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:55:41.650 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:55:41.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:55:41.791+0000 7fa531d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:55:41.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:55:41.798+0000 7fa531d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:55:42.211 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Removed 15542 objects 2024-09-22T03:55:42.211 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Clean up completed and total clean up time :92.0085 2024-09-22T03:55:44.248 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:55:44.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:55:44.372+0000 7f6800711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:55:44.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:55:44.378+0000 7f6800711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:55:46.439 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:55:46.440 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-22T03:55:46.481 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:55:46.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:55:46.565+0000 7f3385b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:55:46.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:55:46.578+0000 7f3385b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:55:46.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:55:46.602+0000 7f45e86d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:55:46.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:55:46.609+0000 7f45e86d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:55:47.715 INFO:teuthology.orchestra.run.smithi037.stderr:reweighted osd.0 to 1 (10000) 2024-09-22T03:55:47.739 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-22T03:55:47.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:55:47.855+0000 7fb0fe591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:55:47.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:55:47.866+0000 7fb0fe591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:55:48.232 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_1 2024-09-22T03:55:48.233 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_1 unique_pool_1 --yes-i-really-really-mean-it 2024-09-22T03:55:48.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:55:48.342+0000 7f46f7551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:55:48.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:55:48.355+0000 7f46f7551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:55:48.715 INFO:teuthology.orchestra.run.smithi037.stderr:reweighted osd.1 to 1 (10000) 2024-09-22T03:55:48.716 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'unique_pool_1' removed 2024-09-22T03:55:48.718 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:55:48.737 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-22T03:55:48.740 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2024-09-22T03:55:48.741 INFO:tasks.radosbench:Beginning radosbench... 2024-09-22T03:55:48.741 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_2 2024-09-22T03:55:48.741 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_2 16 2024-09-22T03:55:48.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:55:48.901+0000 7fca65b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:55:48.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:55:48.911+0000 7fca65b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:55:48.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:55:48.938+0000 7fcef30c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:55:48.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:55:48.953+0000 7fcef1e66640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:55:48.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:55:48.958+0000 7fd550f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:55:48.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:55:48.979+0000 7fd550f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:55:49.722 INFO:teuthology.orchestra.run.smithi037.stderr:reweighted osd.2 to 1 (10000) 2024-09-22T03:55:49.722 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'unique_pool_2' created 2024-09-22T03:55:49.741 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-22T03:55:49.744 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_2 rados --yes-i-really-mean-it || true 2024-09-22T03:55:49.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:55:49.875+0000 7f940c591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:55:49.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:55:49.888+0000 7f940c591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:55:49.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:55:49.915+0000 7f9937191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:55:49.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:55:49.930+0000 7f9937191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:55:50.731 INFO:teuthology.orchestra.run.smithi037.stderr:reweighted osd.3 to 1 (10000) 2024-09-22T03:55:50.731 INFO:teuthology.orchestra.run.smithi037.stderr:enabled application 'rados' on pool 'unique_pool_2' 2024-09-22T03:55:50.759 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-22T03:55:50.759 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:55:50.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:55:50.951+0000 7f2995aa3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:55:50.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:55:50.962+0000 7f2995aa3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:55:51.176 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:55:51.176 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-22T03:55:51.177 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:55:51.189 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":245,"stamp":"2024-09-22T03:55:51.047904+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":63,"acting":63,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":286804,"kb_used_data":1812,"kb_used_omap":0,"kb_used_meta":284928,"kb_avail":377200556,"statfs":{"total":386547056640,"available":386253369344,"internally_reserved":0,"allocated":1855488,"data_stored":2362075,"data_compressed":90168,"data_compressed_allocated":122880,"data_compressed_original":1720320,"omap_allocated":0,"internal_metadata":291766272},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-31086,"num_write_kb":-994689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001013"},"pg_stats":[{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-22T03:55:49.719929+0000","last_change":"2024-09-22T03:55:49.719929+0000","last_active":"2024-09-22T03:55:49.719929+0000","last_peered":"2024-09-22T03:55:49.719929+0000","last_clean":"2024-09-22T03:55:49.719929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:55:49.719929+0000","last_undegraded":"2024-09-22T03:55:49.719929+0000","last_fullsized":"2024-09-22T03:55:49.719929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-22T03:55:49.799319+0000","last_change":"2024-09-22T03:55:49.799319+0000","last_active":"2024-09-22T03:55:49.719929+0000","last_peered":"2024-09-22T03:55:49.719929+0000","last_clean":"2024-09-22T03:55:49.719929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:55:49.799319+0000","last_undegraded":"2024-09-22T03:55:49.799319+0000","last_fullsized":"2024-09-22T03:55:49.799319+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-22T03:55:49.784457+0000","last_change":"2024-09-22T03:55:49.784457+0000","last_active":"2024-09-22T03:55:49.719929+0000","last_peered":"2024-09-22T03:55:49.719929+0000","last_clean":"2024-09-22T03:55:49.719929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:55:49.784457+0000","last_undegraded":"2024-09-22T03:55:49.784457+0000","last_fullsized":"2024-09-22T03:55:49.784457+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-22T03:55:49.719929+0000","last_change":"2024-09-22T03:55:49.719929+0000","last_active":"2024-09-22T03:55:49.719929+0000","last_peered":"2024-09-22T03:55:49.719929+0000","last_clean":"2024-09-22T03:55:49.719929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:55:49.719929+0000","last_undegraded":"2024-09-22T03:55:49.719929+0000","last_fullsized":"2024-09-22T03:55:49.719929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-22T03:55:49.770701+0000","last_change":"2024-09-22T03:55:49.770701+0000","last_active":"2024-09-22T03:55:49.719929+0000","last_peered":"2024-09-22T03:55:49.719929+0000","last_clean":"2024-09-22T03:55:49.719929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:55:49.770701+0000","last_undegraded":"2024-09-22T03:55:49.770701+0000","last_fullsized":"2024-09-22T03:55:49.770701+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-22T03:55:49.796652+0000","last_change":"2024-09-22T03:55:49.796652+0000","last_active":"2024-09-22T03:55:49.719929+0000","last_peered":"2024-09-22T03:55:49.719929+0000","last_clean":"2024-09-22T03:55:49.719929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:55:49.796652+0000","last_undegraded":"2024-09-22T03:55:49.796652+0000","last_fullsized":"2024-09-22T03:55:49.796652+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-22T03:55:49.780945+0000","last_change":"2024-09-22T03:55:49.780945+0000","last_active":"2024-09-22T03:55:49.719929+0000","last_peered":"2024-09-22T03:55:49.719929+0000","last_clean":"2024-09-22T03:55:49.719929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:55:49.780945+0000","last_undegraded":"2024-09-22T03:55:49.780945+0000","last_fullsized":"2024-09-22T03:55:49.780945+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-22T03:55:49.740054+0000","last_change":"2024-09-22T03:55:49.740054+0000","last_active":"2024-09-22T03:55:49.719929+0000","last_peered":"2024-09-22T03:55:49.719929+0000","last_clean":"2024-09-22T03:55:49.719929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:55:49.740054+0000","last_undegraded":"2024-09-22T03:55:49.740054+0000","last_fullsized":"2024-09-22T03:55:49.740054+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-22T03:55:49.758129+0000","last_change":"2024-09-22T03:55:49.758129+0000","last_active":"2024-09-22T03:55:49.719929+0000","last_peered":"2024-09-22T03:55:49.719929+0000","last_clean":"2024-09-22T03:55:49.719929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:55:49.758129+0000","last_undegraded":"2024-09-22T03:55:49.758129+0000","last_fullsized":"2024-09-22T03:55:49.758129+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":184,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-22T03:55:17.137984+0000","last_change":"2024-09-22T03:49:12.034704+0000","last_active":"2024-09-22T03:55:17.137984+0000","last_peered":"2024-09-22T03:55:17.137984+0000","last_clean":"2024-09-22T03:55:17.137984+0000","last_became_active":"2024-09-22T03:49:12.027470+0000","last_became_peered":"2024-09-22T03:49:12.027470+0000","last_unstale":"2024-09-22T03:55:17.137984+0000","last_undegraded":"2024-09-22T03:55:17.137984+0000","last_fullsized":"2024-09-22T03:55:17.137984+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_clean_scrub_stamp":"2024-09-22T03:49:10.979949+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":119,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:55:49.733917+0000","last_change":"2024-09-22T03:49:17.031458+0000","last_active":"2024-09-22T03:55:49.733917+0000","last_peered":"2024-09-22T03:55:49.733917+0000","last_clean":"2024-09-22T03:55:49.733917+0000","last_became_active":"2024-09-22T03:49:15.125490+0000","last_became_peered":"2024-09-22T03:49:15.125490+0000","last_unstale":"2024-09-22T03:55:49.733917+0000","last_undegraded":"2024-09-22T03:55:49.733917+0000","last_fullsized":"2024-09-22T03:55:49.733917+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-22T03:55:49.763824+0000","last_change":"2024-09-22T03:55:49.763824+0000","last_active":"2024-09-22T03:55:49.719929+0000","last_peered":"2024-09-22T03:55:49.719929+0000","last_clean":"2024-09-22T03:55:49.719929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:55:49.763824+0000","last_undegraded":"2024-09-22T03:55:49.763824+0000","last_fullsized":"2024-09-22T03:55:49.763824+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":118,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:55:49.731059+0000","last_change":"2024-09-22T03:49:17.029339+0000","last_active":"2024-09-22T03:55:49.731059+0000","last_peered":"2024-09-22T03:55:49.731059+0000","last_clean":"2024-09-22T03:55:49.731059+0000","last_became_active":"2024-09-22T03:49:15.097304+0000","last_became_peered":"2024-09-22T03:49:15.097304+0000","last_unstale":"2024-09-22T03:55:49.731059+0000","last_undegraded":"2024-09-22T03:55:49.731059+0000","last_fullsized":"2024-09-22T03:55:49.731059+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-22T03:55:49.719929+0000","last_change":"2024-09-22T03:55:49.719929+0000","last_active":"2024-09-22T03:55:49.719929+0000","last_peered":"2024-09-22T03:55:49.719929+0000","last_clean":"2024-09-22T03:55:49.719929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:55:49.719929+0000","last_undegraded":"2024-09-22T03:55:49.719929+0000","last_fullsized":"2024-09-22T03:55:49.719929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":118,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:55:49.733156+0000","last_change":"2024-09-22T03:49:17.029349+0000","last_active":"2024-09-22T03:55:49.733156+0000","last_peered":"2024-09-22T03:55:49.733156+0000","last_clean":"2024-09-22T03:55:49.733156+0000","last_became_active":"2024-09-22T03:49:15.094890+0000","last_became_peered":"2024-09-22T03:49:15.094890+0000","last_unstale":"2024-09-22T03:55:49.733156+0000","last_undegraded":"2024-09-22T03:55:49.733156+0000","last_fullsized":"2024-09-22T03:55:49.733156+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-22T03:55:49.775066+0000","last_change":"2024-09-22T03:55:49.775066+0000","last_active":"2024-09-22T03:55:49.719929+0000","last_peered":"2024-09-22T03:55:49.719929+0000","last_clean":"2024-09-22T03:55:49.719929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:55:49.775066+0000","last_undegraded":"2024-09-22T03:55:49.775066+0000","last_fullsized":"2024-09-22T03:55:49.775066+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":120,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:55:49.733716+0000","last_change":"2024-09-22T03:49:17.031466+0000","last_active":"2024-09-22T03:55:49.733716+0000","last_peered":"2024-09-22T03:55:49.733716+0000","last_clean":"2024-09-22T03:55:49.733716+0000","last_became_active":"2024-09-22T03:49:15.098420+0000","last_became_peered":"2024-09-22T03:49:15.098420+0000","last_unstale":"2024-09-22T03:55:49.733716+0000","last_undegraded":"2024-09-22T03:55:49.733716+0000","last_fullsized":"2024-09-22T03:55:49.733716+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-22T03:55:49.742931+0000","last_change":"2024-09-22T03:55:49.742931+0000","last_active":"2024-09-22T03:55:49.719929+0000","last_peered":"2024-09-22T03:55:49.719929+0000","last_clean":"2024-09-22T03:55:49.719929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:55:49.742931+0000","last_undegraded":"2024-09-22T03:55:49.742931+0000","last_fullsized":"2024-09-22T03:55:49.742931+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":109,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-22T03:55:17.144675+0000","last_change":"2024-09-22T03:49:17.036954+0000","last_active":"2024-09-22T03:55:17.144675+0000","last_peered":"2024-09-22T03:55:17.144675+0000","last_clean":"2024-09-22T03:55:17.144675+0000","last_became_active":"2024-09-22T03:49:15.110506+0000","last_became_peered":"2024-09-22T03:49:15.110506+0000","last_unstale":"2024-09-22T03:55:17.144675+0000","last_undegraded":"2024-09-22T03:55:17.144675+0000","last_fullsized":"2024-09-22T03:55:17.144675+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-22T03:55:49.751658+0000","last_change":"2024-09-22T03:55:49.751658+0000","last_active":"2024-09-22T03:55:49.719929+0000","last_peered":"2024-09-22T03:55:49.719929+0000","last_clean":"2024-09-22T03:55:49.719929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:55:49.751658+0000","last_undegraded":"2024-09-22T03:55:49.751658+0000","last_fullsized":"2024-09-22T03:55:49.751658+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":109,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-22T03:55:17.135172+0000","last_change":"2024-09-22T03:49:17.032989+0000","last_active":"2024-09-22T03:55:17.135172+0000","last_peered":"2024-09-22T03:55:17.135172+0000","last_clean":"2024-09-22T03:55:17.135172+0000","last_became_active":"2024-09-22T03:49:15.079260+0000","last_became_peered":"2024-09-22T03:49:15.079260+0000","last_unstale":"2024-09-22T03:55:17.135172+0000","last_undegraded":"2024-09-22T03:55:17.135172+0000","last_fullsized":"2024-09-22T03:55:17.135172+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-22T03:55:49.719929+0000","last_change":"2024-09-22T03:55:49.719929+0000","last_active":"2024-09-22T03:55:49.719929+0000","last_peered":"2024-09-22T03:55:49.719929+0000","last_clean":"2024-09-22T03:55:49.719929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:55:49.719929+0000","last_undegraded":"2024-09-22T03:55:49.719929+0000","last_fullsized":"2024-09-22T03:55:49.719929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":109,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-22T03:55:17.139778+0000","last_change":"2024-09-22T03:49:17.036402+0000","last_active":"2024-09-22T03:55:17.139778+0000","last_peered":"2024-09-22T03:55:17.139778+0000","last_clean":"2024-09-22T03:55:17.139778+0000","last_became_active":"2024-09-22T03:49:15.108430+0000","last_became_peered":"2024-09-22T03:49:15.108430+0000","last_unstale":"2024-09-22T03:55:17.139778+0000","last_undegraded":"2024-09-22T03:55:17.139778+0000","last_fullsized":"2024-09-22T03:55:17.139778+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-22T03:55:49.740054+0000","last_change":"2024-09-22T03:55:49.740054+0000","last_active":"2024-09-22T03:55:49.719929+0000","last_peered":"2024-09-22T03:55:49.719929+0000","last_clean":"2024-09-22T03:55:49.719929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:55:49.740054+0000","last_undegraded":"2024-09-22T03:55:49.740054+0000","last_fullsized":"2024-09-22T03:55:49.740054+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":118,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:55:49.731926+0000","last_change":"2024-09-22T03:49:17.029128+0000","last_active":"2024-09-22T03:55:49.731926+0000","last_peered":"2024-09-22T03:55:49.731926+0000","last_clean":"2024-09-22T03:55:49.731926+0000","last_became_active":"2024-09-22T03:49:15.113396+0000","last_became_peered":"2024-09-22T03:49:15.113396+0000","last_unstale":"2024-09-22T03:55:49.731926+0000","last_undegraded":"2024-09-22T03:55:49.731926+0000","last_fullsized":"2024-09-22T03:55:49.731926+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":36,"acting":36,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949673354,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":71696,"kb_used_data":448,"kb_used_omap":0,"kb_used_meta":71232,"kb_avail":94300144,"statfs":{"total":96636764160,"available":96563347456,"internally_reserved":0,"allocated":458752,"data_stored":730500,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":72941568},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654706063,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":71664,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":71232,"kb_avail":94300176,"statfs":{"total":96636764160,"available":96563380224,"internally_reserved":0,"allocated":425984,"data_stored":150286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":72941568},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706063,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":71724,"kb_used_data":476,"kb_used_omap":0,"kb_used_meta":71232,"kb_avail":94300116,"statfs":{"total":96636764160,"available":96563318784,"internally_reserved":0,"allocated":487424,"data_stored":740654,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":72941568},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706063,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":71720,"kb_used_data":472,"kb_used_omap":0,"kb_used_meta":71232,"kb_avail":94300120,"statfs":{"total":96636764160,"available":96563322880,"internally_reserved":0,"allocated":483328,"data_stored":740635,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":72941568},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:55:51.191 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:55:51.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:55:51.287+0000 7ff6ead91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:55:51.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:55:51.293+0000 7ff6ead91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:55:51.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:55:51.344+0000 7fbb8cac8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:55:51.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:55:51.353+0000 7fbb8cac8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:55:51.555 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:55:51.556 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-22T03:55:51.568 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":245,"stamp":"2024-09-22T03:55:51.047904+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":63,"acting":63,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":286804,"kb_used_data":1812,"kb_used_omap":0,"kb_used_meta":284928,"kb_avail":377200556,"statfs":{"total":386547056640,"available":386253369344,"internally_reserved":0,"allocated":1855488,"data_stored":2362075,"data_compressed":90168,"data_compressed_allocated":122880,"data_compressed_original":1720320,"omap_allocated":0,"internal_metadata":291766272},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-31086,"num_write_kb":-994689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001013"},"pg_stats":[{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-22T03:55:49.719929+0000","last_change":"2024-09-22T03:55:49.719929+0000","last_active":"2024-09-22T03:55:49.719929+0000","last_peered":"2024-09-22T03:55:49.719929+0000","last_clean":"2024-09-22T03:55:49.719929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:55:49.719929+0000","last_undegraded":"2024-09-22T03:55:49.719929+0000","last_fullsized":"2024-09-22T03:55:49.719929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-22T03:55:49.799319+0000","last_change":"2024-09-22T03:55:49.799319+0000","last_active":"2024-09-22T03:55:49.719929+0000","last_peered":"2024-09-22T03:55:49.719929+0000","last_clean":"2024-09-22T03:55:49.719929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:55:49.799319+0000","last_undegraded":"2024-09-22T03:55:49.799319+0000","last_fullsized":"2024-09-22T03:55:49.799319+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-22T03:55:49.784457+0000","last_change":"2024-09-22T03:55:49.784457+0000","last_active":"2024-09-22T03:55:49.719929+0000","last_peered":"2024-09-22T03:55:49.719929+0000","last_clean":"2024-09-22T03:55:49.719929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:55:49.784457+0000","last_undegraded":"2024-09-22T03:55:49.784457+0000","last_fullsized":"2024-09-22T03:55:49.784457+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-22T03:55:49.719929+0000","last_change":"2024-09-22T03:55:49.719929+0000","last_active":"2024-09-22T03:55:49.719929+0000","last_peered":"2024-09-22T03:55:49.719929+0000","last_clean":"2024-09-22T03:55:49.719929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:55:49.719929+0000","last_undegraded":"2024-09-22T03:55:49.719929+0000","last_fullsized":"2024-09-22T03:55:49.719929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-22T03:55:49.770701+0000","last_change":"2024-09-22T03:55:49.770701+0000","last_active":"2024-09-22T03:55:49.719929+0000","last_peered":"2024-09-22T03:55:49.719929+0000","last_clean":"2024-09-22T03:55:49.719929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:55:49.770701+0000","last_undegraded":"2024-09-22T03:55:49.770701+0000","last_fullsized":"2024-09-22T03:55:49.770701+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-22T03:55:49.796652+0000","last_change":"2024-09-22T03:55:49.796652+0000","last_active":"2024-09-22T03:55:49.719929+0000","last_peered":"2024-09-22T03:55:49.719929+0000","last_clean":"2024-09-22T03:55:49.719929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:55:49.796652+0000","last_undegraded":"2024-09-22T03:55:49.796652+0000","last_fullsized":"2024-09-22T03:55:49.796652+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-22T03:55:49.780945+0000","last_change":"2024-09-22T03:55:49.780945+0000","last_active":"2024-09-22T03:55:49.719929+0000","last_peered":"2024-09-22T03:55:49.719929+0000","last_clean":"2024-09-22T03:55:49.719929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:55:49.780945+0000","last_undegraded":"2024-09-22T03:55:49.780945+0000","last_fullsized":"2024-09-22T03:55:49.780945+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-22T03:55:49.740054+0000","last_change":"2024-09-22T03:55:49.740054+0000","last_active":"2024-09-22T03:55:49.719929+0000","last_peered":"2024-09-22T03:55:49.719929+0000","last_clean":"2024-09-22T03:55:49.719929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:55:49.740054+0000","last_undegraded":"2024-09-22T03:55:49.740054+0000","last_fullsized":"2024-09-22T03:55:49.740054+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-22T03:55:49.758129+0000","last_change":"2024-09-22T03:55:49.758129+0000","last_active":"2024-09-22T03:55:49.719929+0000","last_peered":"2024-09-22T03:55:49.719929+0000","last_clean":"2024-09-22T03:55:49.719929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:55:49.758129+0000","last_undegraded":"2024-09-22T03:55:49.758129+0000","last_fullsized":"2024-09-22T03:55:49.758129+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":184,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-22T03:55:17.137984+0000","last_change":"2024-09-22T03:49:12.034704+0000","last_active":"2024-09-22T03:55:17.137984+0000","last_peered":"2024-09-22T03:55:17.137984+0000","last_clean":"2024-09-22T03:55:17.137984+0000","last_became_active":"2024-09-22T03:49:12.027470+0000","last_became_peered":"2024-09-22T03:49:12.027470+0000","last_unstale":"2024-09-22T03:55:17.137984+0000","last_undegraded":"2024-09-22T03:55:17.137984+0000","last_fullsized":"2024-09-22T03:55:17.137984+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_clean_scrub_stamp":"2024-09-22T03:49:10.979949+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":119,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:55:49.733917+0000","last_change":"2024-09-22T03:49:17.031458+0000","last_active":"2024-09-22T03:55:49.733917+0000","last_peered":"2024-09-22T03:55:49.733917+0000","last_clean":"2024-09-22T03:55:49.733917+0000","last_became_active":"2024-09-22T03:49:15.125490+0000","last_became_peered":"2024-09-22T03:49:15.125490+0000","last_unstale":"2024-09-22T03:55:49.733917+0000","last_undegraded":"2024-09-22T03:55:49.733917+0000","last_fullsized":"2024-09-22T03:55:49.733917+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-22T03:55:49.763824+0000","last_change":"2024-09-22T03:55:49.763824+0000","last_active":"2024-09-22T03:55:49.719929+0000","last_peered":"2024-09-22T03:55:49.719929+0000","last_clean":"2024-09-22T03:55:49.719929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:55:49.763824+0000","last_undegraded":"2024-09-22T03:55:49.763824+0000","last_fullsized":"2024-09-22T03:55:49.763824+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":118,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:55:49.731059+0000","last_change":"2024-09-22T03:49:17.029339+0000","last_active":"2024-09-22T03:55:49.731059+0000","last_peered":"2024-09-22T03:55:49.731059+0000","last_clean":"2024-09-22T03:55:49.731059+0000","last_became_active":"2024-09-22T03:49:15.097304+0000","last_became_peered":"2024-09-22T03:49:15.097304+0000","last_unstale":"2024-09-22T03:55:49.731059+0000","last_undegraded":"2024-09-22T03:55:49.731059+0000","last_fullsized":"2024-09-22T03:55:49.731059+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-22T03:55:49.719929+0000","last_change":"2024-09-22T03:55:49.719929+0000","last_active":"2024-09-22T03:55:49.719929+0000","last_peered":"2024-09-22T03:55:49.719929+0000","last_clean":"2024-09-22T03:55:49.719929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:55:49.719929+0000","last_undegraded":"2024-09-22T03:55:49.719929+0000","last_fullsized":"2024-09-22T03:55:49.719929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":118,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:55:49.733156+0000","last_change":"2024-09-22T03:49:17.029349+0000","last_active":"2024-09-22T03:55:49.733156+0000","last_peered":"2024-09-22T03:55:49.733156+0000","last_clean":"2024-09-22T03:55:49.733156+0000","last_became_active":"2024-09-22T03:49:15.094890+0000","last_became_peered":"2024-09-22T03:49:15.094890+0000","last_unstale":"2024-09-22T03:55:49.733156+0000","last_undegraded":"2024-09-22T03:55:49.733156+0000","last_fullsized":"2024-09-22T03:55:49.733156+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-22T03:55:49.775066+0000","last_change":"2024-09-22T03:55:49.775066+0000","last_active":"2024-09-22T03:55:49.719929+0000","last_peered":"2024-09-22T03:55:49.719929+0000","last_clean":"2024-09-22T03:55:49.719929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:55:49.775066+0000","last_undegraded":"2024-09-22T03:55:49.775066+0000","last_fullsized":"2024-09-22T03:55:49.775066+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":120,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:55:49.733716+0000","last_change":"2024-09-22T03:49:17.031466+0000","last_active":"2024-09-22T03:55:49.733716+0000","last_peered":"2024-09-22T03:55:49.733716+0000","last_clean":"2024-09-22T03:55:49.733716+0000","last_became_active":"2024-09-22T03:49:15.098420+0000","last_became_peered":"2024-09-22T03:49:15.098420+0000","last_unstale":"2024-09-22T03:55:49.733716+0000","last_undegraded":"2024-09-22T03:55:49.733716+0000","last_fullsized":"2024-09-22T03:55:49.733716+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-22T03:55:49.742931+0000","last_change":"2024-09-22T03:55:49.742931+0000","last_active":"2024-09-22T03:55:49.719929+0000","last_peered":"2024-09-22T03:55:49.719929+0000","last_clean":"2024-09-22T03:55:49.719929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:55:49.742931+0000","last_undegraded":"2024-09-22T03:55:49.742931+0000","last_fullsized":"2024-09-22T03:55:49.742931+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":109,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-22T03:55:17.144675+0000","last_change":"2024-09-22T03:49:17.036954+0000","last_active":"2024-09-22T03:55:17.144675+0000","last_peered":"2024-09-22T03:55:17.144675+0000","last_clean":"2024-09-22T03:55:17.144675+0000","last_became_active":"2024-09-22T03:49:15.110506+0000","last_became_peered":"2024-09-22T03:49:15.110506+0000","last_unstale":"2024-09-22T03:55:17.144675+0000","last_undegraded":"2024-09-22T03:55:17.144675+0000","last_fullsized":"2024-09-22T03:55:17.144675+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-22T03:55:49.751658+0000","last_change":"2024-09-22T03:55:49.751658+0000","last_active":"2024-09-22T03:55:49.719929+0000","last_peered":"2024-09-22T03:55:49.719929+0000","last_clean":"2024-09-22T03:55:49.719929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:55:49.751658+0000","last_undegraded":"2024-09-22T03:55:49.751658+0000","last_fullsized":"2024-09-22T03:55:49.751658+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":109,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-22T03:55:17.135172+0000","last_change":"2024-09-22T03:49:17.032989+0000","last_active":"2024-09-22T03:55:17.135172+0000","last_peered":"2024-09-22T03:55:17.135172+0000","last_clean":"2024-09-22T03:55:17.135172+0000","last_became_active":"2024-09-22T03:49:15.079260+0000","last_became_peered":"2024-09-22T03:49:15.079260+0000","last_unstale":"2024-09-22T03:55:17.135172+0000","last_undegraded":"2024-09-22T03:55:17.135172+0000","last_fullsized":"2024-09-22T03:55:17.135172+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-22T03:55:49.719929+0000","last_change":"2024-09-22T03:55:49.719929+0000","last_active":"2024-09-22T03:55:49.719929+0000","last_peered":"2024-09-22T03:55:49.719929+0000","last_clean":"2024-09-22T03:55:49.719929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:55:49.719929+0000","last_undegraded":"2024-09-22T03:55:49.719929+0000","last_fullsized":"2024-09-22T03:55:49.719929+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":109,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-22T03:55:17.139778+0000","last_change":"2024-09-22T03:49:17.036402+0000","last_active":"2024-09-22T03:55:17.139778+0000","last_peered":"2024-09-22T03:55:17.139778+0000","last_clean":"2024-09-22T03:55:17.139778+0000","last_became_active":"2024-09-22T03:49:15.108430+0000","last_became_peered":"2024-09-22T03:49:15.108430+0000","last_unstale":"2024-09-22T03:55:17.139778+0000","last_undegraded":"2024-09-22T03:55:17.139778+0000","last_fullsized":"2024-09-22T03:55:17.139778+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-22T03:55:49.740054+0000","last_change":"2024-09-22T03:55:49.740054+0000","last_active":"2024-09-22T03:55:49.719929+0000","last_peered":"2024-09-22T03:55:49.719929+0000","last_clean":"2024-09-22T03:55:49.719929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:55:49.740054+0000","last_undegraded":"2024-09-22T03:55:49.740054+0000","last_fullsized":"2024-09-22T03:55:49.740054+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":118,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:55:49.731926+0000","last_change":"2024-09-22T03:49:17.029128+0000","last_active":"2024-09-22T03:55:49.731926+0000","last_peered":"2024-09-22T03:55:49.731926+0000","last_clean":"2024-09-22T03:55:49.731926+0000","last_became_active":"2024-09-22T03:49:15.113396+0000","last_became_peered":"2024-09-22T03:49:15.113396+0000","last_unstale":"2024-09-22T03:55:49.731926+0000","last_undegraded":"2024-09-22T03:55:49.731926+0000","last_fullsized":"2024-09-22T03:55:49.731926+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":36,"acting":36,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949673354,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":71696,"kb_used_data":448,"kb_used_omap":0,"kb_used_meta":71232,"kb_avail":94300144,"statfs":{"total":96636764160,"available":96563347456,"internally_reserved":0,"allocated":458752,"data_stored":730500,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":72941568},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654706063,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":71664,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":71232,"kb_avail":94300176,"statfs":{"total":96636764160,"available":96563380224,"internally_reserved":0,"allocated":425984,"data_stored":150286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":72941568},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706063,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":71724,"kb_used_data":476,"kb_used_omap":0,"kb_used_meta":71232,"kb_avail":94300116,"statfs":{"total":96636764160,"available":96563318784,"internally_reserved":0,"allocated":487424,"data_stored":740654,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":72941568},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706063,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":71720,"kb_used_data":472,"kb_used_omap":0,"kb_used_meta":71232,"kb_avail":94300120,"statfs":{"total":96636764160,"available":96563322880,"internally_reserved":0,"allocated":483328,"data_stored":740635,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":72941568},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:55:51.570 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-22T03:55:51.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:55:51.678+0000 7f44a8951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:55:51.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:55:51.686+0000 7f44a8951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:55:51.754 DEBUG:teuthology.orchestra.run.smithi037:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -b 65536 --object-size 65536 -p unique_pool_2 bench 90 write' 2024-09-22T03:55:51.757 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2024-09-22T03:55:51.757 INFO:teuthology.orchestra.run:waiting for 3000 2024-09-22T03:55:51.822 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:hints = 1 2024-09-22T03:55:51.823 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Maintaining 16 concurrent writes of 65536 bytes to objects of size 65536 for up to 90 seconds or 0 objects 2024-09-22T03:55:51.823 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Object prefix: benchmark_data_smithi037_46542 2024-09-22T03:55:51.823 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-22T03:55:51.823 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 0 0 0 0 0 0 - 0 2024-09-22T03:55:52.133 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:55:52.134 INFO:teuthology.orchestra.run.smithi037.stdout:{"fsid":"9eda29d9-a2b0-48de-a9bc-7b5579d66932","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":3,"quorum":[0],"quorum_names":["a"],"quorum_age":409,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":1},"osdmap":{"epoch":52,"num_osds":4,"num_up_osds":4,"osd_up_since":1726976950,"num_in_osds":4,"osd_in_since":1726976944,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":12},{"state_name":"active+clean","count":9},{"state_name":"unknown","count":4}],"num_pgs":25,"num_pools":3,"num_objects":4,"data_bytes":590387,"bytes_used":293687296,"bytes_avail":386253369344,"bytes_total":386547056640,"unknown_pgs_ratio":0.15999999642372131,"inactive_pgs_ratio":0.47999998927116394},"fsmap":{"epoch":1,"btime":"2024-09-22T03:49:02:654758+0000","by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":2,"modified":"2024-09-22T03:50:08.974635+0000","services":{}},"progress_events":{}} 2024-09-22T03:55:52.159 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-22T03:55:52.160 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:55:52.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:55:52.356+0000 7f00d4351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:55:52.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:55:52.371+0000 7f00d4351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:55:52.713 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:55:52.713 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-22T03:55:52.731 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":246,"stamp":"2024-09-22T03:55:51.733515+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":286840,"kb_used_data":1848,"kb_used_omap":0,"kb_used_meta":284928,"kb_avail":377200520,"statfs":{"total":386547056640,"available":386253332480,"internally_reserved":0,"allocated":1892352,"data_stored":2375874,"data_compressed":90168,"data_compressed_allocated":122880,"data_compressed_original":1720320,"omap_allocated":0,"internal_metadata":291766272},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-31086,"num_write_kb":-994689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.018587"},"pg_stats":[{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-22T03:55:50.936777+0000","last_change":"2024-09-22T03:55:50.938932+0000","last_active":"2024-09-22T03:55:50.936777+0000","last_peered":"2024-09-22T03:55:50.936777+0000","last_clean":"2024-09-22T03:55:49.719929+0000","last_became_active":"2024-09-22T03:55:50.929290+0000","last_became_peered":"2024-09-22T03:55:50.929290+0000","last_unstale":"2024-09-22T03:55:50.936777+0000","last_undegraded":"2024-09-22T03:55:50.936777+0000","last_fullsized":"2024-09-22T03:55:50.936777+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-22T03:55:49.799319+0000","last_change":"2024-09-22T03:55:49.799319+0000","last_active":"2024-09-22T03:55:49.719929+0000","last_peered":"2024-09-22T03:55:49.719929+0000","last_clean":"2024-09-22T03:55:49.719929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:55:49.799319+0000","last_undegraded":"2024-09-22T03:55:49.799319+0000","last_fullsized":"2024-09-22T03:55:49.799319+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-22T03:55:49.784457+0000","last_change":"2024-09-22T03:55:49.784457+0000","last_active":"2024-09-22T03:55:49.719929+0000","last_peered":"2024-09-22T03:55:49.719929+0000","last_clean":"2024-09-22T03:55:49.719929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:55:49.784457+0000","last_undegraded":"2024-09-22T03:55:49.784457+0000","last_fullsized":"2024-09-22T03:55:49.784457+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-22T03:55:50.941398+0000","last_change":"2024-09-22T03:55:50.942624+0000","last_active":"2024-09-22T03:55:50.941398+0000","last_peered":"2024-09-22T03:55:50.941398+0000","last_clean":"2024-09-22T03:55:49.719929+0000","last_became_active":"2024-09-22T03:55:50.922812+0000","last_became_peered":"2024-09-22T03:55:50.922812+0000","last_unstale":"2024-09-22T03:55:50.941398+0000","last_undegraded":"2024-09-22T03:55:50.941398+0000","last_fullsized":"2024-09-22T03:55:50.941398+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-22T03:55:49.770701+0000","last_change":"2024-09-22T03:55:49.770701+0000","last_active":"2024-09-22T03:55:49.719929+0000","last_peered":"2024-09-22T03:55:49.719929+0000","last_clean":"2024-09-22T03:55:49.719929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:55:49.770701+0000","last_undegraded":"2024-09-22T03:55:49.770701+0000","last_fullsized":"2024-09-22T03:55:49.770701+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-22T03:55:49.796652+0000","last_change":"2024-09-22T03:55:49.796652+0000","last_active":"2024-09-22T03:55:49.719929+0000","last_peered":"2024-09-22T03:55:49.719929+0000","last_clean":"2024-09-22T03:55:49.719929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:55:49.796652+0000","last_undegraded":"2024-09-22T03:55:49.796652+0000","last_fullsized":"2024-09-22T03:55:49.796652+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-22T03:55:49.780945+0000","last_change":"2024-09-22T03:55:49.780945+0000","last_active":"2024-09-22T03:55:49.719929+0000","last_peered":"2024-09-22T03:55:49.719929+0000","last_clean":"2024-09-22T03:55:49.719929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:55:49.780945+0000","last_undegraded":"2024-09-22T03:55:49.780945+0000","last_fullsized":"2024-09-22T03:55:49.780945+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-22T03:55:49.740054+0000","last_change":"2024-09-22T03:55:49.740054+0000","last_active":"2024-09-22T03:55:49.719929+0000","last_peered":"2024-09-22T03:55:49.719929+0000","last_clean":"2024-09-22T03:55:49.719929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:55:49.740054+0000","last_undegraded":"2024-09-22T03:55:49.740054+0000","last_fullsized":"2024-09-22T03:55:49.740054+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-22T03:55:49.758129+0000","last_change":"2024-09-22T03:55:49.758129+0000","last_active":"2024-09-22T03:55:49.719929+0000","last_peered":"2024-09-22T03:55:49.719929+0000","last_clean":"2024-09-22T03:55:49.719929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:55:49.758129+0000","last_undegraded":"2024-09-22T03:55:49.758129+0000","last_fullsized":"2024-09-22T03:55:49.758129+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":196,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-22T03:55:50.751473+0000","last_change":"2024-09-22T03:49:12.034704+0000","last_active":"2024-09-22T03:55:50.751473+0000","last_peered":"2024-09-22T03:55:50.751473+0000","last_clean":"2024-09-22T03:55:50.751473+0000","last_became_active":"2024-09-22T03:49:12.027470+0000","last_became_peered":"2024-09-22T03:49:12.027470+0000","last_unstale":"2024-09-22T03:55:50.751473+0000","last_undegraded":"2024-09-22T03:55:50.751473+0000","last_fullsized":"2024-09-22T03:55:50.751473+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_clean_scrub_stamp":"2024-09-22T03:49:10.979949+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":119,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:55:49.733917+0000","last_change":"2024-09-22T03:49:17.031458+0000","last_active":"2024-09-22T03:55:49.733917+0000","last_peered":"2024-09-22T03:55:49.733917+0000","last_clean":"2024-09-22T03:55:49.733917+0000","last_became_active":"2024-09-22T03:49:15.125490+0000","last_became_peered":"2024-09-22T03:49:15.125490+0000","last_unstale":"2024-09-22T03:55:49.733917+0000","last_undegraded":"2024-09-22T03:55:49.733917+0000","last_fullsized":"2024-09-22T03:55:49.733917+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-22T03:55:49.763824+0000","last_change":"2024-09-22T03:55:49.763824+0000","last_active":"2024-09-22T03:55:49.719929+0000","last_peered":"2024-09-22T03:55:49.719929+0000","last_clean":"2024-09-22T03:55:49.719929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:55:49.763824+0000","last_undegraded":"2024-09-22T03:55:49.763824+0000","last_fullsized":"2024-09-22T03:55:49.763824+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":118,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:55:49.731059+0000","last_change":"2024-09-22T03:49:17.029339+0000","last_active":"2024-09-22T03:55:49.731059+0000","last_peered":"2024-09-22T03:55:49.731059+0000","last_clean":"2024-09-22T03:55:49.731059+0000","last_became_active":"2024-09-22T03:49:15.097304+0000","last_became_peered":"2024-09-22T03:49:15.097304+0000","last_unstale":"2024-09-22T03:55:49.731059+0000","last_undegraded":"2024-09-22T03:55:49.731059+0000","last_fullsized":"2024-09-22T03:55:49.731059+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-22T03:55:50.917272+0000","last_change":"2024-09-22T03:55:50.918358+0000","last_active":"2024-09-22T03:55:50.917272+0000","last_peered":"2024-09-22T03:55:50.917272+0000","last_clean":"2024-09-22T03:55:49.719929+0000","last_became_active":"2024-09-22T03:55:50.889906+0000","last_became_peered":"2024-09-22T03:55:50.889906+0000","last_unstale":"2024-09-22T03:55:50.917272+0000","last_undegraded":"2024-09-22T03:55:50.917272+0000","last_fullsized":"2024-09-22T03:55:50.917272+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":118,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:55:49.733156+0000","last_change":"2024-09-22T03:49:17.029349+0000","last_active":"2024-09-22T03:55:49.733156+0000","last_peered":"2024-09-22T03:55:49.733156+0000","last_clean":"2024-09-22T03:55:49.733156+0000","last_became_active":"2024-09-22T03:49:15.094890+0000","last_became_peered":"2024-09-22T03:49:15.094890+0000","last_unstale":"2024-09-22T03:55:49.733156+0000","last_undegraded":"2024-09-22T03:55:49.733156+0000","last_fullsized":"2024-09-22T03:55:49.733156+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-22T03:55:49.775066+0000","last_change":"2024-09-22T03:55:49.775066+0000","last_active":"2024-09-22T03:55:49.719929+0000","last_peered":"2024-09-22T03:55:49.719929+0000","last_clean":"2024-09-22T03:55:49.719929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:55:49.775066+0000","last_undegraded":"2024-09-22T03:55:49.775066+0000","last_fullsized":"2024-09-22T03:55:49.775066+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":120,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:55:49.733716+0000","last_change":"2024-09-22T03:49:17.031466+0000","last_active":"2024-09-22T03:55:49.733716+0000","last_peered":"2024-09-22T03:55:49.733716+0000","last_clean":"2024-09-22T03:55:49.733716+0000","last_became_active":"2024-09-22T03:49:15.098420+0000","last_became_peered":"2024-09-22T03:49:15.098420+0000","last_unstale":"2024-09-22T03:55:49.733716+0000","last_undegraded":"2024-09-22T03:55:49.733716+0000","last_fullsized":"2024-09-22T03:55:49.733716+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-22T03:55:49.742931+0000","last_change":"2024-09-22T03:55:49.742931+0000","last_active":"2024-09-22T03:55:49.719929+0000","last_peered":"2024-09-22T03:55:49.719929+0000","last_clean":"2024-09-22T03:55:49.719929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:55:49.742931+0000","last_undegraded":"2024-09-22T03:55:49.742931+0000","last_fullsized":"2024-09-22T03:55:49.742931+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":121,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-22T03:55:50.755468+0000","last_change":"2024-09-22T03:49:17.036954+0000","last_active":"2024-09-22T03:55:50.755468+0000","last_peered":"2024-09-22T03:55:50.755468+0000","last_clean":"2024-09-22T03:55:50.755468+0000","last_became_active":"2024-09-22T03:49:15.110506+0000","last_became_peered":"2024-09-22T03:49:15.110506+0000","last_unstale":"2024-09-22T03:55:50.755468+0000","last_undegraded":"2024-09-22T03:55:50.755468+0000","last_fullsized":"2024-09-22T03:55:50.755468+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-22T03:55:49.751658+0000","last_change":"2024-09-22T03:55:49.751658+0000","last_active":"2024-09-22T03:55:49.719929+0000","last_peered":"2024-09-22T03:55:49.719929+0000","last_clean":"2024-09-22T03:55:49.719929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:55:49.751658+0000","last_undegraded":"2024-09-22T03:55:49.751658+0000","last_fullsized":"2024-09-22T03:55:49.751658+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":121,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-22T03:55:50.749688+0000","last_change":"2024-09-22T03:49:17.032989+0000","last_active":"2024-09-22T03:55:50.749688+0000","last_peered":"2024-09-22T03:55:50.749688+0000","last_clean":"2024-09-22T03:55:50.749688+0000","last_became_active":"2024-09-22T03:49:15.079260+0000","last_became_peered":"2024-09-22T03:49:15.079260+0000","last_unstale":"2024-09-22T03:55:50.749688+0000","last_undegraded":"2024-09-22T03:55:50.749688+0000","last_fullsized":"2024-09-22T03:55:50.749688+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-22T03:55:50.861427+0000","last_change":"2024-09-22T03:55:50.862926+0000","last_active":"2024-09-22T03:55:50.861427+0000","last_peered":"2024-09-22T03:55:50.861427+0000","last_clean":"2024-09-22T03:55:49.719929+0000","last_became_active":"2024-09-22T03:55:50.851824+0000","last_became_peered":"2024-09-22T03:55:50.851824+0000","last_unstale":"2024-09-22T03:55:50.861427+0000","last_undegraded":"2024-09-22T03:55:50.861427+0000","last_fullsized":"2024-09-22T03:55:50.861427+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":121,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-22T03:55:50.768130+0000","last_change":"2024-09-22T03:49:17.036402+0000","last_active":"2024-09-22T03:55:50.768130+0000","last_peered":"2024-09-22T03:55:50.768130+0000","last_clean":"2024-09-22T03:55:50.768130+0000","last_became_active":"2024-09-22T03:49:15.108430+0000","last_became_peered":"2024-09-22T03:49:15.108430+0000","last_unstale":"2024-09-22T03:55:50.768130+0000","last_undegraded":"2024-09-22T03:55:50.768130+0000","last_fullsized":"2024-09-22T03:55:50.768130+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-22T03:55:49.740054+0000","last_change":"2024-09-22T03:55:49.740054+0000","last_active":"2024-09-22T03:55:49.719929+0000","last_peered":"2024-09-22T03:55:49.719929+0000","last_clean":"2024-09-22T03:55:49.719929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:55:49.740054+0000","last_undegraded":"2024-09-22T03:55:49.740054+0000","last_fullsized":"2024-09-22T03:55:49.740054+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":118,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:55:49.731926+0000","last_change":"2024-09-22T03:49:17.029128+0000","last_active":"2024-09-22T03:55:49.731926+0000","last_peered":"2024-09-22T03:55:49.731926+0000","last_clean":"2024-09-22T03:55:49.731926+0000","last_became_active":"2024-09-22T03:49:15.113396+0000","last_became_peered":"2024-09-22T03:49:15.113396+0000","last_unstale":"2024-09-22T03:55:49.731926+0000","last_undegraded":"2024-09-22T03:55:49.731926+0000","last_fullsized":"2024-09-22T03:55:49.731926+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949673359,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":71732,"kb_used_data":484,"kb_used_omap":0,"kb_used_meta":71232,"kb_avail":94300108,"statfs":{"total":96636764160,"available":96563310592,"internally_reserved":0,"allocated":495616,"data_stored":744299,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":72941568},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654706063,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":71664,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":71232,"kb_avail":94300176,"statfs":{"total":96636764160,"available":96563380224,"internally_reserved":0,"allocated":425984,"data_stored":150286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":72941568},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706063,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":71724,"kb_used_data":476,"kb_used_omap":0,"kb_used_meta":71232,"kb_avail":94300116,"statfs":{"total":96636764160,"available":96563318784,"internally_reserved":0,"allocated":487424,"data_stored":740654,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":72941568},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706063,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":71720,"kb_used_data":472,"kb_used_omap":0,"kb_used_meta":71232,"kb_avail":94300120,"statfs":{"total":96636764160,"available":96563322880,"internally_reserved":0,"allocated":483328,"data_stored":740635,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":72941568},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:55:52.823 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 1 16 223 207 12.9366 12.9375 0.0549457 0.074287 2024-09-22T03:55:53.393 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:55:53.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:55:53.547+0000 7ff2f3391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:55:53.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:55:53.557+0000 7ff2f3391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:55:53.823 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 2 16 452 436 13.624 14.3125 0.0637498 0.0713748 2024-09-22T03:55:54.823 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 3 16 675 659 13.7281 13.9375 0.117917 0.0721112 2024-09-22T03:55:55.734 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:55:55.823 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 4 16 903 887 13.8582 14.25 0.0581259 0.0713522 2024-09-22T03:55:55.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:55:55.908+0000 7fdb15488640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:55:55.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:55:55.921+0000 7fdb0ffff640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:55:56.047 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:55:56.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:55:56.232+0000 7f4f28a5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:55:56.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:55:56.246+0000 7f4f28a5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:55:56.266 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:55:56.266 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-22T03:55:56.284 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":248,"stamp":"2024-09-22T03:55:55.048752+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":286840,"kb_used_data":1848,"kb_used_omap":0,"kb_used_meta":284928,"kb_avail":377200520,"statfs":{"total":386547056640,"available":386253332480,"internally_reserved":0,"allocated":1892352,"data_stored":2375874,"data_compressed":90168,"data_compressed_allocated":122880,"data_compressed_original":1720320,"omap_allocated":0,"internal_metadata":291766272},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001317"},"pg_stats":[{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-22T03:55:50.936777+0000","last_change":"2024-09-22T03:55:50.938932+0000","last_active":"2024-09-22T03:55:50.936777+0000","last_peered":"2024-09-22T03:55:50.936777+0000","last_clean":"2024-09-22T03:55:49.719929+0000","last_became_active":"2024-09-22T03:55:50.929290+0000","last_became_peered":"2024-09-22T03:55:50.929290+0000","last_unstale":"2024-09-22T03:55:50.936777+0000","last_undegraded":"2024-09-22T03:55:50.936777+0000","last_fullsized":"2024-09-22T03:55:50.936777+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-22T03:55:49.799319+0000","last_change":"2024-09-22T03:55:49.799319+0000","last_active":"2024-09-22T03:55:49.719929+0000","last_peered":"2024-09-22T03:55:49.719929+0000","last_clean":"2024-09-22T03:55:49.719929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:55:49.799319+0000","last_undegraded":"2024-09-22T03:55:49.799319+0000","last_fullsized":"2024-09-22T03:55:49.799319+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-22T03:55:49.784457+0000","last_change":"2024-09-22T03:55:49.784457+0000","last_active":"2024-09-22T03:55:49.719929+0000","last_peered":"2024-09-22T03:55:49.719929+0000","last_clean":"2024-09-22T03:55:49.719929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:55:49.784457+0000","last_undegraded":"2024-09-22T03:55:49.784457+0000","last_fullsized":"2024-09-22T03:55:49.784457+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-22T03:55:50.941398+0000","last_change":"2024-09-22T03:55:50.942624+0000","last_active":"2024-09-22T03:55:50.941398+0000","last_peered":"2024-09-22T03:55:50.941398+0000","last_clean":"2024-09-22T03:55:49.719929+0000","last_became_active":"2024-09-22T03:55:50.922812+0000","last_became_peered":"2024-09-22T03:55:50.922812+0000","last_unstale":"2024-09-22T03:55:50.941398+0000","last_undegraded":"2024-09-22T03:55:50.941398+0000","last_fullsized":"2024-09-22T03:55:50.941398+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-22T03:55:49.770701+0000","last_change":"2024-09-22T03:55:49.770701+0000","last_active":"2024-09-22T03:55:49.719929+0000","last_peered":"2024-09-22T03:55:49.719929+0000","last_clean":"2024-09-22T03:55:49.719929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:55:49.770701+0000","last_undegraded":"2024-09-22T03:55:49.770701+0000","last_fullsized":"2024-09-22T03:55:49.770701+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-22T03:55:49.796652+0000","last_change":"2024-09-22T03:55:49.796652+0000","last_active":"2024-09-22T03:55:49.719929+0000","last_peered":"2024-09-22T03:55:49.719929+0000","last_clean":"2024-09-22T03:55:49.719929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:55:49.796652+0000","last_undegraded":"2024-09-22T03:55:49.796652+0000","last_fullsized":"2024-09-22T03:55:49.796652+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-22T03:55:49.780945+0000","last_change":"2024-09-22T03:55:49.780945+0000","last_active":"2024-09-22T03:55:49.719929+0000","last_peered":"2024-09-22T03:55:49.719929+0000","last_clean":"2024-09-22T03:55:49.719929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:55:49.780945+0000","last_undegraded":"2024-09-22T03:55:49.780945+0000","last_fullsized":"2024-09-22T03:55:49.780945+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-22T03:55:49.740054+0000","last_change":"2024-09-22T03:55:49.740054+0000","last_active":"2024-09-22T03:55:49.719929+0000","last_peered":"2024-09-22T03:55:49.719929+0000","last_clean":"2024-09-22T03:55:49.719929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:55:49.740054+0000","last_undegraded":"2024-09-22T03:55:49.740054+0000","last_fullsized":"2024-09-22T03:55:49.740054+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-22T03:55:49.758129+0000","last_change":"2024-09-22T03:55:49.758129+0000","last_active":"2024-09-22T03:55:49.719929+0000","last_peered":"2024-09-22T03:55:49.719929+0000","last_clean":"2024-09-22T03:55:49.719929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:55:49.758129+0000","last_undegraded":"2024-09-22T03:55:49.758129+0000","last_fullsized":"2024-09-22T03:55:49.758129+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":196,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-22T03:55:50.751473+0000","last_change":"2024-09-22T03:49:12.034704+0000","last_active":"2024-09-22T03:55:50.751473+0000","last_peered":"2024-09-22T03:55:50.751473+0000","last_clean":"2024-09-22T03:55:50.751473+0000","last_became_active":"2024-09-22T03:49:12.027470+0000","last_became_peered":"2024-09-22T03:49:12.027470+0000","last_unstale":"2024-09-22T03:55:50.751473+0000","last_undegraded":"2024-09-22T03:55:50.751473+0000","last_fullsized":"2024-09-22T03:55:50.751473+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_clean_scrub_stamp":"2024-09-22T03:49:10.979949+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":119,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:55:49.733917+0000","last_change":"2024-09-22T03:49:17.031458+0000","last_active":"2024-09-22T03:55:49.733917+0000","last_peered":"2024-09-22T03:55:49.733917+0000","last_clean":"2024-09-22T03:55:49.733917+0000","last_became_active":"2024-09-22T03:49:15.125490+0000","last_became_peered":"2024-09-22T03:49:15.125490+0000","last_unstale":"2024-09-22T03:55:49.733917+0000","last_undegraded":"2024-09-22T03:55:49.733917+0000","last_fullsized":"2024-09-22T03:55:49.733917+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-22T03:55:49.763824+0000","last_change":"2024-09-22T03:55:49.763824+0000","last_active":"2024-09-22T03:55:49.719929+0000","last_peered":"2024-09-22T03:55:49.719929+0000","last_clean":"2024-09-22T03:55:49.719929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:55:49.763824+0000","last_undegraded":"2024-09-22T03:55:49.763824+0000","last_fullsized":"2024-09-22T03:55:49.763824+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":118,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:55:49.731059+0000","last_change":"2024-09-22T03:49:17.029339+0000","last_active":"2024-09-22T03:55:49.731059+0000","last_peered":"2024-09-22T03:55:49.731059+0000","last_clean":"2024-09-22T03:55:49.731059+0000","last_became_active":"2024-09-22T03:49:15.097304+0000","last_became_peered":"2024-09-22T03:49:15.097304+0000","last_unstale":"2024-09-22T03:55:49.731059+0000","last_undegraded":"2024-09-22T03:55:49.731059+0000","last_fullsized":"2024-09-22T03:55:49.731059+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-22T03:55:50.917272+0000","last_change":"2024-09-22T03:55:50.918358+0000","last_active":"2024-09-22T03:55:50.917272+0000","last_peered":"2024-09-22T03:55:50.917272+0000","last_clean":"2024-09-22T03:55:49.719929+0000","last_became_active":"2024-09-22T03:55:50.889906+0000","last_became_peered":"2024-09-22T03:55:50.889906+0000","last_unstale":"2024-09-22T03:55:50.917272+0000","last_undegraded":"2024-09-22T03:55:50.917272+0000","last_fullsized":"2024-09-22T03:55:50.917272+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":118,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:55:49.733156+0000","last_change":"2024-09-22T03:49:17.029349+0000","last_active":"2024-09-22T03:55:49.733156+0000","last_peered":"2024-09-22T03:55:49.733156+0000","last_clean":"2024-09-22T03:55:49.733156+0000","last_became_active":"2024-09-22T03:49:15.094890+0000","last_became_peered":"2024-09-22T03:49:15.094890+0000","last_unstale":"2024-09-22T03:55:49.733156+0000","last_undegraded":"2024-09-22T03:55:49.733156+0000","last_fullsized":"2024-09-22T03:55:49.733156+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-22T03:55:49.775066+0000","last_change":"2024-09-22T03:55:49.775066+0000","last_active":"2024-09-22T03:55:49.719929+0000","last_peered":"2024-09-22T03:55:49.719929+0000","last_clean":"2024-09-22T03:55:49.719929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:55:49.775066+0000","last_undegraded":"2024-09-22T03:55:49.775066+0000","last_fullsized":"2024-09-22T03:55:49.775066+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":120,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:55:49.733716+0000","last_change":"2024-09-22T03:49:17.031466+0000","last_active":"2024-09-22T03:55:49.733716+0000","last_peered":"2024-09-22T03:55:49.733716+0000","last_clean":"2024-09-22T03:55:49.733716+0000","last_became_active":"2024-09-22T03:49:15.098420+0000","last_became_peered":"2024-09-22T03:49:15.098420+0000","last_unstale":"2024-09-22T03:55:49.733716+0000","last_undegraded":"2024-09-22T03:55:49.733716+0000","last_fullsized":"2024-09-22T03:55:49.733716+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-22T03:55:49.742931+0000","last_change":"2024-09-22T03:55:49.742931+0000","last_active":"2024-09-22T03:55:49.719929+0000","last_peered":"2024-09-22T03:55:49.719929+0000","last_clean":"2024-09-22T03:55:49.719929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:55:49.742931+0000","last_undegraded":"2024-09-22T03:55:49.742931+0000","last_fullsized":"2024-09-22T03:55:49.742931+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":121,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-22T03:55:50.755468+0000","last_change":"2024-09-22T03:49:17.036954+0000","last_active":"2024-09-22T03:55:50.755468+0000","last_peered":"2024-09-22T03:55:50.755468+0000","last_clean":"2024-09-22T03:55:50.755468+0000","last_became_active":"2024-09-22T03:49:15.110506+0000","last_became_peered":"2024-09-22T03:49:15.110506+0000","last_unstale":"2024-09-22T03:55:50.755468+0000","last_undegraded":"2024-09-22T03:55:50.755468+0000","last_fullsized":"2024-09-22T03:55:50.755468+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-22T03:55:49.751658+0000","last_change":"2024-09-22T03:55:49.751658+0000","last_active":"2024-09-22T03:55:49.719929+0000","last_peered":"2024-09-22T03:55:49.719929+0000","last_clean":"2024-09-22T03:55:49.719929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:55:49.751658+0000","last_undegraded":"2024-09-22T03:55:49.751658+0000","last_fullsized":"2024-09-22T03:55:49.751658+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":121,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-22T03:55:50.749688+0000","last_change":"2024-09-22T03:49:17.032989+0000","last_active":"2024-09-22T03:55:50.749688+0000","last_peered":"2024-09-22T03:55:50.749688+0000","last_clean":"2024-09-22T03:55:50.749688+0000","last_became_active":"2024-09-22T03:49:15.079260+0000","last_became_peered":"2024-09-22T03:49:15.079260+0000","last_unstale":"2024-09-22T03:55:50.749688+0000","last_undegraded":"2024-09-22T03:55:50.749688+0000","last_fullsized":"2024-09-22T03:55:50.749688+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-22T03:55:50.861427+0000","last_change":"2024-09-22T03:55:50.862926+0000","last_active":"2024-09-22T03:55:50.861427+0000","last_peered":"2024-09-22T03:55:50.861427+0000","last_clean":"2024-09-22T03:55:49.719929+0000","last_became_active":"2024-09-22T03:55:50.851824+0000","last_became_peered":"2024-09-22T03:55:50.851824+0000","last_unstale":"2024-09-22T03:55:50.861427+0000","last_undegraded":"2024-09-22T03:55:50.861427+0000","last_fullsized":"2024-09-22T03:55:50.861427+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":121,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-22T03:55:50.768130+0000","last_change":"2024-09-22T03:49:17.036402+0000","last_active":"2024-09-22T03:55:50.768130+0000","last_peered":"2024-09-22T03:55:50.768130+0000","last_clean":"2024-09-22T03:55:50.768130+0000","last_became_active":"2024-09-22T03:49:15.108430+0000","last_became_peered":"2024-09-22T03:49:15.108430+0000","last_unstale":"2024-09-22T03:55:50.768130+0000","last_undegraded":"2024-09-22T03:55:50.768130+0000","last_fullsized":"2024-09-22T03:55:50.768130+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-22T03:55:49.740054+0000","last_change":"2024-09-22T03:55:49.740054+0000","last_active":"2024-09-22T03:55:49.719929+0000","last_peered":"2024-09-22T03:55:49.719929+0000","last_clean":"2024-09-22T03:55:49.719929+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:55:49.740054+0000","last_undegraded":"2024-09-22T03:55:49.740054+0000","last_fullsized":"2024-09-22T03:55:49.740054+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":118,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-22T03:55:49.731926+0000","last_change":"2024-09-22T03:49:17.029128+0000","last_active":"2024-09-22T03:55:49.731926+0000","last_peered":"2024-09-22T03:55:49.731926+0000","last_clean":"2024-09-22T03:55:49.731926+0000","last_became_active":"2024-09-22T03:49:15.113396+0000","last_became_peered":"2024-09-22T03:49:15.113396+0000","last_unstale":"2024-09-22T03:55:49.731926+0000","last_undegraded":"2024-09-22T03:55:49.731926+0000","last_fullsized":"2024-09-22T03:55:49.731926+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949673359,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":71732,"kb_used_data":484,"kb_used_omap":0,"kb_used_meta":71232,"kb_avail":94300108,"statfs":{"total":96636764160,"available":96563310592,"internally_reserved":0,"allocated":495616,"data_stored":744299,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":72941568},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654706063,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":71664,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":71232,"kb_avail":94300176,"statfs":{"total":96636764160,"available":96563380224,"internally_reserved":0,"allocated":425984,"data_stored":150286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":72941568},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706063,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":71724,"kb_used_data":476,"kb_used_omap":0,"kb_used_meta":71232,"kb_avail":94300116,"statfs":{"total":96636764160,"available":96563318784,"internally_reserved":0,"allocated":487424,"data_stored":740654,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":72941568},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706063,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":71720,"kb_used_data":472,"kb_used_omap":0,"kb_used_meta":71232,"kb_avail":94300120,"statfs":{"total":96636764160,"available":96563322880,"internally_reserved":0,"allocated":483328,"data_stored":740635,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":72941568},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:55:56.286 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-22T03:55:56.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:55:56.454+0000 7f1c5bcbd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:55:56.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:55:56.465+0000 7f1c5bcbd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:55:56.823 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 5 16 1110 1094 13.6739 12.9375 0.0313023 0.0722604 2024-09-22T03:55:57.010 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:55:57.011 INFO:teuthology.orchestra.run.smithi037.stdout:{"fsid":"9eda29d9-a2b0-48de-a9bc-7b5579d66932","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":3,"quorum":[0],"quorum_names":["a"],"quorum_age":414,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":1},"osdmap":{"epoch":52,"num_osds":4,"num_up_osds":4,"osd_up_since":1726976950,"num_in_osds":4,"osd_in_since":1726976944,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":13},{"state_name":"creating+peering","count":12}],"num_pgs":25,"num_pools":3,"num_objects":4,"data_bytes":590387,"bytes_used":293724160,"bytes_avail":386253332480,"bytes_total":386547056640,"inactive_pgs_ratio":0.47999998927116394},"fsmap":{"epoch":1,"btime":"2024-09-22T03:49:02:654758+0000","by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":2,"modified":"2024-09-22T03:50:08.974635+0000","services":{}},"progress_events":{}} 2024-09-22T03:55:57.035 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-22T03:55:57.035 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:55:57.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:55:57.202+0000 7f3a9bf91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:55:57.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:55:57.218+0000 7f3a9bf91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:55:57.564 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:55:57.564 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-22T03:55:57.586 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":249,"stamp":"2024-09-22T03:55:57.049087+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":52953651,"num_objects":803,"num_object_clones":0,"num_object_copies":2409,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":880,"num_write_kb":52244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":854,"ondisk_log_size":854,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":299768,"kb_used_data":10616,"kb_used_omap":0,"kb_used_meta":289088,"kb_avail":377187592,"statfs":{"total":386547056640,"available":386240094208,"internally_reserved":0,"allocated":10870784,"data_stored":145138637,"data_compressed":6865596,"data_compressed_allocated":9043968,"data_compressed_original":144457728,"omap_allocated":0,"internal_metadata":296026112},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":52363264,"num_objects":799,"num_object_clones":0,"num_object_copies":2397,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":799,"num_write_kb":51136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.326924"},"pg_stats":[{"pgid":"5.f","version":"52'60","reported_seq":72,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:56.060927+0000","last_change":"2024-09-22T03:55:50.938932+0000","last_active":"2024-09-22T03:55:56.060927+0000","last_peered":"2024-09-22T03:55:56.060927+0000","last_clean":"2024-09-22T03:55:56.060927+0000","last_became_active":"2024-09-22T03:55:50.929290+0000","last_became_peered":"2024-09-22T03:55:50.929290+0000","last_unstale":"2024-09-22T03:55:56.060927+0000","last_undegraded":"2024-09-22T03:55:56.060927+0000","last_fullsized":"2024-09-22T03:55:56.060927+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3932160,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60,"num_write_kb":3840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"52'38","reported_seq":50,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:54.959670+0000","last_change":"2024-09-22T03:55:50.848180+0000","last_active":"2024-09-22T03:55:54.959670+0000","last_peered":"2024-09-22T03:55:54.959670+0000","last_clean":"2024-09-22T03:55:54.959670+0000","last_became_active":"2024-09-22T03:55:50.838302+0000","last_became_peered":"2024-09-22T03:55:50.838302+0000","last_unstale":"2024-09-22T03:55:54.959670+0000","last_undegraded":"2024-09-22T03:55:54.959670+0000","last_fullsized":"2024-09-22T03:55:54.959670+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2490368,"num_objects":38,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":2432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"52'40","reported_seq":52,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:55.041890+0000","last_change":"2024-09-22T03:55:50.872362+0000","last_active":"2024-09-22T03:55:55.041890+0000","last_peered":"2024-09-22T03:55:55.041890+0000","last_clean":"2024-09-22T03:55:55.041890+0000","last_became_active":"2024-09-22T03:55:50.867322+0000","last_became_peered":"2024-09-22T03:55:50.867322+0000","last_unstale":"2024-09-22T03:55:55.041890+0000","last_undegraded":"2024-09-22T03:55:55.041890+0000","last_fullsized":"2024-09-22T03:55:55.041890+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2621440,"num_objects":40,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":2560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"52'58","reported_seq":70,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:56.134495+0000","last_change":"2024-09-22T03:55:50.942624+0000","last_active":"2024-09-22T03:55:56.134495+0000","last_peered":"2024-09-22T03:55:56.134495+0000","last_clean":"2024-09-22T03:55:56.134495+0000","last_became_active":"2024-09-22T03:55:50.922812+0000","last_became_peered":"2024-09-22T03:55:50.922812+0000","last_unstale":"2024-09-22T03:55:56.134495+0000","last_undegraded":"2024-09-22T03:55:56.134495+0000","last_fullsized":"2024-09-22T03:55:56.134495+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3801088,"num_objects":58,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58,"num_write_kb":3712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"52'37","reported_seq":49,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:55.015530+0000","last_change":"2024-09-22T03:55:50.890353+0000","last_active":"2024-09-22T03:55:55.015530+0000","last_peered":"2024-09-22T03:55:55.015530+0000","last_clean":"2024-09-22T03:55:55.015530+0000","last_became_active":"2024-09-22T03:55:50.882633+0000","last_became_peered":"2024-09-22T03:55:50.882633+0000","last_unstale":"2024-09-22T03:55:55.015530+0000","last_undegraded":"2024-09-22T03:55:55.015530+0000","last_fullsized":"2024-09-22T03:55:55.015530+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2424832,"num_objects":37,"num_object_clones":0,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":2368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.a","version":"52'47","reported_seq":59,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:55.060512+0000","last_change":"2024-09-22T03:55:50.891052+0000","last_active":"2024-09-22T03:55:55.060512+0000","last_peered":"2024-09-22T03:55:55.060512+0000","last_clean":"2024-09-22T03:55:55.060512+0000","last_became_active":"2024-09-22T03:55:50.880295+0000","last_became_peered":"2024-09-22T03:55:50.880295+0000","last_unstale":"2024-09-22T03:55:55.060512+0000","last_undegraded":"2024-09-22T03:55:55.060512+0000","last_fullsized":"2024-09-22T03:55:55.060512+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3080192,"num_objects":47,"num_object_clones":0,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":3008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"52'41","reported_seq":53,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:54.851180+0000","last_change":"2024-09-22T03:55:50.906894+0000","last_active":"2024-09-22T03:55:54.851180+0000","last_peered":"2024-09-22T03:55:54.851180+0000","last_clean":"2024-09-22T03:55:54.851180+0000","last_became_active":"2024-09-22T03:55:50.896899+0000","last_became_peered":"2024-09-22T03:55:50.896899+0000","last_unstale":"2024-09-22T03:55:54.851180+0000","last_undegraded":"2024-09-22T03:55:54.851180+0000","last_fullsized":"2024-09-22T03:55:54.851180+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2686976,"num_objects":41,"num_object_clones":0,"num_object_copies":123,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":2624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"52'52","reported_seq":64,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:55.035842+0000","last_change":"2024-09-22T03:55:50.859578+0000","last_active":"2024-09-22T03:55:55.035842+0000","last_peered":"2024-09-22T03:55:55.035842+0000","last_clean":"2024-09-22T03:55:55.035842+0000","last_became_active":"2024-09-22T03:55:50.843710+0000","last_became_peered":"2024-09-22T03:55:50.843710+0000","last_unstale":"2024-09-22T03:55:55.035842+0000","last_undegraded":"2024-09-22T03:55:55.035842+0000","last_fullsized":"2024-09-22T03:55:55.035842+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3407872,"num_objects":52,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52,"num_write_kb":3328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"52'60","reported_seq":72,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:55.018316+0000","last_change":"2024-09-22T03:55:50.968411+0000","last_active":"2024-09-22T03:55:55.018316+0000","last_peered":"2024-09-22T03:55:55.018316+0000","last_clean":"2024-09-22T03:55:55.018316+0000","last_became_active":"2024-09-22T03:55:50.961718+0000","last_became_peered":"2024-09-22T03:55:50.961718+0000","last_unstale":"2024-09-22T03:55:55.018316+0000","last_undegraded":"2024-09-22T03:55:55.018316+0000","last_fullsized":"2024-09-22T03:55:55.018316+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3932160,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60,"num_write_kb":3840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":199,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:51.749469+0000","last_change":"2024-09-22T03:49:12.034704+0000","last_active":"2024-09-22T03:55:51.749469+0000","last_peered":"2024-09-22T03:55:51.749469+0000","last_clean":"2024-09-22T03:55:51.749469+0000","last_became_active":"2024-09-22T03:49:12.027470+0000","last_became_peered":"2024-09-22T03:49:12.027470+0000","last_unstale":"2024-09-22T03:55:51.749469+0000","last_undegraded":"2024-09-22T03:55:51.749469+0000","last_fullsized":"2024-09-22T03:55:51.749469+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_clean_scrub_stamp":"2024-09-22T03:49:10.979949+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":125,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:51.750162+0000","last_change":"2024-09-22T03:49:17.031458+0000","last_active":"2024-09-22T03:55:51.750162+0000","last_peered":"2024-09-22T03:55:51.750162+0000","last_clean":"2024-09-22T03:55:51.750162+0000","last_became_active":"2024-09-22T03:49:15.125490+0000","last_became_peered":"2024-09-22T03:49:15.125490+0000","last_unstale":"2024-09-22T03:55:51.750162+0000","last_undegraded":"2024-09-22T03:55:51.750162+0000","last_fullsized":"2024-09-22T03:55:51.750162+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.7","version":"52'42","reported_seq":54,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:54.775196+0000","last_change":"2024-09-22T03:55:50.910597+0000","last_active":"2024-09-22T03:55:54.775196+0000","last_peered":"2024-09-22T03:55:54.775196+0000","last_clean":"2024-09-22T03:55:54.775196+0000","last_became_active":"2024-09-22T03:55:50.901290+0000","last_became_peered":"2024-09-22T03:55:50.901290+0000","last_unstale":"2024-09-22T03:55:54.775196+0000","last_undegraded":"2024-09-22T03:55:54.775196+0000","last_fullsized":"2024-09-22T03:55:54.775196+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2752512,"num_objects":42,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":2688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":124,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:51.742303+0000","last_change":"2024-09-22T03:49:17.029339+0000","last_active":"2024-09-22T03:55:51.742303+0000","last_peered":"2024-09-22T03:55:51.742303+0000","last_clean":"2024-09-22T03:55:51.742303+0000","last_became_active":"2024-09-22T03:49:15.097304+0000","last_became_peered":"2024-09-22T03:49:15.097304+0000","last_unstale":"2024-09-22T03:55:51.742303+0000","last_undegraded":"2024-09-22T03:55:51.742303+0000","last_fullsized":"2024-09-22T03:55:51.742303+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"52'58","reported_seq":70,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:56.098040+0000","last_change":"2024-09-22T03:55:50.918358+0000","last_active":"2024-09-22T03:55:56.098040+0000","last_peered":"2024-09-22T03:55:56.098040+0000","last_clean":"2024-09-22T03:55:56.098040+0000","last_became_active":"2024-09-22T03:55:50.889906+0000","last_became_peered":"2024-09-22T03:55:50.889906+0000","last_unstale":"2024-09-22T03:55:56.098040+0000","last_undegraded":"2024-09-22T03:55:56.098040+0000","last_fullsized":"2024-09-22T03:55:56.098040+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3801088,"num_objects":58,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58,"num_write_kb":3712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":124,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:51.751861+0000","last_change":"2024-09-22T03:49:17.029349+0000","last_active":"2024-09-22T03:55:51.751861+0000","last_peered":"2024-09-22T03:55:51.751861+0000","last_clean":"2024-09-22T03:55:51.751861+0000","last_became_active":"2024-09-22T03:49:15.094890+0000","last_became_peered":"2024-09-22T03:49:15.094890+0000","last_unstale":"2024-09-22T03:55:51.751861+0000","last_undegraded":"2024-09-22T03:55:51.751861+0000","last_fullsized":"2024-09-22T03:55:51.751861+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"52'58","reported_seq":70,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:55.004437+0000","last_change":"2024-09-22T03:55:50.939050+0000","last_active":"2024-09-22T03:55:55.004437+0000","last_peered":"2024-09-22T03:55:55.004437+0000","last_clean":"2024-09-22T03:55:55.004437+0000","last_became_active":"2024-09-22T03:55:50.929831+0000","last_became_peered":"2024-09-22T03:55:50.929831+0000","last_unstale":"2024-09-22T03:55:55.004437+0000","last_undegraded":"2024-09-22T03:55:55.004437+0000","last_fullsized":"2024-09-22T03:55:55.004437+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3801088,"num_objects":58,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58,"num_write_kb":3712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":126,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:51.749244+0000","last_change":"2024-09-22T03:49:17.031466+0000","last_active":"2024-09-22T03:55:51.749244+0000","last_peered":"2024-09-22T03:55:51.749244+0000","last_clean":"2024-09-22T03:55:51.749244+0000","last_became_active":"2024-09-22T03:49:15.098420+0000","last_became_peered":"2024-09-22T03:49:15.098420+0000","last_unstale":"2024-09-22T03:55:51.749244+0000","last_undegraded":"2024-09-22T03:55:51.749244+0000","last_fullsized":"2024-09-22T03:55:51.749244+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3","version":"52'52","reported_seq":64,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:54.962103+0000","last_change":"2024-09-22T03:55:50.862956+0000","last_active":"2024-09-22T03:55:54.962103+0000","last_peered":"2024-09-22T03:55:54.962103+0000","last_clean":"2024-09-22T03:55:54.962103+0000","last_became_active":"2024-09-22T03:55:50.854828+0000","last_became_peered":"2024-09-22T03:55:50.854828+0000","last_unstale":"2024-09-22T03:55:54.962103+0000","last_undegraded":"2024-09-22T03:55:54.962103+0000","last_fullsized":"2024-09-22T03:55:54.962103+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3407872,"num_objects":52,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52,"num_write_kb":3328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":124,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:51.754967+0000","last_change":"2024-09-22T03:49:17.036954+0000","last_active":"2024-09-22T03:55:51.754967+0000","last_peered":"2024-09-22T03:55:51.754967+0000","last_clean":"2024-09-22T03:55:51.754967+0000","last_became_active":"2024-09-22T03:49:15.110506+0000","last_became_peered":"2024-09-22T03:49:15.110506+0000","last_unstale":"2024-09-22T03:55:51.754967+0000","last_undegraded":"2024-09-22T03:55:51.754967+0000","last_fullsized":"2024-09-22T03:55:51.754967+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"52'54","reported_seq":66,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:54.977971+0000","last_change":"2024-09-22T03:55:50.927264+0000","last_active":"2024-09-22T03:55:54.977971+0000","last_peered":"2024-09-22T03:55:54.977971+0000","last_clean":"2024-09-22T03:55:54.977971+0000","last_became_active":"2024-09-22T03:55:50.919600+0000","last_became_peered":"2024-09-22T03:55:50.919600+0000","last_unstale":"2024-09-22T03:55:54.977971+0000","last_undegraded":"2024-09-22T03:55:54.977971+0000","last_fullsized":"2024-09-22T03:55:54.977971+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3538944,"num_objects":54,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":3456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":124,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:51.747974+0000","last_change":"2024-09-22T03:49:17.032989+0000","last_active":"2024-09-22T03:55:51.747974+0000","last_peered":"2024-09-22T03:55:51.747974+0000","last_clean":"2024-09-22T03:55:51.747974+0000","last_became_active":"2024-09-22T03:49:15.079260+0000","last_became_peered":"2024-09-22T03:49:15.079260+0000","last_unstale":"2024-09-22T03:55:51.747974+0000","last_undegraded":"2024-09-22T03:55:51.747974+0000","last_fullsized":"2024-09-22T03:55:51.747974+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"52'52","reported_seq":64,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:55.961843+0000","last_change":"2024-09-22T03:55:50.862926+0000","last_active":"2024-09-22T03:55:55.961843+0000","last_peered":"2024-09-22T03:55:55.961843+0000","last_clean":"2024-09-22T03:55:55.961843+0000","last_became_active":"2024-09-22T03:55:50.851824+0000","last_became_peered":"2024-09-22T03:55:50.851824+0000","last_unstale":"2024-09-22T03:55:55.961843+0000","last_undegraded":"2024-09-22T03:55:55.961843+0000","last_fullsized":"2024-09-22T03:55:55.961843+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3407872,"num_objects":52,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52,"num_write_kb":3328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":124,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:51.758850+0000","last_change":"2024-09-22T03:49:17.036402+0000","last_active":"2024-09-22T03:55:51.758850+0000","last_peered":"2024-09-22T03:55:51.758850+0000","last_clean":"2024-09-22T03:55:51.758850+0000","last_became_active":"2024-09-22T03:49:15.108430+0000","last_became_peered":"2024-09-22T03:49:15.108430+0000","last_unstale":"2024-09-22T03:55:51.758850+0000","last_undegraded":"2024-09-22T03:55:51.758850+0000","last_fullsized":"2024-09-22T03:55:51.758850+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"52'50","reported_seq":62,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:54.823529+0000","last_change":"2024-09-22T03:55:50.878789+0000","last_active":"2024-09-22T03:55:54.823529+0000","last_peered":"2024-09-22T03:55:54.823529+0000","last_clean":"2024-09-22T03:55:54.823529+0000","last_became_active":"2024-09-22T03:55:50.852561+0000","last_became_peered":"2024-09-22T03:55:50.852561+0000","last_unstale":"2024-09-22T03:55:54.823529+0000","last_undegraded":"2024-09-22T03:55:54.823529+0000","last_fullsized":"2024-09-22T03:55:54.823529+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3276800,"num_objects":50,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":3200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":124,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:51.744448+0000","last_change":"2024-09-22T03:49:17.029128+0000","last_active":"2024-09-22T03:55:51.744448+0000","last_peered":"2024-09-22T03:55:51.744448+0000","last_clean":"2024-09-22T03:55:51.744448+0000","last_became_active":"2024-09-22T03:49:15.113396+0000","last_became_peered":"2024-09-22T03:49:15.113396+0000","last_unstale":"2024-09-22T03:55:51.744448+0000","last_undegraded":"2024-09-22T03:55:51.744448+0000","last_fullsized":"2024-09-22T03:55:51.744448+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":52363264,"num_objects":799,"num_object_clones":0,"num_object_copies":2397,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":799,"num_write_kb":51136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":9625600,"data_stored":154009600,"data_compressed":7310520,"data_compressed_allocated":9625600,"data_compressed_original":154009600,"omap_allocated":0,"internal_metadata":0},"log_size":799,"ondisk_log_size":799,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949673364,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":74028,"kb_used_data":2780,"kb_used_omap":0,"kb_used_meta":71232,"kb_avail":94297812,"statfs":{"total":96636764160,"available":96560959488,"internally_reserved":0,"allocated":2846720,"data_stored":38234496,"data_compressed":1809478,"data_compressed_allocated":2383872,"data_compressed_original":38060032,"omap_allocated":0,"internal_metadata":72941568},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654706068,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":73672,"kb_used_data":2424,"kb_used_omap":0,"kb_used_meta":71232,"kb_avail":94298168,"statfs":{"total":96636764160,"available":96561324032,"internally_reserved":0,"allocated":2482176,"data_stored":32794464,"data_compressed":1549193,"data_compressed_allocated":2039808,"data_compressed_original":32636928,"omap_allocated":0,"internal_metadata":72941568},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706068,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":73816,"kb_used_data":2568,"kb_used_omap":0,"kb_used_meta":71232,"kb_avail":94298024,"statfs":{"total":96636764160,"available":96561176576,"internally_reserved":0,"allocated":2629632,"data_stored":34761088,"data_compressed":1644588,"data_compressed_allocated":2166784,"data_compressed_original":34586624,"omap_allocated":0,"internal_metadata":72941568},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706068,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":78252,"kb_used_data":2844,"kb_used_omap":0,"kb_used_meta":75392,"kb_avail":94293588,"statfs":{"total":96636764160,"available":96556634112,"internally_reserved":0,"allocated":2912256,"data_stored":39348589,"data_compressed":1862337,"data_compressed_allocated":2453504,"data_compressed_original":39174144,"omap_allocated":0,"internal_metadata":77201408},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2641920,"data_stored":42270720,"data_compressed":2006497,"data_compressed_allocated":2641920,"data_compressed_original":42270720,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2555904,"data_stored":40894464,"data_compressed":1941194,"data_compressed_allocated":2555904,"data_compressed_original":40894464,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2195456,"data_stored":35127296,"data_compressed":1667419,"data_compressed_allocated":2195456,"data_compressed_original":35127296,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":2232320,"data_stored":35717120,"data_compressed":1695410,"data_compressed_allocated":2232320,"data_compressed_original":35717120,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:55:57.824 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 6 16 1328 1312 13.6655 13.625 0.0728304 0.0726771 2024-09-22T03:55:58.645 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:55:58.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:55:58.799+0000 7fec530bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:55:58.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:55:58.810+0000 7fec530bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:55:58.824 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 7 16 1568 1552 13.856 15 0.114349 0.0714891 2024-09-22T03:55:59.824 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 8 16 1795 1779 13.8972 14.1875 0.103313 0.071501 2024-09-22T03:56:00.588 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:56:00.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:56:00.757+0000 7fb33cd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:56:00.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:56:00.773+0000 7fb33cd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:56:00.824 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 9 16 2027 2011 13.9641 14.5 0.044664 0.0713425 2024-09-22T03:56:01.164 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:56:01.165 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-22T03:56:01.189 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":251,"stamp":"2024-09-22T03:56:01.049822+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":107545139,"num_objects":1636,"num_object_clones":0,"num_object_copies":4908,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":1713,"num_write_kb":105556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1687,"ondisk_log_size":1687,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":306352,"kb_used_data":21356,"kb_used_omap":0,"kb_used_meta":284928,"kb_avail":377181008,"statfs":{"total":386547056640,"available":386233352192,"internally_reserved":0,"allocated":21868544,"data_stored":321102797,"data_compressed":15220562,"data_compressed_allocated":20041728,"data_compressed_original":320421888,"omap_allocated":0,"internal_metadata":291766272},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":106954752,"num_objects":1632,"num_object_clones":0,"num_object_copies":4896,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1632,"num_write_kb":104448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.001918"},"pg_stats":[{"pgid":"5.f","version":"52'60","reported_seq":72,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:56.060927+0000","last_change":"2024-09-22T03:55:50.938932+0000","last_active":"2024-09-22T03:55:56.060927+0000","last_peered":"2024-09-22T03:55:56.060927+0000","last_clean":"2024-09-22T03:55:56.060927+0000","last_became_active":"2024-09-22T03:55:50.929290+0000","last_became_peered":"2024-09-22T03:55:50.929290+0000","last_unstale":"2024-09-22T03:55:56.060927+0000","last_undegraded":"2024-09-22T03:55:56.060927+0000","last_fullsized":"2024-09-22T03:55:56.060927+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3932160,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60,"num_write_kb":3840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"52'110","reported_seq":122,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:56:00.022586+0000","last_change":"2024-09-22T03:55:50.848180+0000","last_active":"2024-09-22T03:56:00.022586+0000","last_peered":"2024-09-22T03:56:00.022586+0000","last_clean":"2024-09-22T03:56:00.022586+0000","last_became_active":"2024-09-22T03:55:50.838302+0000","last_became_peered":"2024-09-22T03:55:50.838302+0000","last_unstale":"2024-09-22T03:56:00.022586+0000","last_undegraded":"2024-09-22T03:56:00.022586+0000","last_fullsized":"2024-09-22T03:56:00.022586+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7208960,"num_objects":110,"num_object_clones":0,"num_object_copies":330,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":110,"num_write_kb":7040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"52'124","reported_seq":136,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:56:00.075893+0000","last_change":"2024-09-22T03:55:50.872362+0000","last_active":"2024-09-22T03:56:00.075893+0000","last_peered":"2024-09-22T03:56:00.075893+0000","last_clean":"2024-09-22T03:56:00.075893+0000","last_became_active":"2024-09-22T03:55:50.867322+0000","last_became_peered":"2024-09-22T03:55:50.867322+0000","last_unstale":"2024-09-22T03:56:00.075893+0000","last_undegraded":"2024-09-22T03:56:00.075893+0000","last_fullsized":"2024-09-22T03:56:00.075893+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8126464,"num_objects":124,"num_object_clones":0,"num_object_copies":372,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":124,"num_write_kb":7936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"52'58","reported_seq":70,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:56.134495+0000","last_change":"2024-09-22T03:55:50.942624+0000","last_active":"2024-09-22T03:55:56.134495+0000","last_peered":"2024-09-22T03:55:56.134495+0000","last_clean":"2024-09-22T03:55:56.134495+0000","last_became_active":"2024-09-22T03:55:50.922812+0000","last_became_peered":"2024-09-22T03:55:50.922812+0000","last_unstale":"2024-09-22T03:55:56.134495+0000","last_undegraded":"2024-09-22T03:55:56.134495+0000","last_fullsized":"2024-09-22T03:55:56.134495+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3801088,"num_objects":58,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58,"num_write_kb":3712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"52'119","reported_seq":131,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:59.944567+0000","last_change":"2024-09-22T03:55:50.890353+0000","last_active":"2024-09-22T03:55:59.944567+0000","last_peered":"2024-09-22T03:55:59.944567+0000","last_clean":"2024-09-22T03:55:59.944567+0000","last_became_active":"2024-09-22T03:55:50.882633+0000","last_became_peered":"2024-09-22T03:55:50.882633+0000","last_unstale":"2024-09-22T03:55:59.944567+0000","last_undegraded":"2024-09-22T03:55:59.944567+0000","last_fullsized":"2024-09-22T03:55:59.944567+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7798784,"num_objects":119,"num_object_clones":0,"num_object_copies":357,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":119,"num_write_kb":7616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.a","version":"52'112","reported_seq":124,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:59.890006+0000","last_change":"2024-09-22T03:55:50.891052+0000","last_active":"2024-09-22T03:55:59.890006+0000","last_peered":"2024-09-22T03:55:59.890006+0000","last_clean":"2024-09-22T03:55:59.890006+0000","last_became_active":"2024-09-22T03:55:50.880295+0000","last_became_peered":"2024-09-22T03:55:50.880295+0000","last_unstale":"2024-09-22T03:55:59.890006+0000","last_undegraded":"2024-09-22T03:55:59.890006+0000","last_fullsized":"2024-09-22T03:55:59.890006+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340032,"num_objects":112,"num_object_clones":0,"num_object_copies":336,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"52'112","reported_seq":124,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:59.836789+0000","last_change":"2024-09-22T03:55:50.906894+0000","last_active":"2024-09-22T03:55:59.836789+0000","last_peered":"2024-09-22T03:55:59.836789+0000","last_clean":"2024-09-22T03:55:59.836789+0000","last_became_active":"2024-09-22T03:55:50.896899+0000","last_became_peered":"2024-09-22T03:55:50.896899+0000","last_unstale":"2024-09-22T03:55:59.836789+0000","last_undegraded":"2024-09-22T03:55:59.836789+0000","last_fullsized":"2024-09-22T03:55:59.836789+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340032,"num_objects":112,"num_object_clones":0,"num_object_copies":336,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"52'122","reported_seq":134,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:56:00.005961+0000","last_change":"2024-09-22T03:55:50.859578+0000","last_active":"2024-09-22T03:56:00.005961+0000","last_peered":"2024-09-22T03:56:00.005961+0000","last_clean":"2024-09-22T03:56:00.005961+0000","last_became_active":"2024-09-22T03:55:50.843710+0000","last_became_peered":"2024-09-22T03:55:50.843710+0000","last_unstale":"2024-09-22T03:56:00.005961+0000","last_undegraded":"2024-09-22T03:56:00.005961+0000","last_fullsized":"2024-09-22T03:56:00.005961+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7995392,"num_objects":122,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":122,"num_write_kb":7808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"52'119","reported_seq":131,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:59.858854+0000","last_change":"2024-09-22T03:55:50.968411+0000","last_active":"2024-09-22T03:55:59.858854+0000","last_peered":"2024-09-22T03:55:59.858854+0000","last_clean":"2024-09-22T03:55:59.858854+0000","last_became_active":"2024-09-22T03:55:50.961718+0000","last_became_peered":"2024-09-22T03:55:50.961718+0000","last_unstale":"2024-09-22T03:55:59.858854+0000","last_undegraded":"2024-09-22T03:55:59.858854+0000","last_fullsized":"2024-09-22T03:55:59.858854+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7798784,"num_objects":119,"num_object_clones":0,"num_object_copies":357,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":119,"num_write_kb":7616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":199,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:51.749469+0000","last_change":"2024-09-22T03:49:12.034704+0000","last_active":"2024-09-22T03:55:51.749469+0000","last_peered":"2024-09-22T03:55:51.749469+0000","last_clean":"2024-09-22T03:55:51.749469+0000","last_became_active":"2024-09-22T03:49:12.027470+0000","last_became_peered":"2024-09-22T03:49:12.027470+0000","last_unstale":"2024-09-22T03:55:51.749469+0000","last_undegraded":"2024-09-22T03:55:51.749469+0000","last_fullsized":"2024-09-22T03:55:51.749469+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_clean_scrub_stamp":"2024-09-22T03:49:10.979949+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":125,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:51.750162+0000","last_change":"2024-09-22T03:49:17.031458+0000","last_active":"2024-09-22T03:55:51.750162+0000","last_peered":"2024-09-22T03:55:51.750162+0000","last_clean":"2024-09-22T03:55:51.750162+0000","last_became_active":"2024-09-22T03:49:15.125490+0000","last_became_peered":"2024-09-22T03:49:15.125490+0000","last_unstale":"2024-09-22T03:55:51.750162+0000","last_undegraded":"2024-09-22T03:55:51.750162+0000","last_fullsized":"2024-09-22T03:55:51.750162+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.7","version":"52'120","reported_seq":132,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:59.909952+0000","last_change":"2024-09-22T03:55:50.910597+0000","last_active":"2024-09-22T03:55:59.909952+0000","last_peered":"2024-09-22T03:55:59.909952+0000","last_clean":"2024-09-22T03:55:59.909952+0000","last_became_active":"2024-09-22T03:55:50.901290+0000","last_became_peered":"2024-09-22T03:55:50.901290+0000","last_unstale":"2024-09-22T03:55:59.909952+0000","last_undegraded":"2024-09-22T03:55:59.909952+0000","last_fullsized":"2024-09-22T03:55:59.909952+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7864320,"num_objects":120,"num_object_clones":0,"num_object_copies":360,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":7680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":124,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:51.742303+0000","last_change":"2024-09-22T03:49:17.029339+0000","last_active":"2024-09-22T03:55:51.742303+0000","last_peered":"2024-09-22T03:55:51.742303+0000","last_clean":"2024-09-22T03:55:51.742303+0000","last_became_active":"2024-09-22T03:49:15.097304+0000","last_became_peered":"2024-09-22T03:49:15.097304+0000","last_unstale":"2024-09-22T03:55:51.742303+0000","last_undegraded":"2024-09-22T03:55:51.742303+0000","last_fullsized":"2024-09-22T03:55:51.742303+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"52'58","reported_seq":70,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:56.098040+0000","last_change":"2024-09-22T03:55:50.918358+0000","last_active":"2024-09-22T03:55:56.098040+0000","last_peered":"2024-09-22T03:55:56.098040+0000","last_clean":"2024-09-22T03:55:56.098040+0000","last_became_active":"2024-09-22T03:55:50.889906+0000","last_became_peered":"2024-09-22T03:55:50.889906+0000","last_unstale":"2024-09-22T03:55:56.098040+0000","last_undegraded":"2024-09-22T03:55:56.098040+0000","last_fullsized":"2024-09-22T03:55:56.098040+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3801088,"num_objects":58,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58,"num_write_kb":3712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":124,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:51.751861+0000","last_change":"2024-09-22T03:49:17.029349+0000","last_active":"2024-09-22T03:55:51.751861+0000","last_peered":"2024-09-22T03:55:51.751861+0000","last_clean":"2024-09-22T03:55:51.751861+0000","last_became_active":"2024-09-22T03:49:15.094890+0000","last_became_peered":"2024-09-22T03:49:15.094890+0000","last_unstale":"2024-09-22T03:55:51.751861+0000","last_undegraded":"2024-09-22T03:55:51.751861+0000","last_fullsized":"2024-09-22T03:55:51.751861+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"52'114","reported_seq":126,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:56:00.020497+0000","last_change":"2024-09-22T03:55:50.939050+0000","last_active":"2024-09-22T03:56:00.020497+0000","last_peered":"2024-09-22T03:56:00.020497+0000","last_clean":"2024-09-22T03:56:00.020497+0000","last_became_active":"2024-09-22T03:55:50.929831+0000","last_became_peered":"2024-09-22T03:55:50.929831+0000","last_unstale":"2024-09-22T03:56:00.020497+0000","last_undegraded":"2024-09-22T03:56:00.020497+0000","last_fullsized":"2024-09-22T03:56:00.020497+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7471104,"num_objects":114,"num_object_clones":0,"num_object_copies":342,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":114,"num_write_kb":7296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":126,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:51.749244+0000","last_change":"2024-09-22T03:49:17.031466+0000","last_active":"2024-09-22T03:55:51.749244+0000","last_peered":"2024-09-22T03:55:51.749244+0000","last_clean":"2024-09-22T03:55:51.749244+0000","last_became_active":"2024-09-22T03:49:15.098420+0000","last_became_peered":"2024-09-22T03:49:15.098420+0000","last_unstale":"2024-09-22T03:55:51.749244+0000","last_undegraded":"2024-09-22T03:55:51.749244+0000","last_fullsized":"2024-09-22T03:55:51.749244+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3","version":"52'119","reported_seq":131,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:59.932517+0000","last_change":"2024-09-22T03:55:50.862956+0000","last_active":"2024-09-22T03:55:59.932517+0000","last_peered":"2024-09-22T03:55:59.932517+0000","last_clean":"2024-09-22T03:55:59.932517+0000","last_became_active":"2024-09-22T03:55:50.854828+0000","last_became_peered":"2024-09-22T03:55:50.854828+0000","last_unstale":"2024-09-22T03:55:59.932517+0000","last_undegraded":"2024-09-22T03:55:59.932517+0000","last_fullsized":"2024-09-22T03:55:59.932517+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7798784,"num_objects":119,"num_object_clones":0,"num_object_copies":357,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":119,"num_write_kb":7616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":124,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:51.754967+0000","last_change":"2024-09-22T03:49:17.036954+0000","last_active":"2024-09-22T03:55:51.754967+0000","last_peered":"2024-09-22T03:55:51.754967+0000","last_clean":"2024-09-22T03:55:51.754967+0000","last_became_active":"2024-09-22T03:49:15.110506+0000","last_became_peered":"2024-09-22T03:49:15.110506+0000","last_unstale":"2024-09-22T03:55:51.754967+0000","last_undegraded":"2024-09-22T03:55:51.754967+0000","last_fullsized":"2024-09-22T03:55:51.754967+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"52'119","reported_seq":131,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:56:00.064015+0000","last_change":"2024-09-22T03:55:50.927264+0000","last_active":"2024-09-22T03:56:00.064015+0000","last_peered":"2024-09-22T03:56:00.064015+0000","last_clean":"2024-09-22T03:56:00.064015+0000","last_became_active":"2024-09-22T03:55:50.919600+0000","last_became_peered":"2024-09-22T03:55:50.919600+0000","last_unstale":"2024-09-22T03:56:00.064015+0000","last_undegraded":"2024-09-22T03:56:00.064015+0000","last_fullsized":"2024-09-22T03:56:00.064015+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7798784,"num_objects":119,"num_object_clones":0,"num_object_copies":357,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":119,"num_write_kb":7616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":124,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:51.747974+0000","last_change":"2024-09-22T03:49:17.032989+0000","last_active":"2024-09-22T03:55:51.747974+0000","last_peered":"2024-09-22T03:55:51.747974+0000","last_clean":"2024-09-22T03:55:51.747974+0000","last_became_active":"2024-09-22T03:49:15.079260+0000","last_became_peered":"2024-09-22T03:49:15.079260+0000","last_unstale":"2024-09-22T03:55:51.747974+0000","last_undegraded":"2024-09-22T03:55:51.747974+0000","last_fullsized":"2024-09-22T03:55:51.747974+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"52'52","reported_seq":64,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:55.961843+0000","last_change":"2024-09-22T03:55:50.862926+0000","last_active":"2024-09-22T03:55:55.961843+0000","last_peered":"2024-09-22T03:55:55.961843+0000","last_clean":"2024-09-22T03:55:55.961843+0000","last_became_active":"2024-09-22T03:55:50.851824+0000","last_became_peered":"2024-09-22T03:55:50.851824+0000","last_unstale":"2024-09-22T03:55:55.961843+0000","last_undegraded":"2024-09-22T03:55:55.961843+0000","last_fullsized":"2024-09-22T03:55:55.961843+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3407872,"num_objects":52,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52,"num_write_kb":3328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":124,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:51.758850+0000","last_change":"2024-09-22T03:49:17.036402+0000","last_active":"2024-09-22T03:55:51.758850+0000","last_peered":"2024-09-22T03:55:51.758850+0000","last_clean":"2024-09-22T03:55:51.758850+0000","last_became_active":"2024-09-22T03:49:15.108430+0000","last_became_peered":"2024-09-22T03:49:15.108430+0000","last_unstale":"2024-09-22T03:55:51.758850+0000","last_undegraded":"2024-09-22T03:55:51.758850+0000","last_fullsized":"2024-09-22T03:55:51.758850+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"52'114","reported_seq":126,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:56:00.025420+0000","last_change":"2024-09-22T03:55:50.878789+0000","last_active":"2024-09-22T03:56:00.025420+0000","last_peered":"2024-09-22T03:56:00.025420+0000","last_clean":"2024-09-22T03:56:00.025420+0000","last_became_active":"2024-09-22T03:55:50.852561+0000","last_became_peered":"2024-09-22T03:55:50.852561+0000","last_unstale":"2024-09-22T03:56:00.025420+0000","last_undegraded":"2024-09-22T03:56:00.025420+0000","last_fullsized":"2024-09-22T03:56:00.025420+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7471104,"num_objects":114,"num_object_clones":0,"num_object_copies":342,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":114,"num_write_kb":7296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":124,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:51.744448+0000","last_change":"2024-09-22T03:49:17.029128+0000","last_active":"2024-09-22T03:55:51.744448+0000","last_peered":"2024-09-22T03:55:51.744448+0000","last_clean":"2024-09-22T03:55:51.744448+0000","last_became_active":"2024-09-22T03:49:15.113396+0000","last_became_peered":"2024-09-22T03:49:15.113396+0000","last_unstale":"2024-09-22T03:55:51.744448+0000","last_undegraded":"2024-09-22T03:55:51.744448+0000","last_fullsized":"2024-09-22T03:55:51.744448+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":106954752,"num_objects":1632,"num_object_clones":0,"num_object_copies":4896,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1632,"num_write_kb":104448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20668416,"data_stored":330694656,"data_compressed":15699838,"data_compressed_allocated":20668416,"data_compressed_original":330694656,"omap_allocated":0,"internal_metadata":0},"log_size":1632,"ondisk_log_size":1632,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949673364,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":74028,"kb_used_data":2780,"kb_used_omap":0,"kb_used_meta":71232,"kb_avail":94297812,"statfs":{"total":96636764160,"available":96560959488,"internally_reserved":0,"allocated":2846720,"data_stored":38234496,"data_compressed":1809478,"data_compressed_allocated":2383872,"data_compressed_original":38060032,"omap_allocated":0,"internal_metadata":72941568},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654706073,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":81204,"kb_used_data":5796,"kb_used_omap":0,"kb_used_meta":75392,"kb_avail":94290636,"statfs":{"total":96636764160,"available":96553611264,"internally_reserved":0,"allocated":5935104,"data_stored":88041312,"data_compressed":4172359,"data_compressed_allocated":5492736,"data_compressed_original":87883776,"omap_allocated":0,"internal_metadata":77201408},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706073,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":81400,"kb_used_data":5988,"kb_used_omap":0,"kb_used_meta":75392,"kb_avail":94290440,"statfs":{"total":96636764160,"available":96553410560,"internally_reserved":0,"allocated":6131712,"data_stored":90794368,"data_compressed":4305133,"data_compressed_allocated":5668864,"data_compressed_original":90619904,"omap_allocated":0,"internal_metadata":77201408},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706073,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":69720,"kb_used_data":6792,"kb_used_omap":0,"kb_used_meta":62912,"kb_avail":94302120,"statfs":{"total":96636764160,"available":96565370880,"internally_reserved":0,"allocated":6955008,"data_stored":104032621,"data_compressed":4933592,"data_compressed_allocated":6496256,"data_compressed_original":103858176,"omap_allocated":0,"internal_metadata":64421888},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6664192,"data_stored":106627072,"data_compressed":5062248,"data_compressed_allocated":6664192,"data_compressed_original":106627072,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2555904,"data_stored":40894464,"data_compressed":1941194,"data_compressed_allocated":2555904,"data_compressed_original":40894464,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5734400,"data_stored":91750400,"data_compressed":4355989,"data_compressed_allocated":5734400,"data_compressed_original":91750400,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":5713920,"data_stored":91422720,"data_compressed":4340407,"data_compressed_allocated":5713920,"data_compressed_original":91422720,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:56:01.190 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-22T03:56:01.191 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:56:01.191 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:56:01.191 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:56:01.254 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:56:01.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:56:01.359+0000 7fa8c98bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:56:01.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:56:01.375+0000 7fa8c98bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:56:01.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:56:01.438+0000 7f485e2bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:56:01.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:56:01.448+0000 7f485e2bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:56:01.542 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:56:01.542 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:56:01.542 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:56:01.542 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:56:01.542 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:56:01.542 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:56:01.542 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:56:01.542 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:56:01.542 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:56:01.542 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:56:01.542 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:56:01.543 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:56:01.545 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:56:01.546 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:56:01.546 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:56:01.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:56:01.733+0000 7f73b0afd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:56:01.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:56:01.746+0000 7f73b0afd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:56:01.824 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 10 16 2237 2221 13.88 13.125 0.129836 0.0716102 2024-09-22T03:56:01.829 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:56:01.829 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:56:01.829 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:56:01.829 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:56:01.829 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:56:01.829 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:56:01.829 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:56:01.829 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:56:01.829 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:56:01.829 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:56:01.829 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:56:01.829 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:56:01.836 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:56:01.837 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:56:01.837 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:56:02.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:56:02.005+0000 7efdc0d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:56:02.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:56:02.025+0000 7efdc0d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:56:02.064 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:56:02.064 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:56:02.064 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:56:02.064 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:56:02.064 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:56:02.064 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:56:02.064 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:56:02.064 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:56:02.064 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:56:02.064 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:56:02.064 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:56:02.065 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:56:02.069 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:56:02.069 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:56:02.070 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:56:02.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:56:02.247+0000 7f6827191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:56:02.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:56:02.266+0000 7f6827191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:56:02.425 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:56:02.425 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:56:02.425 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:56:02.425 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:56:02.425 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:56:02.426 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:56:02.426 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:56:02.426 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:56:02.426 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:56:02.426 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:56:02.426 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:56:02.426 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:56:02.431 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:56:02.431 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:56:02.824 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 11 16 2456 2440 13.8624 13.6875 0.101867 0.0719205 2024-09-22T03:56:03.824 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 12 16 2684 2668 13.8946 14.25 0.0629325 0.0717459 2024-09-22T03:56:03.910 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:56:04.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:56:04.074+0000 7f7442274640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:56:04.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:56:04.084+0000 7f7442274640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:56:04.824 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 13 16 2908 2892 13.9026 14 0.0823139 0.0717027 2024-09-22T03:56:05.824 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 14 16 3141 3125 13.9497 14.5625 0.0815354 0.0715222 2024-09-22T03:56:06.512 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:56:06.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:56:06.689+0000 7ff72ed91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:56:06.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:56:06.700+0000 7ff72ed91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:56:06.824 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 15 16 3362 3346 13.9404 13.8125 0.0582907 0.0715629 2024-09-22T03:56:07.432 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:56:07.432 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:56:07.432 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:56:07.432 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:56:07.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:56:07.592+0000 7f52b9246640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:56:07.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:56:07.612+0000 7f52b9246640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:56:07.790 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:56:07.791 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:56:07.791 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:56:07.791 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:56:07.791 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:56:07.791 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:56:07.791 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:56:07.791 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:56:07.791 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:56:07.791 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:56:07.791 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:56:07.791 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:56:07.795 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:56:07.796 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:56:07.796 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:56:07.824 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 16 16 3586 3570 13.9441 14 0.059235 0.0715455 2024-09-22T03:56:07.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:56:07.976+0000 7fb0db551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:56:07.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:56:07.993+0000 7fb0db551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:56:08.163 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:56:08.163 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:56:08.163 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:56:08.163 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:56:08.163 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:56:08.163 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:56:08.163 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:56:08.163 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:56:08.163 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:56:08.163 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:56:08.164 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:56:08.164 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:56:08.170 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:56:08.170 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:56:08.170 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:56:08.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:56:08.372+0000 7fb9b30d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:56:08.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:56:08.389+0000 7fb9b30d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:56:08.418 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:56:08.419 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:56:08.419 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:56:08.419 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:56:08.419 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:56:08.419 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:56:08.419 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:56:08.419 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:56:08.419 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:56:08.419 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:56:08.420 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:56:08.420 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:56:08.423 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:56:08.423 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:56:08.423 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:56:08.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:56:08.597+0000 7f9d59791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:56:08.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:56:08.617+0000 7f9d59791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:56:08.661 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:56:08.662 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:56:08.662 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:56:08.662 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:56:08.662 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:56:08.662 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:56:08.662 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:56:08.662 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:56:08.662 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:56:08.662 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:56:08.662 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:56:08.662 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:56:08.667 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:56:08.667 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:56:08.825 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 17 16 3809 3793 13.9436 13.9375 0.0738595 0.0715106 2024-09-22T03:56:09.177 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:56:09.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:56:09.348+0000 7fae7d151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:56:09.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:56:09.357+0000 7fae7d151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:56:09.825 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 18 16 4031 4015 13.9397 13.875 0.0610092 0.0715972 2024-09-22T03:56:10.825 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 19 16 4251 4235 13.9297 13.75 0.0917219 0.0716195 2024-09-22T03:56:11.759 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:56:11.825 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:2024-09-22T03:56:11.824830+0000 min lat: 0.0157147 max lat: 0.204046 avg lat: 0.0716939 2024-09-22T03:56:11.825 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-22T03:56:11.825 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 20 16 4464 4448 13.8988 13.3125 0.053011 0.0716939 2024-09-22T03:56:11.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:56:11.929+0000 7fa731b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:56:11.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:56:11.945+0000 7fa731b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:56:12.825 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 21 16 4684 4668 13.8916 13.75 0.0812865 0.0718496 2024-09-22T03:56:13.668 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:56:13.668 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:56:13.668 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:56:13.825 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 22 16 4916 4900 13.9192 14.5 0.0865905 0.0716893 2024-09-22T03:56:13.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:56:13.837+0000 7f62092a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:56:13.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:56:13.851+0000 7f62092a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:56:14.245 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:56:14.246 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-22T03:56:14.266 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":257,"stamp":"2024-09-22T03:56:13.052678+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":272761395,"num_objects":4157,"num_object_clones":0,"num_object_copies":12471,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":4234,"num_write_kb":266900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4208,"ondisk_log_size":4208,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":315192,"kb_used_data":51000,"kb_used_omap":0,"kb_used_meta":264128,"kb_avail":377172168,"statfs":{"total":386547056640,"available":386224300032,"internally_reserved":0,"allocated":52224000,"data_stored":806790093,"data_compressed":38283526,"data_compressed_allocated":50397184,"data_compressed_original":806109184,"omap_allocated":0,"internal_metadata":270467072},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":165216256,"num_objects":2521,"num_object_clones":0,"num_object_copies":7563,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2521,"num_write_kb":161344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002855"},"pg_stats":[{"pgid":"5.f","version":"52'280","reported_seq":292,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:56:10.975854+0000","last_change":"2024-09-22T03:55:50.938932+0000","last_active":"2024-09-22T03:56:10.975854+0000","last_peered":"2024-09-22T03:56:10.975854+0000","last_clean":"2024-09-22T03:56:10.975854+0000","last_became_active":"2024-09-22T03:55:50.929290+0000","last_became_peered":"2024-09-22T03:55:50.929290+0000","last_unstale":"2024-09-22T03:56:10.975854+0000","last_undegraded":"2024-09-22T03:56:10.975854+0000","last_fullsized":"2024-09-22T03:56:10.975854+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":280,"log_dups_size":0,"ondisk_log_size":280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18350080,"num_objects":280,"num_object_clones":0,"num_object_copies":840,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":280,"num_write_kb":17920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"52'248","reported_seq":260,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:56:09.840400+0000","last_change":"2024-09-22T03:55:50.848180+0000","last_active":"2024-09-22T03:56:09.840400+0000","last_peered":"2024-09-22T03:56:09.840400+0000","last_clean":"2024-09-22T03:56:09.840400+0000","last_became_active":"2024-09-22T03:55:50.838302+0000","last_became_peered":"2024-09-22T03:55:50.838302+0000","last_unstale":"2024-09-22T03:56:09.840400+0000","last_undegraded":"2024-09-22T03:56:09.840400+0000","last_fullsized":"2024-09-22T03:56:09.840400+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":248,"log_dups_size":0,"ondisk_log_size":248,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16252928,"num_objects":248,"num_object_clones":0,"num_object_copies":744,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":248,"num_write_kb":15872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"52'271","reported_seq":283,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:56:09.879557+0000","last_change":"2024-09-22T03:55:50.872362+0000","last_active":"2024-09-22T03:56:09.879557+0000","last_peered":"2024-09-22T03:56:09.879557+0000","last_clean":"2024-09-22T03:56:09.879557+0000","last_became_active":"2024-09-22T03:55:50.867322+0000","last_became_peered":"2024-09-22T03:55:50.867322+0000","last_unstale":"2024-09-22T03:56:09.879557+0000","last_undegraded":"2024-09-22T03:56:09.879557+0000","last_fullsized":"2024-09-22T03:56:09.879557+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":271,"log_dups_size":0,"ondisk_log_size":271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17760256,"num_objects":271,"num_object_clones":0,"num_object_copies":813,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":271,"num_write_kb":17344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"52'270","reported_seq":282,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:56:11.059995+0000","last_change":"2024-09-22T03:55:50.942624+0000","last_active":"2024-09-22T03:56:11.059995+0000","last_peered":"2024-09-22T03:56:11.059995+0000","last_clean":"2024-09-22T03:56:11.059995+0000","last_became_active":"2024-09-22T03:55:50.922812+0000","last_became_peered":"2024-09-22T03:55:50.922812+0000","last_unstale":"2024-09-22T03:56:11.059995+0000","last_undegraded":"2024-09-22T03:56:11.059995+0000","last_fullsized":"2024-09-22T03:56:11.059995+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":270,"log_dups_size":0,"ondisk_log_size":270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17694720,"num_objects":270,"num_object_clones":0,"num_object_copies":810,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":270,"num_write_kb":17280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"52'263","reported_seq":275,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:56:10.005756+0000","last_change":"2024-09-22T03:55:50.890353+0000","last_active":"2024-09-22T03:56:10.005756+0000","last_peered":"2024-09-22T03:56:10.005756+0000","last_clean":"2024-09-22T03:56:10.005756+0000","last_became_active":"2024-09-22T03:55:50.882633+0000","last_became_peered":"2024-09-22T03:55:50.882633+0000","last_unstale":"2024-09-22T03:56:10.005756+0000","last_undegraded":"2024-09-22T03:56:10.005756+0000","last_fullsized":"2024-09-22T03:56:10.005756+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":263,"log_dups_size":0,"ondisk_log_size":263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17235968,"num_objects":263,"num_object_clones":0,"num_object_copies":789,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":263,"num_write_kb":16832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.a","version":"52'257","reported_seq":269,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:56:10.057143+0000","last_change":"2024-09-22T03:55:50.891052+0000","last_active":"2024-09-22T03:56:10.057143+0000","last_peered":"2024-09-22T03:56:10.057143+0000","last_clean":"2024-09-22T03:56:10.057143+0000","last_became_active":"2024-09-22T03:55:50.880295+0000","last_became_peered":"2024-09-22T03:55:50.880295+0000","last_unstale":"2024-09-22T03:56:10.057143+0000","last_undegraded":"2024-09-22T03:56:10.057143+0000","last_fullsized":"2024-09-22T03:56:10.057143+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":257,"log_dups_size":0,"ondisk_log_size":257,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16842752,"num_objects":257,"num_object_clones":0,"num_object_copies":771,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":257,"num_write_kb":16448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"52'253","reported_seq":265,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:56:10.051089+0000","last_change":"2024-09-22T03:55:50.906894+0000","last_active":"2024-09-22T03:56:10.051089+0000","last_peered":"2024-09-22T03:56:10.051089+0000","last_clean":"2024-09-22T03:56:10.051089+0000","last_became_active":"2024-09-22T03:55:50.896899+0000","last_became_peered":"2024-09-22T03:55:50.896899+0000","last_unstale":"2024-09-22T03:56:10.051089+0000","last_undegraded":"2024-09-22T03:56:10.051089+0000","last_fullsized":"2024-09-22T03:56:10.051089+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":253,"log_dups_size":0,"ondisk_log_size":253,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16580608,"num_objects":253,"num_object_clones":0,"num_object_copies":759,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":253,"num_write_kb":16192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"52'268","reported_seq":280,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:56:10.031601+0000","last_change":"2024-09-22T03:55:50.859578+0000","last_active":"2024-09-22T03:56:10.031601+0000","last_peered":"2024-09-22T03:56:10.031601+0000","last_clean":"2024-09-22T03:56:10.031601+0000","last_became_active":"2024-09-22T03:55:50.843710+0000","last_became_peered":"2024-09-22T03:55:50.843710+0000","last_unstale":"2024-09-22T03:56:10.031601+0000","last_undegraded":"2024-09-22T03:56:10.031601+0000","last_fullsized":"2024-09-22T03:56:10.031601+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":268,"log_dups_size":0,"ondisk_log_size":268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17563648,"num_objects":268,"num_object_clones":0,"num_object_copies":804,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":268,"num_write_kb":17152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"52'255","reported_seq":267,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:56:10.041517+0000","last_change":"2024-09-22T03:55:50.968411+0000","last_active":"2024-09-22T03:56:10.041517+0000","last_peered":"2024-09-22T03:56:10.041517+0000","last_clean":"2024-09-22T03:56:10.041517+0000","last_became_active":"2024-09-22T03:55:50.961718+0000","last_became_peered":"2024-09-22T03:55:50.961718+0000","last_unstale":"2024-09-22T03:56:10.041517+0000","last_undegraded":"2024-09-22T03:56:10.041517+0000","last_fullsized":"2024-09-22T03:56:10.041517+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":255,"log_dups_size":0,"ondisk_log_size":255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16711680,"num_objects":255,"num_object_clones":0,"num_object_copies":765,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":255,"num_write_kb":16320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":199,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:51.749469+0000","last_change":"2024-09-22T03:49:12.034704+0000","last_active":"2024-09-22T03:55:51.749469+0000","last_peered":"2024-09-22T03:55:51.749469+0000","last_clean":"2024-09-22T03:55:51.749469+0000","last_became_active":"2024-09-22T03:49:12.027470+0000","last_became_peered":"2024-09-22T03:49:12.027470+0000","last_unstale":"2024-09-22T03:55:51.749469+0000","last_undegraded":"2024-09-22T03:55:51.749469+0000","last_fullsized":"2024-09-22T03:55:51.749469+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_clean_scrub_stamp":"2024-09-22T03:49:10.979949+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":125,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:51.750162+0000","last_change":"2024-09-22T03:49:17.031458+0000","last_active":"2024-09-22T03:55:51.750162+0000","last_peered":"2024-09-22T03:55:51.750162+0000","last_clean":"2024-09-22T03:55:51.750162+0000","last_became_active":"2024-09-22T03:49:15.125490+0000","last_became_peered":"2024-09-22T03:49:15.125490+0000","last_unstale":"2024-09-22T03:55:51.750162+0000","last_undegraded":"2024-09-22T03:55:51.750162+0000","last_fullsized":"2024-09-22T03:55:51.750162+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.7","version":"52'269","reported_seq":281,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:56:09.869912+0000","last_change":"2024-09-22T03:55:50.910597+0000","last_active":"2024-09-22T03:56:09.869912+0000","last_peered":"2024-09-22T03:56:09.869912+0000","last_clean":"2024-09-22T03:56:09.869912+0000","last_became_active":"2024-09-22T03:55:50.901290+0000","last_became_peered":"2024-09-22T03:55:50.901290+0000","last_unstale":"2024-09-22T03:56:09.869912+0000","last_undegraded":"2024-09-22T03:56:09.869912+0000","last_fullsized":"2024-09-22T03:56:09.869912+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":269,"log_dups_size":0,"ondisk_log_size":269,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17629184,"num_objects":269,"num_object_clones":0,"num_object_copies":807,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":269,"num_write_kb":17216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":124,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:51.742303+0000","last_change":"2024-09-22T03:49:17.029339+0000","last_active":"2024-09-22T03:55:51.742303+0000","last_peered":"2024-09-22T03:55:51.742303+0000","last_clean":"2024-09-22T03:55:51.742303+0000","last_became_active":"2024-09-22T03:49:15.097304+0000","last_became_peered":"2024-09-22T03:49:15.097304+0000","last_unstale":"2024-09-22T03:55:51.742303+0000","last_undegraded":"2024-09-22T03:55:51.742303+0000","last_fullsized":"2024-09-22T03:55:51.742303+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"52'274","reported_seq":286,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:56:11.075983+0000","last_change":"2024-09-22T03:55:50.918358+0000","last_active":"2024-09-22T03:56:11.075983+0000","last_peered":"2024-09-22T03:56:11.075983+0000","last_clean":"2024-09-22T03:56:11.075983+0000","last_became_active":"2024-09-22T03:55:50.889906+0000","last_became_peered":"2024-09-22T03:55:50.889906+0000","last_unstale":"2024-09-22T03:56:11.075983+0000","last_undegraded":"2024-09-22T03:56:11.075983+0000","last_fullsized":"2024-09-22T03:56:11.075983+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":274,"log_dups_size":0,"ondisk_log_size":274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17956864,"num_objects":274,"num_object_clones":0,"num_object_copies":822,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":274,"num_write_kb":17536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":124,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:51.751861+0000","last_change":"2024-09-22T03:49:17.029349+0000","last_active":"2024-09-22T03:55:51.751861+0000","last_peered":"2024-09-22T03:55:51.751861+0000","last_clean":"2024-09-22T03:55:51.751861+0000","last_became_active":"2024-09-22T03:49:15.094890+0000","last_became_peered":"2024-09-22T03:49:15.094890+0000","last_unstale":"2024-09-22T03:55:51.751861+0000","last_undegraded":"2024-09-22T03:55:51.751861+0000","last_fullsized":"2024-09-22T03:55:51.751861+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"52'258","reported_seq":270,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:56:09.959782+0000","last_change":"2024-09-22T03:55:50.939050+0000","last_active":"2024-09-22T03:56:09.959782+0000","last_peered":"2024-09-22T03:56:09.959782+0000","last_clean":"2024-09-22T03:56:09.959782+0000","last_became_active":"2024-09-22T03:55:50.929831+0000","last_became_peered":"2024-09-22T03:55:50.929831+0000","last_unstale":"2024-09-22T03:56:09.959782+0000","last_undegraded":"2024-09-22T03:56:09.959782+0000","last_fullsized":"2024-09-22T03:56:09.959782+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":258,"log_dups_size":0,"ondisk_log_size":258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16908288,"num_objects":258,"num_object_clones":0,"num_object_copies":774,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":258,"num_write_kb":16512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":126,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:51.749244+0000","last_change":"2024-09-22T03:49:17.031466+0000","last_active":"2024-09-22T03:55:51.749244+0000","last_peered":"2024-09-22T03:55:51.749244+0000","last_clean":"2024-09-22T03:55:51.749244+0000","last_became_active":"2024-09-22T03:49:15.098420+0000","last_became_peered":"2024-09-22T03:49:15.098420+0000","last_unstale":"2024-09-22T03:55:51.749244+0000","last_undegraded":"2024-09-22T03:55:51.749244+0000","last_fullsized":"2024-09-22T03:55:51.749244+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3","version":"52'239","reported_seq":251,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:56:10.091953+0000","last_change":"2024-09-22T03:55:50.862956+0000","last_active":"2024-09-22T03:56:10.091953+0000","last_peered":"2024-09-22T03:56:10.091953+0000","last_clean":"2024-09-22T03:56:10.091953+0000","last_became_active":"2024-09-22T03:55:50.854828+0000","last_became_peered":"2024-09-22T03:55:50.854828+0000","last_unstale":"2024-09-22T03:56:10.091953+0000","last_undegraded":"2024-09-22T03:56:10.091953+0000","last_fullsized":"2024-09-22T03:56:10.091953+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15663104,"num_objects":239,"num_object_clones":0,"num_object_copies":717,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":239,"num_write_kb":15296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":124,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:51.754967+0000","last_change":"2024-09-22T03:49:17.036954+0000","last_active":"2024-09-22T03:55:51.754967+0000","last_peered":"2024-09-22T03:55:51.754967+0000","last_clean":"2024-09-22T03:55:51.754967+0000","last_became_active":"2024-09-22T03:49:15.110506+0000","last_became_peered":"2024-09-22T03:49:15.110506+0000","last_unstale":"2024-09-22T03:55:51.754967+0000","last_undegraded":"2024-09-22T03:55:51.754967+0000","last_fullsized":"2024-09-22T03:55:51.754967+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"52'251","reported_seq":263,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:56:09.821524+0000","last_change":"2024-09-22T03:55:50.927264+0000","last_active":"2024-09-22T03:56:09.821524+0000","last_peered":"2024-09-22T03:56:09.821524+0000","last_clean":"2024-09-22T03:56:09.821524+0000","last_became_active":"2024-09-22T03:55:50.919600+0000","last_became_peered":"2024-09-22T03:55:50.919600+0000","last_unstale":"2024-09-22T03:56:09.821524+0000","last_undegraded":"2024-09-22T03:56:09.821524+0000","last_fullsized":"2024-09-22T03:56:09.821524+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":251,"log_dups_size":0,"ondisk_log_size":251,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16449536,"num_objects":251,"num_object_clones":0,"num_object_copies":753,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":251,"num_write_kb":16064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":124,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:51.747974+0000","last_change":"2024-09-22T03:49:17.032989+0000","last_active":"2024-09-22T03:55:51.747974+0000","last_peered":"2024-09-22T03:55:51.747974+0000","last_clean":"2024-09-22T03:55:51.747974+0000","last_became_active":"2024-09-22T03:49:15.079260+0000","last_became_peered":"2024-09-22T03:49:15.079260+0000","last_unstale":"2024-09-22T03:55:51.747974+0000","last_undegraded":"2024-09-22T03:55:51.747974+0000","last_fullsized":"2024-09-22T03:55:51.747974+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"52'261","reported_seq":273,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:56:11.146564+0000","last_change":"2024-09-22T03:55:50.862926+0000","last_active":"2024-09-22T03:56:11.146564+0000","last_peered":"2024-09-22T03:56:11.146564+0000","last_clean":"2024-09-22T03:56:11.146564+0000","last_became_active":"2024-09-22T03:55:50.851824+0000","last_became_peered":"2024-09-22T03:55:50.851824+0000","last_unstale":"2024-09-22T03:56:11.146564+0000","last_undegraded":"2024-09-22T03:56:11.146564+0000","last_fullsized":"2024-09-22T03:56:11.146564+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":261,"log_dups_size":0,"ondisk_log_size":261,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17104896,"num_objects":261,"num_object_clones":0,"num_object_copies":783,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":261,"num_write_kb":16704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":124,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:51.758850+0000","last_change":"2024-09-22T03:49:17.036402+0000","last_active":"2024-09-22T03:55:51.758850+0000","last_peered":"2024-09-22T03:55:51.758850+0000","last_clean":"2024-09-22T03:55:51.758850+0000","last_became_active":"2024-09-22T03:49:15.108430+0000","last_became_peered":"2024-09-22T03:49:15.108430+0000","last_unstale":"2024-09-22T03:55:51.758850+0000","last_undegraded":"2024-09-22T03:55:51.758850+0000","last_fullsized":"2024-09-22T03:55:51.758850+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"52'236","reported_seq":248,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:56:09.817356+0000","last_change":"2024-09-22T03:55:50.878789+0000","last_active":"2024-09-22T03:56:09.817356+0000","last_peered":"2024-09-22T03:56:09.817356+0000","last_clean":"2024-09-22T03:56:09.817356+0000","last_became_active":"2024-09-22T03:55:50.852561+0000","last_became_peered":"2024-09-22T03:55:50.852561+0000","last_unstale":"2024-09-22T03:56:09.817356+0000","last_undegraded":"2024-09-22T03:56:09.817356+0000","last_fullsized":"2024-09-22T03:56:09.817356+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":236,"log_dups_size":0,"ondisk_log_size":236,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15466496,"num_objects":236,"num_object_clones":0,"num_object_copies":708,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":236,"num_write_kb":15104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":124,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:51.744448+0000","last_change":"2024-09-22T03:49:17.029128+0000","last_active":"2024-09-22T03:55:51.744448+0000","last_peered":"2024-09-22T03:55:51.744448+0000","last_clean":"2024-09-22T03:55:51.744448+0000","last_became_active":"2024-09-22T03:49:15.113396+0000","last_became_peered":"2024-09-22T03:49:15.113396+0000","last_unstale":"2024-09-22T03:55:51.744448+0000","last_undegraded":"2024-09-22T03:55:51.744448+0000","last_fullsized":"2024-09-22T03:55:51.744448+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":272171008,"num_objects":4153,"num_object_clones":0,"num_object_copies":12459,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4153,"num_write_kb":265792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":50839552,"data_stored":813432832,"data_compressed":38622814,"data_compressed_allocated":50839552,"data_compressed_original":813432832,"omap_allocated":0,"internal_metadata":0},"log_size":4153,"ondisk_log_size":4153,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949673379,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":74052,"kb_used_data":11124,"kb_used_omap":0,"kb_used_meta":62912,"kb_avail":94297788,"statfs":{"total":96636764160,"available":96560934912,"internally_reserved":0,"allocated":11390976,"data_stored":174942592,"data_compressed":8301042,"data_compressed_allocated":10928128,"data_compressed_original":174768128,"omap_allocated":0,"internal_metadata":64421888},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654706083,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":79532,"kb_used_data":12444,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94292308,"statfs":{"total":96636764160,"available":96555323392,"internally_reserved":0,"allocated":12742656,"data_stored":196962144,"data_compressed":9344503,"data_compressed_allocated":12300288,"data_compressed_original":196804608,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706083,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":79916,"kb_used_data":12828,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94291924,"statfs":{"total":96636764160,"available":96554930176,"internally_reserved":0,"allocated":13135872,"data_stored":202860928,"data_compressed":9626653,"data_compressed_allocated":12673024,"data_compressed_original":202686464,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706083,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":81692,"kb_used_data":14604,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94290148,"statfs":{"total":96636764160,"available":96553111552,"internally_reserved":0,"allocated":14954496,"data_stored":232024429,"data_compressed":11011328,"data_compressed_allocated":14495744,"data_compressed_original":231849984,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":14614528,"data_stored":233832448,"data_compressed":11102640,"data_compressed_allocated":14614528,"data_compressed_original":233832448,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":11075584,"data_stored":177209344,"data_compressed":8414138,"data_compressed_allocated":11075584,"data_compressed_original":177209344,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12673024,"data_stored":202768384,"data_compressed":9627717,"data_compressed_allocated":12673024,"data_compressed_original":202768384,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12476416,"data_stored":199622656,"data_compressed":9478319,"data_compressed_allocated":12476416,"data_compressed_original":199622656,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:56:14.503 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:56:14.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:56:14.678+0000 7fc088e7d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:56:14.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:56:14.691+0000 7fc088e7d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:56:14.825 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 23 16 5126 5110 13.8846 13.125 0.0413232 0.0718994 2024-09-22T03:56:15.825 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 24 16 5345 5329 13.8764 13.6875 0.0631329 0.0719374 2024-09-22T03:56:16.825 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 25 16 5574 5558 13.8937 14.3125 0.0910577 0.0718761 2024-09-22T03:56:17.106 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:56:17.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:56:17.263+0000 7f85b6f08640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:56:17.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:56:17.274+0000 7f85b6f08640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:56:17.826 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 26 16 5790 5774 13.8786 13.5 0.0748377 0.0719286 2024-09-22T03:56:18.826 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 27 16 6007 5991 13.8668 13.5625 0.0856854 0.0719894 2024-09-22T03:56:19.269 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:56:19.269 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:56:19.269 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:56:19.269 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:56:19.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:56:19.438+0000 7f16b3191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:56:19.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:56:19.452+0000 7f16b3191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:56:19.499 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:56:19.499 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:56:19.499 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:56:19.499 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:56:19.499 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:56:19.499 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:56:19.500 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:56:19.500 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:56:19.500 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:56:19.500 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:56:19.500 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:56:19.500 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:56:19.503 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:56:19.503 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:56:19.504 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:56:19.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:56:19.679+0000 7f137667f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:56:19.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:56:19.693+0000 7f137667f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:56:19.725 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:56:19.725 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:56:19.725 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:56:19.725 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:56:19.725 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:56:19.725 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:56:19.725 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:56:19.725 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:56:19.725 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:56:19.726 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:56:19.726 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:56:19.726 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:56:19.729 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:56:19.729 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:56:19.729 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:56:19.826 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 28 16 6218 6202 13.8425 13.1875 0.0416118 0.0721059 2024-09-22T03:56:19.881 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:56:19.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:56:19.879+0000 7f8bf9446640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:56:19.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:56:19.904+0000 7f8bf9446640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:56:19.934 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:56:19.935 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:56:19.935 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:56:19.935 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:56:19.935 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:56:19.935 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:56:19.935 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:56:19.935 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:56:19.935 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:56:19.935 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:56:19.935 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:56:19.935 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:56:19.939 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:56:19.939 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:56:19.940 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:56:20.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:56:20.052+0000 7fe92bd51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:56:20.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:56:20.064+0000 7fe92bd51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:56:20.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:56:20.135+0000 7f062e591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:56:20.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:56:20.150+0000 7f062e591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:56:20.195 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:56:20.195 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:56:20.195 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:56:20.195 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:56:20.196 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:56:20.196 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:56:20.196 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:56:20.196 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:56:20.196 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:56:20.196 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:56:20.196 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:56:20.196 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:56:20.200 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:56:20.201 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:56:20.826 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 29 16 6412 6396 13.7832 12.125 0.0918459 0.0724592 2024-09-22T03:56:21.826 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 30 16 6640 6624 13.7987 14.25 0.0503442 0.0723971 2024-09-22T03:56:22.441 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:56:22.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:56:22.624+0000 7f5062846640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:56:22.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:56:22.636+0000 7f5062846640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:56:22.826 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 31 16 6852 6836 13.781 13.25 0.109309 0.0724588 2024-09-22T03:56:23.826 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 32 16 7065 7049 13.7663 13.3125 0.0501261 0.0725282 2024-09-22T03:56:24.826 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 33 16 7292 7276 13.7791 14.1875 0.0561201 0.0725135 2024-09-22T03:56:25.190 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:56:25.201 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:56:25.201 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:56:25.201 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:56:25.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:56:25.343+0000 7f6197674640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:56:25.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:56:25.354+0000 7f6197674640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:56:25.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:56:25.413+0000 7fb16d911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:56:25.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:56:25.427+0000 7fb16d911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:56:25.753 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:56:25.753 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-22T03:56:25.781 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":263,"stamp":"2024-09-22T03:56:25.055266+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":414908979,"num_objects":6326,"num_object_clones":0,"num_object_copies":18978,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":6403,"num_write_kb":405716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6377,"ondisk_log_size":6377,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":384416,"kb_used_data":77216,"kb_used_omap":0,"kb_used_meta":307136,"kb_avail":377102944,"statfs":{"total":386547056640,"available":386153414656,"internally_reserved":0,"allocated":79069184,"data_stored":1236313037,"data_compressed":58679574,"data_compressed_allocated":77242368,"data_compressed_original":1235632128,"omap_allocated":0,"internal_metadata":314507264},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":142147584,"num_objects":2169,"num_object_clones":0,"num_object_copies":6507,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2169,"num_write_kb":138816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002587"},"pg_stats":[{"pgid":"5.f","version":"52'409","reported_seq":421,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:56:20.862831+0000","last_change":"2024-09-22T03:55:50.938932+0000","last_active":"2024-09-22T03:56:20.862831+0000","last_peered":"2024-09-22T03:56:20.862831+0000","last_clean":"2024-09-22T03:56:20.862831+0000","last_became_active":"2024-09-22T03:55:50.929290+0000","last_became_peered":"2024-09-22T03:55:50.929290+0000","last_unstale":"2024-09-22T03:56:20.862831+0000","last_undegraded":"2024-09-22T03:56:20.862831+0000","last_fullsized":"2024-09-22T03:56:20.862831+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26804224,"num_objects":409,"num_object_clones":0,"num_object_copies":1227,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":409,"num_write_kb":26176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"52'388","reported_seq":400,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:56:19.839142+0000","last_change":"2024-09-22T03:55:50.848180+0000","last_active":"2024-09-22T03:56:19.839142+0000","last_peered":"2024-09-22T03:56:19.839142+0000","last_clean":"2024-09-22T03:56:19.839142+0000","last_became_active":"2024-09-22T03:55:50.838302+0000","last_became_peered":"2024-09-22T03:55:50.838302+0000","last_unstale":"2024-09-22T03:56:19.839142+0000","last_undegraded":"2024-09-22T03:56:19.839142+0000","last_fullsized":"2024-09-22T03:56:19.839142+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25427968,"num_objects":388,"num_object_clones":0,"num_object_copies":1164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":388,"num_write_kb":24832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"52'421","reported_seq":433,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:56:19.779642+0000","last_change":"2024-09-22T03:55:50.872362+0000","last_active":"2024-09-22T03:56:19.779642+0000","last_peered":"2024-09-22T03:56:19.779642+0000","last_clean":"2024-09-22T03:56:19.779642+0000","last_became_active":"2024-09-22T03:55:50.867322+0000","last_became_peered":"2024-09-22T03:55:50.867322+0000","last_unstale":"2024-09-22T03:56:19.779642+0000","last_undegraded":"2024-09-22T03:56:19.779642+0000","last_fullsized":"2024-09-22T03:56:19.779642+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27590656,"num_objects":421,"num_object_clones":0,"num_object_copies":1263,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":421,"num_write_kb":26944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"52'422","reported_seq":434,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:56:20.925805+0000","last_change":"2024-09-22T03:55:50.942624+0000","last_active":"2024-09-22T03:56:20.925805+0000","last_peered":"2024-09-22T03:56:20.925805+0000","last_clean":"2024-09-22T03:56:20.925805+0000","last_became_active":"2024-09-22T03:55:50.922812+0000","last_became_peered":"2024-09-22T03:55:50.922812+0000","last_unstale":"2024-09-22T03:56:20.925805+0000","last_undegraded":"2024-09-22T03:56:20.925805+0000","last_fullsized":"2024-09-22T03:56:20.925805+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27656192,"num_objects":422,"num_object_clones":0,"num_object_copies":1266,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":422,"num_write_kb":27008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"52'379","reported_seq":391,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:56:19.872668+0000","last_change":"2024-09-22T03:55:50.890353+0000","last_active":"2024-09-22T03:56:19.872668+0000","last_peered":"2024-09-22T03:56:19.872668+0000","last_clean":"2024-09-22T03:56:19.872668+0000","last_became_active":"2024-09-22T03:55:50.882633+0000","last_became_peered":"2024-09-22T03:55:50.882633+0000","last_unstale":"2024-09-22T03:56:19.872668+0000","last_undegraded":"2024-09-22T03:56:19.872668+0000","last_fullsized":"2024-09-22T03:56:19.872668+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24838144,"num_objects":379,"num_object_clones":0,"num_object_copies":1137,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":379,"num_write_kb":24256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.a","version":"52'394","reported_seq":406,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:56:19.960301+0000","last_change":"2024-09-22T03:55:50.891052+0000","last_active":"2024-09-22T03:56:19.960301+0000","last_peered":"2024-09-22T03:56:19.960301+0000","last_clean":"2024-09-22T03:56:19.960301+0000","last_became_active":"2024-09-22T03:55:50.880295+0000","last_became_peered":"2024-09-22T03:55:50.880295+0000","last_unstale":"2024-09-22T03:56:19.960301+0000","last_undegraded":"2024-09-22T03:56:19.960301+0000","last_fullsized":"2024-09-22T03:56:19.960301+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25821184,"num_objects":394,"num_object_clones":0,"num_object_copies":1182,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":394,"num_write_kb":25216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"52'385","reported_seq":397,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:56:19.966233+0000","last_change":"2024-09-22T03:55:50.906894+0000","last_active":"2024-09-22T03:56:19.966233+0000","last_peered":"2024-09-22T03:56:19.966233+0000","last_clean":"2024-09-22T03:56:19.966233+0000","last_became_active":"2024-09-22T03:55:50.896899+0000","last_became_peered":"2024-09-22T03:55:50.896899+0000","last_unstale":"2024-09-22T03:56:19.966233+0000","last_undegraded":"2024-09-22T03:56:19.966233+0000","last_fullsized":"2024-09-22T03:56:19.966233+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25231360,"num_objects":385,"num_object_clones":0,"num_object_copies":1155,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":385,"num_write_kb":24640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"52'400","reported_seq":412,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:56:20.040745+0000","last_change":"2024-09-22T03:55:50.859578+0000","last_active":"2024-09-22T03:56:20.040745+0000","last_peered":"2024-09-22T03:56:20.040745+0000","last_clean":"2024-09-22T03:56:20.040745+0000","last_became_active":"2024-09-22T03:55:50.843710+0000","last_became_peered":"2024-09-22T03:55:50.843710+0000","last_unstale":"2024-09-22T03:56:20.040745+0000","last_undegraded":"2024-09-22T03:56:20.040745+0000","last_fullsized":"2024-09-22T03:56:20.040745+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26214400,"num_objects":400,"num_object_clones":0,"num_object_copies":1200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":25600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"52'389","reported_seq":401,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:56:19.896004+0000","last_change":"2024-09-22T03:55:50.968411+0000","last_active":"2024-09-22T03:56:19.896004+0000","last_peered":"2024-09-22T03:56:19.896004+0000","last_clean":"2024-09-22T03:56:19.896004+0000","last_became_active":"2024-09-22T03:55:50.961718+0000","last_became_peered":"2024-09-22T03:55:50.961718+0000","last_unstale":"2024-09-22T03:56:19.896004+0000","last_undegraded":"2024-09-22T03:56:19.896004+0000","last_fullsized":"2024-09-22T03:56:19.896004+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25493504,"num_objects":389,"num_object_clones":0,"num_object_copies":1167,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":389,"num_write_kb":24896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":199,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:51.749469+0000","last_change":"2024-09-22T03:49:12.034704+0000","last_active":"2024-09-22T03:55:51.749469+0000","last_peered":"2024-09-22T03:55:51.749469+0000","last_clean":"2024-09-22T03:55:51.749469+0000","last_became_active":"2024-09-22T03:49:12.027470+0000","last_became_peered":"2024-09-22T03:49:12.027470+0000","last_unstale":"2024-09-22T03:55:51.749469+0000","last_undegraded":"2024-09-22T03:55:51.749469+0000","last_fullsized":"2024-09-22T03:55:51.749469+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_clean_scrub_stamp":"2024-09-22T03:49:10.979949+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":125,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:51.750162+0000","last_change":"2024-09-22T03:49:17.031458+0000","last_active":"2024-09-22T03:55:51.750162+0000","last_peered":"2024-09-22T03:55:51.750162+0000","last_clean":"2024-09-22T03:55:51.750162+0000","last_became_active":"2024-09-22T03:49:15.125490+0000","last_became_peered":"2024-09-22T03:49:15.125490+0000","last_unstale":"2024-09-22T03:55:51.750162+0000","last_undegraded":"2024-09-22T03:55:51.750162+0000","last_fullsized":"2024-09-22T03:55:51.750162+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.7","version":"52'392","reported_seq":404,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:56:19.773766+0000","last_change":"2024-09-22T03:55:50.910597+0000","last_active":"2024-09-22T03:56:19.773766+0000","last_peered":"2024-09-22T03:56:19.773766+0000","last_clean":"2024-09-22T03:56:19.773766+0000","last_became_active":"2024-09-22T03:55:50.901290+0000","last_became_peered":"2024-09-22T03:55:50.901290+0000","last_unstale":"2024-09-22T03:56:19.773766+0000","last_undegraded":"2024-09-22T03:56:19.773766+0000","last_fullsized":"2024-09-22T03:56:19.773766+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25690112,"num_objects":392,"num_object_clones":0,"num_object_copies":1176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":392,"num_write_kb":25088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":124,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:51.742303+0000","last_change":"2024-09-22T03:49:17.029339+0000","last_active":"2024-09-22T03:55:51.742303+0000","last_peered":"2024-09-22T03:55:51.742303+0000","last_clean":"2024-09-22T03:55:51.742303+0000","last_became_active":"2024-09-22T03:49:15.097304+0000","last_became_peered":"2024-09-22T03:49:15.097304+0000","last_unstale":"2024-09-22T03:55:51.742303+0000","last_undegraded":"2024-09-22T03:55:51.742303+0000","last_fullsized":"2024-09-22T03:55:51.742303+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"52'419","reported_seq":431,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:56:21.152195+0000","last_change":"2024-09-22T03:55:50.918358+0000","last_active":"2024-09-22T03:56:21.152195+0000","last_peered":"2024-09-22T03:56:21.152195+0000","last_clean":"2024-09-22T03:56:21.152195+0000","last_became_active":"2024-09-22T03:55:50.889906+0000","last_became_peered":"2024-09-22T03:55:50.889906+0000","last_unstale":"2024-09-22T03:56:21.152195+0000","last_undegraded":"2024-09-22T03:56:21.152195+0000","last_fullsized":"2024-09-22T03:56:21.152195+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27459584,"num_objects":419,"num_object_clones":0,"num_object_copies":1257,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":419,"num_write_kb":26816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":124,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:51.751861+0000","last_change":"2024-09-22T03:49:17.029349+0000","last_active":"2024-09-22T03:55:51.751861+0000","last_peered":"2024-09-22T03:55:51.751861+0000","last_clean":"2024-09-22T03:55:51.751861+0000","last_became_active":"2024-09-22T03:49:15.094890+0000","last_became_peered":"2024-09-22T03:49:15.094890+0000","last_unstale":"2024-09-22T03:55:51.751861+0000","last_undegraded":"2024-09-22T03:55:51.751861+0000","last_fullsized":"2024-09-22T03:55:51.751861+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"52'409","reported_seq":421,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:56:19.881237+0000","last_change":"2024-09-22T03:55:50.939050+0000","last_active":"2024-09-22T03:56:19.881237+0000","last_peered":"2024-09-22T03:56:19.881237+0000","last_clean":"2024-09-22T03:56:19.881237+0000","last_became_active":"2024-09-22T03:55:50.929831+0000","last_became_peered":"2024-09-22T03:55:50.929831+0000","last_unstale":"2024-09-22T03:56:19.881237+0000","last_undegraded":"2024-09-22T03:56:19.881237+0000","last_fullsized":"2024-09-22T03:56:19.881237+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26804224,"num_objects":409,"num_object_clones":0,"num_object_copies":1227,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":409,"num_write_kb":26176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":126,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:51.749244+0000","last_change":"2024-09-22T03:49:17.031466+0000","last_active":"2024-09-22T03:55:51.749244+0000","last_peered":"2024-09-22T03:55:51.749244+0000","last_clean":"2024-09-22T03:55:51.749244+0000","last_became_active":"2024-09-22T03:49:15.098420+0000","last_became_peered":"2024-09-22T03:49:15.098420+0000","last_unstale":"2024-09-22T03:55:51.749244+0000","last_undegraded":"2024-09-22T03:55:51.749244+0000","last_fullsized":"2024-09-22T03:55:51.749244+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3","version":"52'370","reported_seq":382,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:56:20.081888+0000","last_change":"2024-09-22T03:55:50.862956+0000","last_active":"2024-09-22T03:56:20.081888+0000","last_peered":"2024-09-22T03:56:20.081888+0000","last_clean":"2024-09-22T03:56:20.081888+0000","last_became_active":"2024-09-22T03:55:50.854828+0000","last_became_peered":"2024-09-22T03:55:50.854828+0000","last_unstale":"2024-09-22T03:56:20.081888+0000","last_undegraded":"2024-09-22T03:56:20.081888+0000","last_fullsized":"2024-09-22T03:56:20.081888+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24248320,"num_objects":370,"num_object_clones":0,"num_object_copies":1110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":370,"num_write_kb":23680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":124,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:51.754967+0000","last_change":"2024-09-22T03:49:17.036954+0000","last_active":"2024-09-22T03:55:51.754967+0000","last_peered":"2024-09-22T03:55:51.754967+0000","last_clean":"2024-09-22T03:55:51.754967+0000","last_became_active":"2024-09-22T03:49:15.110506+0000","last_became_peered":"2024-09-22T03:49:15.110506+0000","last_unstale":"2024-09-22T03:55:51.754967+0000","last_undegraded":"2024-09-22T03:55:51.754967+0000","last_fullsized":"2024-09-22T03:55:51.754967+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"52'388","reported_seq":400,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:56:20.009005+0000","last_change":"2024-09-22T03:55:50.927264+0000","last_active":"2024-09-22T03:56:20.009005+0000","last_peered":"2024-09-22T03:56:20.009005+0000","last_clean":"2024-09-22T03:56:20.009005+0000","last_became_active":"2024-09-22T03:55:50.919600+0000","last_became_peered":"2024-09-22T03:55:50.919600+0000","last_unstale":"2024-09-22T03:56:20.009005+0000","last_undegraded":"2024-09-22T03:56:20.009005+0000","last_fullsized":"2024-09-22T03:56:20.009005+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25427968,"num_objects":388,"num_object_clones":0,"num_object_copies":1164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":388,"num_write_kb":24832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":124,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:51.747974+0000","last_change":"2024-09-22T03:49:17.032989+0000","last_active":"2024-09-22T03:55:51.747974+0000","last_peered":"2024-09-22T03:55:51.747974+0000","last_clean":"2024-09-22T03:55:51.747974+0000","last_became_active":"2024-09-22T03:49:15.079260+0000","last_became_peered":"2024-09-22T03:49:15.079260+0000","last_unstale":"2024-09-22T03:55:51.747974+0000","last_undegraded":"2024-09-22T03:55:51.747974+0000","last_fullsized":"2024-09-22T03:55:51.747974+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"52'391","reported_seq":403,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:56:21.082903+0000","last_change":"2024-09-22T03:55:50.862926+0000","last_active":"2024-09-22T03:56:21.082903+0000","last_peered":"2024-09-22T03:56:21.082903+0000","last_clean":"2024-09-22T03:56:21.082903+0000","last_became_active":"2024-09-22T03:55:50.851824+0000","last_became_peered":"2024-09-22T03:55:50.851824+0000","last_unstale":"2024-09-22T03:56:21.082903+0000","last_undegraded":"2024-09-22T03:56:21.082903+0000","last_fullsized":"2024-09-22T03:56:21.082903+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25624576,"num_objects":391,"num_object_clones":0,"num_object_copies":1173,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":391,"num_write_kb":25024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":124,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:51.758850+0000","last_change":"2024-09-22T03:49:17.036402+0000","last_active":"2024-09-22T03:55:51.758850+0000","last_peered":"2024-09-22T03:55:51.758850+0000","last_clean":"2024-09-22T03:55:51.758850+0000","last_became_active":"2024-09-22T03:49:15.108430+0000","last_became_peered":"2024-09-22T03:49:15.108430+0000","last_unstale":"2024-09-22T03:55:51.758850+0000","last_undegraded":"2024-09-22T03:55:51.758850+0000","last_fullsized":"2024-09-22T03:55:51.758850+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"52'366","reported_seq":378,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:56:19.909694+0000","last_change":"2024-09-22T03:55:50.878789+0000","last_active":"2024-09-22T03:56:19.909694+0000","last_peered":"2024-09-22T03:56:19.909694+0000","last_clean":"2024-09-22T03:56:19.909694+0000","last_became_active":"2024-09-22T03:55:50.852561+0000","last_became_peered":"2024-09-22T03:55:50.852561+0000","last_unstale":"2024-09-22T03:56:19.909694+0000","last_undegraded":"2024-09-22T03:56:19.909694+0000","last_fullsized":"2024-09-22T03:56:19.909694+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23986176,"num_objects":366,"num_object_clones":0,"num_object_copies":1098,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":366,"num_write_kb":23424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":124,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:51.744448+0000","last_change":"2024-09-22T03:49:17.029128+0000","last_active":"2024-09-22T03:55:51.744448+0000","last_peered":"2024-09-22T03:55:51.744448+0000","last_clean":"2024-09-22T03:55:51.744448+0000","last_became_active":"2024-09-22T03:49:15.113396+0000","last_became_peered":"2024-09-22T03:49:15.113396+0000","last_unstale":"2024-09-22T03:55:51.744448+0000","last_undegraded":"2024-09-22T03:55:51.744448+0000","last_fullsized":"2024-09-22T03:55:51.744448+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":414318592,"num_objects":6322,"num_object_clones":0,"num_object_copies":18966,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6322,"num_write_kb":404608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":77537280,"data_stored":1240596480,"data_compressed":58906830,"data_compressed_allocated":77537280,"data_compressed_original":1240596480,"omap_allocated":0,"internal_metadata":0},"log_size":6322,"ondisk_log_size":6322,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949673389,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":87880,"kb_used_data":16632,"kb_used_omap":0,"kb_used_meta":71232,"kb_avail":94283960,"statfs":{"total":96636764160,"available":96546775040,"internally_reserved":0,"allocated":17031168,"data_stored":265185664,"data_compressed":12586266,"data_compressed_allocated":16568320,"data_compressed_original":265011200,"omap_allocated":0,"internal_metadata":72941568},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654706093,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":108164,"kb_used_data":18868,"kb_used_omap":0,"kb_used_meta":89280,"kb_avail":94263676,"statfs":{"total":96636764160,"available":96526004224,"internally_reserved":0,"allocated":19320832,"data_stored":302212960,"data_compressed":14342375,"data_compressed_allocated":18878464,"data_compressed_original":302055424,"omap_allocated":0,"internal_metadata":91422720},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706093,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":90660,"kb_used_data":19412,"kb_used_omap":0,"kb_used_meta":71232,"kb_avail":94281180,"statfs":{"total":96636764160,"available":96543928320,"internally_reserved":0,"allocated":19877888,"data_stored":310733184,"data_compressed":14749005,"data_compressed_allocated":19415040,"data_compressed_original":310558720,"omap_allocated":0,"internal_metadata":72941568},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706093,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":97712,"kb_used_data":22304,"kb_used_omap":0,"kb_used_meta":75392,"kb_avail":94274128,"statfs":{"total":96636764160,"available":96536707072,"internally_reserved":0,"allocated":22839296,"data_stored":358181229,"data_compressed":17001928,"data_compressed_allocated":22380544,"data_compressed_original":358006784,"omap_allocated":0,"internal_metadata":77201408},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":22450176,"data_stored":359202816,"data_compressed":17055896,"data_compressed_allocated":22450176,"data_compressed_original":359202816,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16687104,"data_stored":266993664,"data_compressed":12677578,"data_compressed_allocated":16687104,"data_compressed_original":266993664,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":19398656,"data_stored":310378496,"data_compressed":14737621,"data_compressed_allocated":19398656,"data_compressed_original":310378496,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":19001344,"data_stored":304021504,"data_compressed":14435735,"data_compressed_allocated":19001344,"data_compressed_original":304021504,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:56:25.826 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 34 16 7481 7465 13.7212 11.8125 0.10163 0.0727721 2024-09-22T03:56:26.826 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 35 16 7703 7687 13.7255 13.875 0.105165 0.072753 2024-09-22T03:56:27.826 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 36 16 7928 7912 13.7349 14.0625 0.0518542 0.0727219 2024-09-22T03:56:28.082 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:56:28.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:56:28.262+0000 7fa194ef4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:56:28.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:56:28.272+0000 7fa194ef4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:56:28.826 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 37 16 8139 8123 13.72 13.1875 0.0892959 0.0728036 2024-09-22T03:56:29.827 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 38 16 8353 8337 13.7109 13.375 0.105593 0.0728452 2024-09-22T03:56:30.783 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:56:30.783 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:56:30.784 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:56:30.784 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:56:30.826 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 39 16 8556 8540 13.6847 12.6875 0.137876 0.0729585 2024-09-22T03:56:30.831 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:56:30.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:56:30.950+0000 7fc661cd1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:56:30.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:56:30.967+0000 7fc660a6f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:56:31.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:56:31.005+0000 7f653b46c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:56:31.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:56:31.016+0000 7f653b46c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:56:31.103 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:56:31.106 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:56:31.107 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:56:31.108 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:56:31.108 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:56:31.108 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:56:31.108 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:56:31.108 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:56:31.108 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:56:31.108 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:56:31.108 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:56:31.108 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:56:31.109 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:56:31.109 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:56:31.109 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:56:31.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:56:31.281+0000 7fcc25711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:56:31.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:56:31.298+0000 7fcc25711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:56:31.332 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:56:31.332 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:56:31.332 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:56:31.332 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:56:31.333 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:56:31.333 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:56:31.333 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:56:31.333 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:56:31.333 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:56:31.333 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:56:31.333 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:56:31.333 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:56:31.338 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:56:31.338 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:56:31.338 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:56:31.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:56:31.507+0000 7f1425711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:56:31.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:56:31.525+0000 7f1425711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:56:31.559 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:56:31.559 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:56:31.559 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:56:31.559 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:56:31.560 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:56:31.560 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:56:31.560 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:56:31.560 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:56:31.560 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:56:31.560 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:56:31.560 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:56:31.560 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:56:31.564 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:56:31.564 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:56:31.565 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:56:31.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:56:31.779+0000 7f11d90fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:56:31.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:56:31.795+0000 7f11d90fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:56:31.827 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:2024-09-22T03:56:31.826686+0000 min lat: 0.0157147 max lat: 0.204046 avg lat: 0.0732712 2024-09-22T03:56:31.827 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-22T03:56:31.827 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 40 16 8742 8726 13.6331 11.625 0.139594 0.0732712 2024-09-22T03:56:31.853 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:56:31.853 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:56:31.854 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:56:31.854 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:56:31.854 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:56:31.854 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:56:31.854 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:56:31.854 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:56:31.854 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:56:31.854 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:56:31.854 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:56:31.854 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:56:31.858 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:56:31.859 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:56:32.827 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 41 16 8943 8927 13.607 12.5625 0.089791 0.07341 2024-09-22T03:56:33.508 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:56:33.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:56:33.674+0000 7f9ca0288640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:56:33.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:56:33.685+0000 7f9ca0288640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:56:33.827 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 42 16 9156 9140 13.6 13.3125 0.0652248 0.0734629 2024-09-22T03:56:34.827 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 43 16 9349 9333 13.5642 12.0625 0.116221 0.0736301 2024-09-22T03:56:35.827 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 44 16 9547 9531 13.5371 12.375 0.0474612 0.0737782 2024-09-22T03:56:36.207 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:56:36.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:56:36.392+0000 7f98b4b11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:56:36.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:56:36.407+0000 7f98b4b11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:56:36.827 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 45 16 9751 9735 13.5196 12.75 0.0399045 0.073891 2024-09-22T03:56:36.859 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:56:36.859 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:56:36.859 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:56:36.860 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:56:37.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:56:37.029+0000 7fe9d0991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:56:37.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:56:37.042+0000 7fe9d0991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:56:37.091 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:56:37.091 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:56:37.091 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:56:37.091 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:56:37.091 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:56:37.091 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:56:37.091 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:56:37.092 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:56:37.092 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:56:37.092 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:56:37.092 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:56:37.092 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:56:37.096 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:56:37.097 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:56:37.097 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:56:37.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:56:37.253+0000 7f7f02591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:56:37.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:56:37.269+0000 7f7f02591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:56:37.420 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:56:37.421 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:56:37.421 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:56:37.421 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:56:37.421 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:56:37.421 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:56:37.421 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:56:37.421 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:56:37.421 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:56:37.421 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:56:37.421 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:56:37.421 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:56:37.425 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:56:37.425 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:56:37.425 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:56:37.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:56:37.584+0000 7f0e2ff48640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:56:37.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:56:37.603+0000 7f0e2ff48640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:56:37.676 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:56:37.676 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:56:37.676 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:56:37.676 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:56:37.676 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:56:37.676 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:56:37.676 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:56:37.677 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:56:37.677 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:56:37.677 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:56:37.677 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:56:37.677 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:56:37.682 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:56:37.683 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:56:37.683 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:56:37.828 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 46 16 9945 9929 13.489 12.125 0.0817049 0.0740582 2024-09-22T03:56:37.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:56:37.840+0000 7fbf6b591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:56:37.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:56:37.854+0000 7fbf6b591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:56:37.917 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:56:37.918 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:56:37.918 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:56:37.918 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:56:37.918 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:56:37.918 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:56:37.918 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:56:37.918 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:56:37.918 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:56:37.918 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:56:37.918 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:56:37.918 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:56:37.923 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:56:37.923 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:56:38.828 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 47 16 10146 10130 13.4693 12.5625 0.0963569 0.074185 2024-09-22T03:56:38.829 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:56:38.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:56:38.973+0000 7f3e38991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:56:38.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:56:38.986+0000 7f3e38991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:56:39.828 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 48 16 10339 10323 13.44 12.0625 0.104012 0.0743445 2024-09-22T03:56:40.828 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 49 16 10546 10530 13.4297 12.9375 0.0441131 0.0743976 2024-09-22T03:56:41.536 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:56:41.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:56:41.706+0000 7fd57f791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:56:41.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:56:41.717+0000 7fd57f791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:56:41.828 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 50 16 10753 10737 13.4198 12.9375 0.101339 0.0744544 2024-09-22T03:56:42.828 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 51 16 10953 10937 13.4017 12.5 0.0865022 0.074568 2024-09-22T03:56:42.924 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:56:42.924 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:56:42.924 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:56:42.925 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:56:43.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:56:43.095+0000 7f4208d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:56:43.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:56:43.109+0000 7f4208d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:56:43.255 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:56:43.255 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:56:43.255 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:56:43.256 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:56:43.256 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:56:43.256 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:56:43.256 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:56:43.256 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:56:43.256 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:56:43.256 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:56:43.256 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:56:43.256 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:56:43.260 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:56:43.260 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:56:43.260 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:56:43.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:56:43.424+0000 7fe92af91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:56:43.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:56:43.437+0000 7fe92af91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:56:43.483 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:56:43.483 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:56:43.483 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:56:43.483 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:56:43.483 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:56:43.483 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:56:43.483 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:56:43.483 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:56:43.483 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:56:43.483 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:56:43.483 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:56:43.484 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:56:43.486 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:56:43.487 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:56:43.487 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:56:43.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:56:43.666+0000 7ff331951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:56:43.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:56:43.683+0000 7ff331951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:56:43.718 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:56:43.719 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:56:43.719 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:56:43.719 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:56:43.719 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:56:43.719 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:56:43.719 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:56:43.719 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:56:43.719 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:56:43.719 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:56:43.719 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:56:43.719 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:56:43.724 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:56:43.724 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:56:43.724 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:56:43.829 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 52 16 11153 11137 13.3844 12.5 0.0536696 0.0746454 2024-09-22T03:56:43.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:56:43.868+0000 7f3190d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:56:43.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:56:43.889+0000 7f3190d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:56:43.988 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:56:43.988 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:56:43.988 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:56:43.988 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:56:43.988 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:56:43.988 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:56:43.988 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:56:43.989 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:56:43.989 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:56:43.989 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:56:43.989 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:56:43.989 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:56:43.991 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:56:43.992 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:56:44.293 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:56:44.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:56:44.459+0000 7f8d96991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:56:44.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:56:44.471+0000 7f8d96991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:56:44.829 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 53 16 11352 11336 13.3665 12.4375 0.0925097 0.0747375 2024-09-22T03:56:45.829 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 54 16 11560 11544 13.3597 13 0.0715476 0.0748025 2024-09-22T03:56:46.829 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 55 16 11769 11753 13.3543 13.0625 0.082468 0.0748212 2024-09-22T03:56:46.965 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:56:47.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:56:47.130+0000 7f737c86c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:56:47.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:56:47.142+0000 7f737c86c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:56:47.829 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 56 16 11963 11947 13.3323 12.125 0.0937399 0.0749549 2024-09-22T03:56:48.829 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 57 16 12169 12153 13.3242 12.875 0.0543487 0.075 2024-09-22T03:56:48.992 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:56:48.992 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:56:48.992 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:56:48.993 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:56:49.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:56:49.154+0000 7f6a7f311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:56:49.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:56:49.172+0000 7f6a7f311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:56:49.336 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:56:49.336 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:56:49.336 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:56:49.336 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:56:49.337 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:56:49.337 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:56:49.337 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:56:49.337 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:56:49.337 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:56:49.337 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:56:49.337 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:56:49.337 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:56:49.339 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:56:49.340 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:56:49.340 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:56:49.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:56:49.509+0000 7fc1ed25c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:56:49.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:56:49.522+0000 7fc1ed25c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:56:49.528 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:56:49.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:56:49.681+0000 7f9f84857640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:56:49.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:56:49.693+0000 7f9f84857640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:56:49.713 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:56:49.713 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:56:49.713 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:56:49.713 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:56:49.713 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:56:49.713 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:56:49.713 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:56:49.713 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:56:49.713 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:56:49.713 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:56:49.713 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:56:49.713 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:56:49.718 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:56:49.718 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:56:49.719 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:56:49.829 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 58 16 12363 12347 13.3036 12.125 0.0394017 0.0750822 2024-09-22T03:56:49.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:56:49.893+0000 7f3dafb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:56:49.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:56:49.909+0000 7f3dafb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:56:49.980 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:56:49.980 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:56:49.981 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:56:49.981 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:56:49.981 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:56:49.981 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:56:49.981 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:56:49.981 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:56:49.981 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:56:49.981 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:56:49.981 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:56:49.981 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:56:49.985 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:56:49.985 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:56:49.986 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:56:50.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:56:50.160+0000 7f22cb591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:56:50.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:56:50.174+0000 7f22cb591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:56:50.383 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:56:50.383 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:56:50.383 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:56:50.383 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:56:50.383 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:56:50.383 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:56:50.383 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:56:50.383 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:56:50.383 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:56:50.383 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:56:50.384 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:56:50.384 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:56:50.387 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:56:50.388 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:56:50.829 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 59 16 12560 12544 13.2867 12.3125 0.0782048 0.0751911 2024-09-22T03:56:51.829 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:2024-09-22T03:56:51.829401+0000 min lat: 0.0157147 max lat: 0.204046 avg lat: 0.0752651 2024-09-22T03:56:51.829 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-22T03:56:51.830 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 60 15 12762 12747 13.2767 12.6875 0.109384 0.0752651 2024-09-22T03:56:52.370 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:56:52.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:56:52.544+0000 7f9daf2fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:56:52.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:56:52.557+0000 7f9dae09b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:56:52.829 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 61 16 12950 12934 13.2506 11.6875 0.0316208 0.0754022 2024-09-22T03:56:53.830 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 62 16 13148 13132 13.2365 12.375 0.0651083 0.0754925 2024-09-22T03:56:54.830 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 63 16 13358 13342 13.2347 13.125 0.0629249 0.0755075 2024-09-22T03:56:55.030 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:56:55.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:56:55.208+0000 7f3aea2c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:56:55.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:56:55.217+0000 7f3aea2c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:56:55.389 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:56:55.389 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:56:55.389 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:56:55.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:56:55.559+0000 7fd1f2f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:56:55.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:56:55.572+0000 7fd1f2f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:56:55.830 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 64 16 13542 13526 13.2076 11.5 0.0995676 0.0756749 2024-09-22T03:56:55.879 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:56:55.879 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-22T03:56:55.901 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":278,"stamp":"2024-09-22T03:56:55.062121+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":818086451,"num_objects":12478,"num_object_clones":0,"num_object_copies":37434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":12555,"num_write_kb":799444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12529,"ondisk_log_size":12529,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":504076,"kb_used_data":151052,"kb_used_omap":0,"kb_used_meta":352960,"kb_avail":376983284,"statfs":{"total":386547056640,"available":386030882816,"internally_reserved":0,"allocated":154677248,"data_stored":2446042061,"data_compressed":116123979,"data_compressed_allocated":152850432,"data_compressed_original":2445361152,"omap_allocated":0,"internal_metadata":361431040},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":132841472,"num_objects":2027,"num_object_clones":0,"num_object_copies":6081,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2027,"num_write_kb":129728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002798"},"pg_stats":[{"pgid":"5.f","version":"52'808","reported_seq":820,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:56:51.117267+0000","last_change":"2024-09-22T03:55:50.938932+0000","last_active":"2024-09-22T03:56:51.117267+0000","last_peered":"2024-09-22T03:56:51.117267+0000","last_clean":"2024-09-22T03:56:51.117267+0000","last_became_active":"2024-09-22T03:55:50.929290+0000","last_became_peered":"2024-09-22T03:55:50.929290+0000","last_unstale":"2024-09-22T03:56:51.117267+0000","last_undegraded":"2024-09-22T03:56:51.117267+0000","last_fullsized":"2024-09-22T03:56:51.117267+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":808,"log_dups_size":0,"ondisk_log_size":808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52953088,"num_objects":808,"num_object_clones":0,"num_object_copies":2424,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":808,"num_write_kb":51712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"52'770","reported_seq":782,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:56:49.936458+0000","last_change":"2024-09-22T03:55:50.848180+0000","last_active":"2024-09-22T03:56:49.936458+0000","last_peered":"2024-09-22T03:56:49.936458+0000","last_clean":"2024-09-22T03:56:49.936458+0000","last_became_active":"2024-09-22T03:55:50.838302+0000","last_became_peered":"2024-09-22T03:55:50.838302+0000","last_unstale":"2024-09-22T03:56:49.936458+0000","last_undegraded":"2024-09-22T03:56:49.936458+0000","last_fullsized":"2024-09-22T03:56:49.936458+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":770,"log_dups_size":0,"ondisk_log_size":770,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50462720,"num_objects":770,"num_object_clones":0,"num_object_copies":2310,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":770,"num_write_kb":49280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"52'809","reported_seq":821,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:56:50.071638+0000","last_change":"2024-09-22T03:55:50.872362+0000","last_active":"2024-09-22T03:56:50.071638+0000","last_peered":"2024-09-22T03:56:50.071638+0000","last_clean":"2024-09-22T03:56:50.071638+0000","last_became_active":"2024-09-22T03:55:50.867322+0000","last_became_peered":"2024-09-22T03:55:50.867322+0000","last_unstale":"2024-09-22T03:56:50.071638+0000","last_undegraded":"2024-09-22T03:56:50.071638+0000","last_fullsized":"2024-09-22T03:56:50.071638+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":809,"log_dups_size":0,"ondisk_log_size":809,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53018624,"num_objects":809,"num_object_clones":0,"num_object_copies":2427,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":809,"num_write_kb":51776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"52'795","reported_seq":807,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:56:50.966437+0000","last_change":"2024-09-22T03:55:50.942624+0000","last_active":"2024-09-22T03:56:50.966437+0000","last_peered":"2024-09-22T03:56:50.966437+0000","last_clean":"2024-09-22T03:56:50.966437+0000","last_became_active":"2024-09-22T03:55:50.922812+0000","last_became_peered":"2024-09-22T03:55:50.922812+0000","last_unstale":"2024-09-22T03:56:50.966437+0000","last_undegraded":"2024-09-22T03:56:50.966437+0000","last_fullsized":"2024-09-22T03:56:50.966437+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":795,"log_dups_size":0,"ondisk_log_size":795,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52101120,"num_objects":795,"num_object_clones":0,"num_object_copies":2385,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":795,"num_write_kb":50880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"52'768","reported_seq":780,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:56:49.857455+0000","last_change":"2024-09-22T03:55:50.890353+0000","last_active":"2024-09-22T03:56:49.857455+0000","last_peered":"2024-09-22T03:56:49.857455+0000","last_clean":"2024-09-22T03:56:49.857455+0000","last_became_active":"2024-09-22T03:55:50.882633+0000","last_became_peered":"2024-09-22T03:55:50.882633+0000","last_unstale":"2024-09-22T03:56:49.857455+0000","last_undegraded":"2024-09-22T03:56:49.857455+0000","last_fullsized":"2024-09-22T03:56:49.857455+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":768,"log_dups_size":0,"ondisk_log_size":768,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":768,"num_object_clones":0,"num_object_copies":2304,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":768,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.a","version":"52'783","reported_seq":795,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:56:49.988572+0000","last_change":"2024-09-22T03:55:50.891052+0000","last_active":"2024-09-22T03:56:49.988572+0000","last_peered":"2024-09-22T03:56:49.988572+0000","last_clean":"2024-09-22T03:56:49.988572+0000","last_became_active":"2024-09-22T03:55:50.880295+0000","last_became_peered":"2024-09-22T03:55:50.880295+0000","last_unstale":"2024-09-22T03:56:49.988572+0000","last_undegraded":"2024-09-22T03:56:49.988572+0000","last_fullsized":"2024-09-22T03:56:49.988572+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":783,"log_dups_size":0,"ondisk_log_size":783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51314688,"num_objects":783,"num_object_clones":0,"num_object_copies":2349,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":783,"num_write_kb":50112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"52'785","reported_seq":797,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:56:49.957593+0000","last_change":"2024-09-22T03:55:50.906894+0000","last_active":"2024-09-22T03:56:49.957593+0000","last_peered":"2024-09-22T03:56:49.957593+0000","last_clean":"2024-09-22T03:56:49.957593+0000","last_became_active":"2024-09-22T03:55:50.896899+0000","last_became_peered":"2024-09-22T03:55:50.896899+0000","last_unstale":"2024-09-22T03:56:49.957593+0000","last_undegraded":"2024-09-22T03:56:49.957593+0000","last_fullsized":"2024-09-22T03:56:49.957593+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":785,"log_dups_size":0,"ondisk_log_size":785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51445760,"num_objects":785,"num_object_clones":0,"num_object_copies":2355,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":785,"num_write_kb":50240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"52'759","reported_seq":771,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:56:49.918979+0000","last_change":"2024-09-22T03:55:50.859578+0000","last_active":"2024-09-22T03:56:49.918979+0000","last_peered":"2024-09-22T03:56:49.918979+0000","last_clean":"2024-09-22T03:56:49.918979+0000","last_became_active":"2024-09-22T03:55:50.843710+0000","last_became_peered":"2024-09-22T03:55:50.843710+0000","last_unstale":"2024-09-22T03:56:49.918979+0000","last_undegraded":"2024-09-22T03:56:49.918979+0000","last_fullsized":"2024-09-22T03:56:49.918979+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":759,"log_dups_size":0,"ondisk_log_size":759,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49741824,"num_objects":759,"num_object_clones":0,"num_object_copies":2277,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":759,"num_write_kb":48576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"52'804","reported_seq":816,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:56:50.070895+0000","last_change":"2024-09-22T03:55:50.968411+0000","last_active":"2024-09-22T03:56:50.070895+0000","last_peered":"2024-09-22T03:56:50.070895+0000","last_clean":"2024-09-22T03:56:50.070895+0000","last_became_active":"2024-09-22T03:55:50.961718+0000","last_became_peered":"2024-09-22T03:55:50.961718+0000","last_unstale":"2024-09-22T03:56:50.070895+0000","last_undegraded":"2024-09-22T03:56:50.070895+0000","last_fullsized":"2024-09-22T03:56:50.070895+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":804,"log_dups_size":0,"ondisk_log_size":804,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52690944,"num_objects":804,"num_object_clones":0,"num_object_copies":2412,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":804,"num_write_kb":51456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":199,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:51.749469+0000","last_change":"2024-09-22T03:49:12.034704+0000","last_active":"2024-09-22T03:55:51.749469+0000","last_peered":"2024-09-22T03:55:51.749469+0000","last_clean":"2024-09-22T03:55:51.749469+0000","last_became_active":"2024-09-22T03:49:12.027470+0000","last_became_peered":"2024-09-22T03:49:12.027470+0000","last_unstale":"2024-09-22T03:55:51.749469+0000","last_undegraded":"2024-09-22T03:55:51.749469+0000","last_fullsized":"2024-09-22T03:55:51.749469+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_clean_scrub_stamp":"2024-09-22T03:49:10.979949+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":125,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:51.750162+0000","last_change":"2024-09-22T03:49:17.031458+0000","last_active":"2024-09-22T03:55:51.750162+0000","last_peered":"2024-09-22T03:55:51.750162+0000","last_clean":"2024-09-22T03:55:51.750162+0000","last_became_active":"2024-09-22T03:49:15.125490+0000","last_became_peered":"2024-09-22T03:49:15.125490+0000","last_unstale":"2024-09-22T03:55:51.750162+0000","last_undegraded":"2024-09-22T03:55:51.750162+0000","last_fullsized":"2024-09-22T03:55:51.750162+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.7","version":"52'797","reported_seq":809,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:56:50.018513+0000","last_change":"2024-09-22T03:55:50.910597+0000","last_active":"2024-09-22T03:56:50.018513+0000","last_peered":"2024-09-22T03:56:50.018513+0000","last_clean":"2024-09-22T03:56:50.018513+0000","last_became_active":"2024-09-22T03:55:50.901290+0000","last_became_peered":"2024-09-22T03:55:50.901290+0000","last_unstale":"2024-09-22T03:56:50.018513+0000","last_undegraded":"2024-09-22T03:56:50.018513+0000","last_fullsized":"2024-09-22T03:56:50.018513+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":797,"log_dups_size":0,"ondisk_log_size":797,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52232192,"num_objects":797,"num_object_clones":0,"num_object_copies":2391,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":797,"num_write_kb":51008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":124,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:51.742303+0000","last_change":"2024-09-22T03:49:17.029339+0000","last_active":"2024-09-22T03:55:51.742303+0000","last_peered":"2024-09-22T03:55:51.742303+0000","last_clean":"2024-09-22T03:55:51.742303+0000","last_became_active":"2024-09-22T03:49:15.097304+0000","last_became_peered":"2024-09-22T03:49:15.097304+0000","last_unstale":"2024-09-22T03:55:51.742303+0000","last_undegraded":"2024-09-22T03:55:51.742303+0000","last_fullsized":"2024-09-22T03:55:51.742303+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"52'776","reported_seq":788,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:56:51.189337+0000","last_change":"2024-09-22T03:55:50.918358+0000","last_active":"2024-09-22T03:56:51.189337+0000","last_peered":"2024-09-22T03:56:51.189337+0000","last_clean":"2024-09-22T03:56:51.189337+0000","last_became_active":"2024-09-22T03:55:50.889906+0000","last_became_peered":"2024-09-22T03:55:50.889906+0000","last_unstale":"2024-09-22T03:56:51.189337+0000","last_undegraded":"2024-09-22T03:56:51.189337+0000","last_fullsized":"2024-09-22T03:56:51.189337+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":776,"log_dups_size":0,"ondisk_log_size":776,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50855936,"num_objects":776,"num_object_clones":0,"num_object_copies":2328,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":776,"num_write_kb":49664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":124,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:51.751861+0000","last_change":"2024-09-22T03:49:17.029349+0000","last_active":"2024-09-22T03:55:51.751861+0000","last_peered":"2024-09-22T03:55:51.751861+0000","last_clean":"2024-09-22T03:55:51.751861+0000","last_became_active":"2024-09-22T03:49:15.094890+0000","last_became_peered":"2024-09-22T03:49:15.094890+0000","last_unstale":"2024-09-22T03:55:51.751861+0000","last_undegraded":"2024-09-22T03:55:51.751861+0000","last_fullsized":"2024-09-22T03:55:51.751861+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"52'777","reported_seq":789,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:56:49.870460+0000","last_change":"2024-09-22T03:55:50.939050+0000","last_active":"2024-09-22T03:56:49.870460+0000","last_peered":"2024-09-22T03:56:49.870460+0000","last_clean":"2024-09-22T03:56:49.870460+0000","last_became_active":"2024-09-22T03:55:50.929831+0000","last_became_peered":"2024-09-22T03:55:50.929831+0000","last_unstale":"2024-09-22T03:56:49.870460+0000","last_undegraded":"2024-09-22T03:56:49.870460+0000","last_fullsized":"2024-09-22T03:56:49.870460+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":777,"log_dups_size":0,"ondisk_log_size":777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50921472,"num_objects":777,"num_object_clones":0,"num_object_copies":2331,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":777,"num_write_kb":49728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":126,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:51.749244+0000","last_change":"2024-09-22T03:49:17.031466+0000","last_active":"2024-09-22T03:55:51.749244+0000","last_peered":"2024-09-22T03:55:51.749244+0000","last_clean":"2024-09-22T03:55:51.749244+0000","last_became_active":"2024-09-22T03:49:15.098420+0000","last_became_peered":"2024-09-22T03:49:15.098420+0000","last_unstale":"2024-09-22T03:55:51.749244+0000","last_undegraded":"2024-09-22T03:55:51.749244+0000","last_fullsized":"2024-09-22T03:55:51.749244+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3","version":"52'746","reported_seq":758,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:56:50.121896+0000","last_change":"2024-09-22T03:55:50.862956+0000","last_active":"2024-09-22T03:56:50.121896+0000","last_peered":"2024-09-22T03:56:50.121896+0000","last_clean":"2024-09-22T03:56:50.121896+0000","last_became_active":"2024-09-22T03:55:50.854828+0000","last_became_peered":"2024-09-22T03:55:50.854828+0000","last_unstale":"2024-09-22T03:56:50.121896+0000","last_undegraded":"2024-09-22T03:56:50.121896+0000","last_fullsized":"2024-09-22T03:56:50.121896+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":746,"log_dups_size":0,"ondisk_log_size":746,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48889856,"num_objects":746,"num_object_clones":0,"num_object_copies":2238,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":746,"num_write_kb":47744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":124,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:51.754967+0000","last_change":"2024-09-22T03:49:17.036954+0000","last_active":"2024-09-22T03:55:51.754967+0000","last_peered":"2024-09-22T03:55:51.754967+0000","last_clean":"2024-09-22T03:55:51.754967+0000","last_became_active":"2024-09-22T03:49:15.110506+0000","last_became_peered":"2024-09-22T03:49:15.110506+0000","last_unstale":"2024-09-22T03:55:51.754967+0000","last_undegraded":"2024-09-22T03:55:51.754967+0000","last_fullsized":"2024-09-22T03:55:51.754967+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"52'752","reported_seq":764,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:56:50.039230+0000","last_change":"2024-09-22T03:55:50.927264+0000","last_active":"2024-09-22T03:56:50.039230+0000","last_peered":"2024-09-22T03:56:50.039230+0000","last_clean":"2024-09-22T03:56:50.039230+0000","last_became_active":"2024-09-22T03:55:50.919600+0000","last_became_peered":"2024-09-22T03:55:50.919600+0000","last_unstale":"2024-09-22T03:56:50.039230+0000","last_undegraded":"2024-09-22T03:56:50.039230+0000","last_fullsized":"2024-09-22T03:56:50.039230+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":752,"log_dups_size":0,"ondisk_log_size":752,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49283072,"num_objects":752,"num_object_clones":0,"num_object_copies":2256,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":752,"num_write_kb":48128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":124,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:51.747974+0000","last_change":"2024-09-22T03:49:17.032989+0000","last_active":"2024-09-22T03:55:51.747974+0000","last_peered":"2024-09-22T03:55:51.747974+0000","last_clean":"2024-09-22T03:55:51.747974+0000","last_became_active":"2024-09-22T03:49:15.079260+0000","last_became_peered":"2024-09-22T03:49:15.079260+0000","last_unstale":"2024-09-22T03:55:51.747974+0000","last_undegraded":"2024-09-22T03:55:51.747974+0000","last_fullsized":"2024-09-22T03:55:51.747974+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"52'784","reported_seq":796,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:56:51.004036+0000","last_change":"2024-09-22T03:55:50.862926+0000","last_active":"2024-09-22T03:56:51.004036+0000","last_peered":"2024-09-22T03:56:51.004036+0000","last_clean":"2024-09-22T03:56:51.004036+0000","last_became_active":"2024-09-22T03:55:50.851824+0000","last_became_peered":"2024-09-22T03:55:50.851824+0000","last_unstale":"2024-09-22T03:56:51.004036+0000","last_undegraded":"2024-09-22T03:56:51.004036+0000","last_fullsized":"2024-09-22T03:56:51.004036+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":784,"log_dups_size":0,"ondisk_log_size":784,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51380224,"num_objects":784,"num_object_clones":0,"num_object_copies":2352,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":784,"num_write_kb":50176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":124,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:51.758850+0000","last_change":"2024-09-22T03:49:17.036402+0000","last_active":"2024-09-22T03:55:51.758850+0000","last_peered":"2024-09-22T03:55:51.758850+0000","last_clean":"2024-09-22T03:55:51.758850+0000","last_became_active":"2024-09-22T03:49:15.108430+0000","last_became_peered":"2024-09-22T03:49:15.108430+0000","last_unstale":"2024-09-22T03:55:51.758850+0000","last_undegraded":"2024-09-22T03:55:51.758850+0000","last_fullsized":"2024-09-22T03:55:51.758850+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"52'761","reported_seq":773,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:56:49.881122+0000","last_change":"2024-09-22T03:55:50.878789+0000","last_active":"2024-09-22T03:56:49.881122+0000","last_peered":"2024-09-22T03:56:49.881122+0000","last_clean":"2024-09-22T03:56:49.881122+0000","last_became_active":"2024-09-22T03:55:50.852561+0000","last_became_peered":"2024-09-22T03:55:50.852561+0000","last_unstale":"2024-09-22T03:56:49.881122+0000","last_undegraded":"2024-09-22T03:56:49.881122+0000","last_fullsized":"2024-09-22T03:56:49.881122+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":761,"log_dups_size":0,"ondisk_log_size":761,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49872896,"num_objects":761,"num_object_clones":0,"num_object_copies":2283,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":761,"num_write_kb":48704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":124,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:51.744448+0000","last_change":"2024-09-22T03:49:17.029128+0000","last_active":"2024-09-22T03:55:51.744448+0000","last_peered":"2024-09-22T03:55:51.744448+0000","last_clean":"2024-09-22T03:55:51.744448+0000","last_became_active":"2024-09-22T03:49:15.113396+0000","last_became_peered":"2024-09-22T03:49:15.113396+0000","last_unstale":"2024-09-22T03:55:51.744448+0000","last_undegraded":"2024-09-22T03:55:51.744448+0000","last_fullsized":"2024-09-22T03:55:51.744448+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":817496064,"num_objects":12474,"num_object_clones":0,"num_object_copies":37422,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12474,"num_write_kb":798336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":153047040,"data_stored":2448752640,"data_compressed":116276547,"data_compressed_allocated":153047040,"data_compressed_original":2448752640,"omap_allocated":0,"internal_metadata":0},"log_size":12474,"ondisk_log_size":12474,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949673419,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":117100,"kb_used_data":31964,"kb_used_omap":0,"kb_used_meta":85120,"kb_avail":94254740,"statfs":{"total":96636764160,"available":96516853760,"internally_reserved":0,"allocated":32731136,"data_stored":516385152,"data_compressed":24514561,"data_compressed_allocated":32268288,"data_compressed_original":516210688,"omap_allocated":0,"internal_metadata":87162880},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654706123,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":130944,"kb_used_data":37488,"kb_used_omap":0,"kb_used_meta":93440,"kb_avail":94240896,"statfs":{"total":96636764160,"available":96502677504,"internally_reserved":0,"allocated":38387712,"data_stored":607283040,"data_compressed":28828734,"data_compressed_allocated":37945344,"data_compressed_original":607125504,"omap_allocated":0,"internal_metadata":95682560},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706123,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":131192,"kb_used_data":37736,"kb_used_omap":0,"kb_used_meta":93440,"kb_avail":94240648,"statfs":{"total":96636764160,"available":96502423552,"internally_reserved":0,"allocated":38641664,"data_stored":610953600,"data_compressed":29005076,"data_compressed_allocated":38178816,"data_compressed_original":610779136,"omap_allocated":0,"internal_metadata":95682560},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706123,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":124840,"kb_used_data":43864,"kb_used_omap":0,"kb_used_meta":80960,"kb_avail":94247000,"statfs":{"total":96636764160,"available":96508928000,"internally_reserved":0,"allocated":44916736,"data_stored":711420269,"data_compressed":33775608,"data_compressed_allocated":44457984,"data_compressed_original":711245824,"omap_allocated":0,"internal_metadata":82903040},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":44519424,"data_stored":712310784,"data_compressed":33823352,"data_compressed_allocated":44519424,"data_compressed_original":712310784,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32321536,"data_stored":517144576,"data_compressed":24556081,"data_compressed_allocated":32321536,"data_compressed_original":517144576,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":38137856,"data_stored":610205696,"data_compressed":28975020,"data_compressed_allocated":38137856,"data_compressed_original":610205696,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":38068224,"data_stored":609091584,"data_compressed":28922094,"data_compressed_allocated":38068224,"data_compressed_original":609091584,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:56:56.830 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 65 16 13735 13719 13.19 12.0625 0.0630128 0.0757702 2024-09-22T03:56:57.541 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:56:57.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:56:57.706+0000 7f4cd7f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:56:57.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:56:57.715+0000 7f4cd7f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:56:57.830 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 66 16 13932 13916 13.1767 12.3125 0.0229344 0.0758371 2024-09-22T03:56:58.830 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 67 16 14117 14101 13.1525 11.5625 0.113468 0.0759557 2024-09-22T03:56:59.830 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 68 16 14307 14291 13.1337 11.875 0.0757472 0.0760802 2024-09-22T03:57:00.092 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:57:00.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:57:00.260+0000 7f9ba52c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:57:00.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:57:00.272+0000 7f9ba52c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:57:00.830 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 69 16 14499 14483 13.1173 12 0.0765248 0.0761791 2024-09-22T03:57:00.903 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:57:00.903 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:57:00.903 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:57:00.904 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:57:01.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:57:01.070+0000 7f473e751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:57:01.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:57:01.083+0000 7f473e751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:57:01.269 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:57:01.270 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:57:01.270 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:57:01.270 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:57:01.270 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:57:01.270 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:57:01.270 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:57:01.270 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:57:01.270 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:57:01.270 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:57:01.270 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:57:01.270 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:57:01.272 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:57:01.273 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:57:01.273 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:57:01.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:57:01.431+0000 7fcc320d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:57:01.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:57:01.451+0000 7fcc320d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:57:01.640 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:57:01.640 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:57:01.640 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:57:01.640 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:57:01.640 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:57:01.641 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:57:01.641 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:57:01.641 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:57:01.641 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:57:01.641 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:57:01.641 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:57:01.641 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:57:01.645 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:57:01.645 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:57:01.645 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:57:01.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:57:01.794+0000 7fa345b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:57:01.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:57:01.811+0000 7fa345b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:57:01.831 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 70 16 14676 14660 13.0879 11.0625 0.149306 0.0763381 2024-09-22T03:57:01.859 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:57:01.859 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:57:01.859 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:57:01.859 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:57:01.859 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:57:01.859 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:57:01.859 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:57:01.859 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:57:01.860 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:57:01.860 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:57:01.860 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:57:01.860 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:57:01.862 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:57:01.862 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:57:01.862 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:57:02.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:57:02.041+0000 7fd007f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:57:02.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:57:02.054+0000 7fd007f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:57:02.150 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:57:02.151 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:57:02.151 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:57:02.151 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:57:02.151 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:57:02.151 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:57:02.151 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:57:02.151 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:57:02.151 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:57:02.151 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:57:02.151 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:57:02.151 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:57:02.154 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:57:02.155 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:57:02.649 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:57:02.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:57:02.804+0000 7f490c151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:57:02.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:57:02.814+0000 7f490c151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:57:02.830 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 71 16 14867 14851 13.0717 11.9375 0.114226 0.0764479 2024-09-22T03:57:03.830 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 72 16 15039 15023 13.0395 10.75 0.109548 0.0766058 2024-09-22T03:57:04.831 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 73 16 15233 15217 13.0269 12.125 0.0517036 0.07671 2024-09-22T03:57:05.278 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:57:05.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:57:05.446+0000 7f92820fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:57:05.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:57:05.456+0000 7f92820fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:57:05.830 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 74 16 15412 15396 13.002 11.1875 0.0466664 0.0768416 2024-09-22T03:57:06.831 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 75 16 15605 15589 12.9895 12.0625 0.0761852 0.07694 2024-09-22T03:57:07.155 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:57:07.156 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:57:07.156 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:57:07.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:57:07.315+0000 7f6e7df91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:57:07.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:57:07.333+0000 7f6e7df91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:57:07.664 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:57:07.664 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-22T03:57:07.685 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":284,"stamp":"2024-09-22T03:57:07.064422+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1006371379,"num_objects":15351,"num_object_clones":0,"num_object_copies":46053,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":15428,"num_write_kb":983316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15402,"ondisk_log_size":15402,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":538040,"kb_used_data":185012,"kb_used_omap":0,"kb_used_meta":352960,"kb_avail":376949320,"statfs":{"total":386547056640,"available":385996103680,"internally_reserved":0,"allocated":189452288,"data_stored":3002442701,"data_compressed":142544859,"data_compressed_allocated":187625472,"data_compressed_original":3001761792,"omap_allocated":0,"internal_metadata":361431040},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":188284928,"num_objects":2873,"num_object_clones":0,"num_object_copies":8619,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2873,"num_write_kb":183872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002301"},"pg_stats":[{"pgid":"5.f","version":"52'989","reported_seq":1001,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:57:06.159219+0000","last_change":"2024-09-22T03:55:50.938932+0000","last_active":"2024-09-22T03:57:06.159219+0000","last_peered":"2024-09-22T03:57:06.159219+0000","last_clean":"2024-09-22T03:57:06.159219+0000","last_became_active":"2024-09-22T03:55:50.929290+0000","last_became_peered":"2024-09-22T03:55:50.929290+0000","last_unstale":"2024-09-22T03:57:06.159219+0000","last_undegraded":"2024-09-22T03:57:06.159219+0000","last_fullsized":"2024-09-22T03:57:06.159219+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":989,"log_dups_size":0,"ondisk_log_size":989,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64815104,"num_objects":989,"num_object_clones":0,"num_object_copies":2967,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":989,"num_write_kb":63296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"52'954","reported_seq":966,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:57:04.699643+0000","last_change":"2024-09-22T03:55:50.848180+0000","last_active":"2024-09-22T03:57:04.699643+0000","last_peered":"2024-09-22T03:57:04.699643+0000","last_clean":"2024-09-22T03:57:04.699643+0000","last_became_active":"2024-09-22T03:55:50.838302+0000","last_became_peered":"2024-09-22T03:55:50.838302+0000","last_unstale":"2024-09-22T03:57:04.699643+0000","last_undegraded":"2024-09-22T03:57:04.699643+0000","last_fullsized":"2024-09-22T03:57:04.699643+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":954,"log_dups_size":0,"ondisk_log_size":954,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62521344,"num_objects":954,"num_object_clones":0,"num_object_copies":2862,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":954,"num_write_kb":61056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"52'1015","reported_seq":1027,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:57:05.043790+0000","last_change":"2024-09-22T03:55:50.872362+0000","last_active":"2024-09-22T03:57:05.043790+0000","last_peered":"2024-09-22T03:57:05.043790+0000","last_clean":"2024-09-22T03:57:05.043790+0000","last_became_active":"2024-09-22T03:55:50.867322+0000","last_became_peered":"2024-09-22T03:55:50.867322+0000","last_unstale":"2024-09-22T03:57:05.043790+0000","last_undegraded":"2024-09-22T03:57:05.043790+0000","last_fullsized":"2024-09-22T03:57:05.043790+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1015,"log_dups_size":0,"ondisk_log_size":1015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66519040,"num_objects":1015,"num_object_clones":0,"num_object_copies":3045,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1015,"num_write_kb":64960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"52'976","reported_seq":988,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:57:05.972962+0000","last_change":"2024-09-22T03:55:50.942624+0000","last_active":"2024-09-22T03:57:05.972962+0000","last_peered":"2024-09-22T03:57:05.972962+0000","last_clean":"2024-09-22T03:57:05.972962+0000","last_became_active":"2024-09-22T03:55:50.922812+0000","last_became_peered":"2024-09-22T03:55:50.922812+0000","last_unstale":"2024-09-22T03:57:05.972962+0000","last_undegraded":"2024-09-22T03:57:05.972962+0000","last_fullsized":"2024-09-22T03:57:05.972962+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":976,"log_dups_size":0,"ondisk_log_size":976,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63963136,"num_objects":976,"num_object_clones":0,"num_object_copies":2928,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":976,"num_write_kb":62464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"52'936","reported_seq":948,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:57:05.072851+0000","last_change":"2024-09-22T03:55:50.890353+0000","last_active":"2024-09-22T03:57:05.072851+0000","last_peered":"2024-09-22T03:57:05.072851+0000","last_clean":"2024-09-22T03:57:05.072851+0000","last_became_active":"2024-09-22T03:55:50.882633+0000","last_became_peered":"2024-09-22T03:55:50.882633+0000","last_unstale":"2024-09-22T03:57:05.072851+0000","last_undegraded":"2024-09-22T03:57:05.072851+0000","last_fullsized":"2024-09-22T03:57:05.072851+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":936,"log_dups_size":0,"ondisk_log_size":936,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61341696,"num_objects":936,"num_object_clones":0,"num_object_copies":2808,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":936,"num_write_kb":59904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.a","version":"52'967","reported_seq":979,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:57:05.123268+0000","last_change":"2024-09-22T03:55:50.891052+0000","last_active":"2024-09-22T03:57:05.123268+0000","last_peered":"2024-09-22T03:57:05.123268+0000","last_clean":"2024-09-22T03:57:05.123268+0000","last_became_active":"2024-09-22T03:55:50.880295+0000","last_became_peered":"2024-09-22T03:55:50.880295+0000","last_unstale":"2024-09-22T03:57:05.123268+0000","last_undegraded":"2024-09-22T03:57:05.123268+0000","last_fullsized":"2024-09-22T03:57:05.123268+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":967,"log_dups_size":0,"ondisk_log_size":967,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63373312,"num_objects":967,"num_object_clones":0,"num_object_copies":2901,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":967,"num_write_kb":61888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"52'959","reported_seq":971,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:57:04.983257+0000","last_change":"2024-09-22T03:55:50.906894+0000","last_active":"2024-09-22T03:57:04.983257+0000","last_peered":"2024-09-22T03:57:04.983257+0000","last_clean":"2024-09-22T03:57:04.983257+0000","last_became_active":"2024-09-22T03:55:50.896899+0000","last_became_peered":"2024-09-22T03:55:50.896899+0000","last_unstale":"2024-09-22T03:57:04.983257+0000","last_undegraded":"2024-09-22T03:57:04.983257+0000","last_fullsized":"2024-09-22T03:57:04.983257+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":959,"log_dups_size":0,"ondisk_log_size":959,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62849024,"num_objects":959,"num_object_clones":0,"num_object_copies":2877,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":959,"num_write_kb":61376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"52'922","reported_seq":934,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:57:04.417674+0000","last_change":"2024-09-22T03:55:50.859578+0000","last_active":"2024-09-22T03:57:04.417674+0000","last_peered":"2024-09-22T03:57:04.417674+0000","last_clean":"2024-09-22T03:57:04.417674+0000","last_became_active":"2024-09-22T03:55:50.843710+0000","last_became_peered":"2024-09-22T03:55:50.843710+0000","last_unstale":"2024-09-22T03:57:04.417674+0000","last_undegraded":"2024-09-22T03:57:04.417674+0000","last_fullsized":"2024-09-22T03:57:04.417674+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":922,"log_dups_size":0,"ondisk_log_size":922,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60424192,"num_objects":922,"num_object_clones":0,"num_object_copies":2766,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":922,"num_write_kb":59008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"52'981","reported_seq":993,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:57:04.947332+0000","last_change":"2024-09-22T03:55:50.968411+0000","last_active":"2024-09-22T03:57:04.947332+0000","last_peered":"2024-09-22T03:57:04.947332+0000","last_clean":"2024-09-22T03:57:04.947332+0000","last_became_active":"2024-09-22T03:55:50.961718+0000","last_became_peered":"2024-09-22T03:55:50.961718+0000","last_unstale":"2024-09-22T03:57:04.947332+0000","last_undegraded":"2024-09-22T03:57:04.947332+0000","last_fullsized":"2024-09-22T03:57:04.947332+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":981,"log_dups_size":0,"ondisk_log_size":981,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64290816,"num_objects":981,"num_object_clones":0,"num_object_copies":2943,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":981,"num_write_kb":62784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":199,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:51.749469+0000","last_change":"2024-09-22T03:49:12.034704+0000","last_active":"2024-09-22T03:55:51.749469+0000","last_peered":"2024-09-22T03:55:51.749469+0000","last_clean":"2024-09-22T03:55:51.749469+0000","last_became_active":"2024-09-22T03:49:12.027470+0000","last_became_peered":"2024-09-22T03:49:12.027470+0000","last_unstale":"2024-09-22T03:55:51.749469+0000","last_undegraded":"2024-09-22T03:55:51.749469+0000","last_fullsized":"2024-09-22T03:55:51.749469+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_clean_scrub_stamp":"2024-09-22T03:49:10.979949+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":125,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:51.750162+0000","last_change":"2024-09-22T03:49:17.031458+0000","last_active":"2024-09-22T03:55:51.750162+0000","last_peered":"2024-09-22T03:55:51.750162+0000","last_clean":"2024-09-22T03:55:51.750162+0000","last_became_active":"2024-09-22T03:49:15.125490+0000","last_became_peered":"2024-09-22T03:49:15.125490+0000","last_unstale":"2024-09-22T03:55:51.750162+0000","last_undegraded":"2024-09-22T03:55:51.750162+0000","last_fullsized":"2024-09-22T03:55:51.750162+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.7","version":"52'956","reported_seq":968,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:57:04.904747+0000","last_change":"2024-09-22T03:55:50.910597+0000","last_active":"2024-09-22T03:57:04.904747+0000","last_peered":"2024-09-22T03:57:04.904747+0000","last_clean":"2024-09-22T03:57:04.904747+0000","last_became_active":"2024-09-22T03:55:50.901290+0000","last_became_peered":"2024-09-22T03:55:50.901290+0000","last_unstale":"2024-09-22T03:57:04.904747+0000","last_undegraded":"2024-09-22T03:57:04.904747+0000","last_fullsized":"2024-09-22T03:57:04.904747+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":956,"log_dups_size":0,"ondisk_log_size":956,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62652416,"num_objects":956,"num_object_clones":0,"num_object_copies":2868,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":956,"num_write_kb":61184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":124,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:51.742303+0000","last_change":"2024-09-22T03:49:17.029339+0000","last_active":"2024-09-22T03:55:51.742303+0000","last_peered":"2024-09-22T03:55:51.742303+0000","last_clean":"2024-09-22T03:55:51.742303+0000","last_became_active":"2024-09-22T03:49:15.097304+0000","last_became_peered":"2024-09-22T03:49:15.097304+0000","last_unstale":"2024-09-22T03:55:51.742303+0000","last_undegraded":"2024-09-22T03:55:51.742303+0000","last_fullsized":"2024-09-22T03:55:51.742303+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"52'968","reported_seq":980,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:57:06.123133+0000","last_change":"2024-09-22T03:55:50.918358+0000","last_active":"2024-09-22T03:57:06.123133+0000","last_peered":"2024-09-22T03:57:06.123133+0000","last_clean":"2024-09-22T03:57:06.123133+0000","last_became_active":"2024-09-22T03:55:50.889906+0000","last_became_peered":"2024-09-22T03:55:50.889906+0000","last_unstale":"2024-09-22T03:57:06.123133+0000","last_undegraded":"2024-09-22T03:57:06.123133+0000","last_fullsized":"2024-09-22T03:57:06.123133+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":968,"log_dups_size":0,"ondisk_log_size":968,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63438848,"num_objects":968,"num_object_clones":0,"num_object_copies":2904,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":968,"num_write_kb":61952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":124,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:51.751861+0000","last_change":"2024-09-22T03:49:17.029349+0000","last_active":"2024-09-22T03:55:51.751861+0000","last_peered":"2024-09-22T03:55:51.751861+0000","last_clean":"2024-09-22T03:55:51.751861+0000","last_became_active":"2024-09-22T03:49:15.094890+0000","last_became_peered":"2024-09-22T03:49:15.094890+0000","last_unstale":"2024-09-22T03:55:51.751861+0000","last_undegraded":"2024-09-22T03:55:51.751861+0000","last_fullsized":"2024-09-22T03:55:51.751861+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"52'956","reported_seq":968,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:57:04.758200+0000","last_change":"2024-09-22T03:55:50.939050+0000","last_active":"2024-09-22T03:57:04.758200+0000","last_peered":"2024-09-22T03:57:04.758200+0000","last_clean":"2024-09-22T03:57:04.758200+0000","last_became_active":"2024-09-22T03:55:50.929831+0000","last_became_peered":"2024-09-22T03:55:50.929831+0000","last_unstale":"2024-09-22T03:57:04.758200+0000","last_undegraded":"2024-09-22T03:57:04.758200+0000","last_fullsized":"2024-09-22T03:57:04.758200+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":956,"log_dups_size":0,"ondisk_log_size":956,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62652416,"num_objects":956,"num_object_clones":0,"num_object_copies":2868,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":956,"num_write_kb":61184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":126,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:51.749244+0000","last_change":"2024-09-22T03:49:17.031466+0000","last_active":"2024-09-22T03:55:51.749244+0000","last_peered":"2024-09-22T03:55:51.749244+0000","last_clean":"2024-09-22T03:55:51.749244+0000","last_became_active":"2024-09-22T03:49:15.098420+0000","last_became_peered":"2024-09-22T03:49:15.098420+0000","last_unstale":"2024-09-22T03:55:51.749244+0000","last_undegraded":"2024-09-22T03:55:51.749244+0000","last_fullsized":"2024-09-22T03:55:51.749244+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3","version":"52'915","reported_seq":927,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:57:05.077611+0000","last_change":"2024-09-22T03:55:50.862956+0000","last_active":"2024-09-22T03:57:05.077611+0000","last_peered":"2024-09-22T03:57:05.077611+0000","last_clean":"2024-09-22T03:57:05.077611+0000","last_became_active":"2024-09-22T03:55:50.854828+0000","last_became_peered":"2024-09-22T03:55:50.854828+0000","last_unstale":"2024-09-22T03:57:05.077611+0000","last_undegraded":"2024-09-22T03:57:05.077611+0000","last_fullsized":"2024-09-22T03:57:05.077611+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":915,"log_dups_size":0,"ondisk_log_size":915,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59965440,"num_objects":915,"num_object_clones":0,"num_object_copies":2745,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":915,"num_write_kb":58560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":124,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:51.754967+0000","last_change":"2024-09-22T03:49:17.036954+0000","last_active":"2024-09-22T03:55:51.754967+0000","last_peered":"2024-09-22T03:55:51.754967+0000","last_clean":"2024-09-22T03:55:51.754967+0000","last_became_active":"2024-09-22T03:49:15.110506+0000","last_became_peered":"2024-09-22T03:49:15.110506+0000","last_unstale":"2024-09-22T03:55:51.754967+0000","last_undegraded":"2024-09-22T03:55:51.754967+0000","last_fullsized":"2024-09-22T03:55:51.754967+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"52'928","reported_seq":940,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:57:04.639937+0000","last_change":"2024-09-22T03:55:50.927264+0000","last_active":"2024-09-22T03:57:04.639937+0000","last_peered":"2024-09-22T03:57:04.639937+0000","last_clean":"2024-09-22T03:57:04.639937+0000","last_became_active":"2024-09-22T03:55:50.919600+0000","last_became_peered":"2024-09-22T03:55:50.919600+0000","last_unstale":"2024-09-22T03:57:04.639937+0000","last_undegraded":"2024-09-22T03:57:04.639937+0000","last_fullsized":"2024-09-22T03:57:04.639937+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":928,"log_dups_size":0,"ondisk_log_size":928,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60817408,"num_objects":928,"num_object_clones":0,"num_object_copies":2784,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":928,"num_write_kb":59392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":124,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:51.747974+0000","last_change":"2024-09-22T03:49:17.032989+0000","last_active":"2024-09-22T03:55:51.747974+0000","last_peered":"2024-09-22T03:55:51.747974+0000","last_clean":"2024-09-22T03:55:51.747974+0000","last_became_active":"2024-09-22T03:49:15.079260+0000","last_became_peered":"2024-09-22T03:49:15.079260+0000","last_unstale":"2024-09-22T03:55:51.747974+0000","last_undegraded":"2024-09-22T03:55:51.747974+0000","last_fullsized":"2024-09-22T03:55:51.747974+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"52'987","reported_seq":999,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:57:05.958169+0000","last_change":"2024-09-22T03:55:50.862926+0000","last_active":"2024-09-22T03:57:05.958169+0000","last_peered":"2024-09-22T03:57:05.958169+0000","last_clean":"2024-09-22T03:57:05.958169+0000","last_became_active":"2024-09-22T03:55:50.851824+0000","last_became_peered":"2024-09-22T03:55:50.851824+0000","last_unstale":"2024-09-22T03:57:05.958169+0000","last_undegraded":"2024-09-22T03:57:05.958169+0000","last_fullsized":"2024-09-22T03:57:05.958169+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":987,"log_dups_size":0,"ondisk_log_size":987,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64684032,"num_objects":987,"num_object_clones":0,"num_object_copies":2961,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":987,"num_write_kb":63168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":124,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:51.758850+0000","last_change":"2024-09-22T03:49:17.036402+0000","last_active":"2024-09-22T03:55:51.758850+0000","last_peered":"2024-09-22T03:55:51.758850+0000","last_clean":"2024-09-22T03:55:51.758850+0000","last_became_active":"2024-09-22T03:49:15.108430+0000","last_became_peered":"2024-09-22T03:49:15.108430+0000","last_unstale":"2024-09-22T03:55:51.758850+0000","last_undegraded":"2024-09-22T03:55:51.758850+0000","last_fullsized":"2024-09-22T03:55:51.758850+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"52'938","reported_seq":950,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:57:04.935565+0000","last_change":"2024-09-22T03:55:50.878789+0000","last_active":"2024-09-22T03:57:04.935565+0000","last_peered":"2024-09-22T03:57:04.935565+0000","last_clean":"2024-09-22T03:57:04.935565+0000","last_became_active":"2024-09-22T03:55:50.852561+0000","last_became_peered":"2024-09-22T03:55:50.852561+0000","last_unstale":"2024-09-22T03:57:04.935565+0000","last_undegraded":"2024-09-22T03:57:04.935565+0000","last_fullsized":"2024-09-22T03:57:04.935565+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":938,"log_dups_size":0,"ondisk_log_size":938,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61472768,"num_objects":938,"num_object_clones":0,"num_object_copies":2814,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":938,"num_write_kb":60032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":124,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:51.744448+0000","last_change":"2024-09-22T03:49:17.029128+0000","last_active":"2024-09-22T03:55:51.744448+0000","last_peered":"2024-09-22T03:55:51.744448+0000","last_clean":"2024-09-22T03:55:51.744448+0000","last_became_active":"2024-09-22T03:49:15.113396+0000","last_became_peered":"2024-09-22T03:49:15.113396+0000","last_unstale":"2024-09-22T03:55:51.744448+0000","last_undegraded":"2024-09-22T03:55:51.744448+0000","last_fullsized":"2024-09-22T03:55:51.744448+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":1005780992,"num_objects":15347,"num_object_clones":0,"num_object_copies":46041,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15347,"num_write_kb":982208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":188317696,"data_stored":3013083136,"data_compressed":143073979,"data_compressed_allocated":188317696,"data_compressed_original":3013083136,"omap_allocated":0,"internal_metadata":0},"log_size":15347,"ondisk_log_size":15347,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949673434,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":132608,"kb_used_data":39152,"kb_used_omap":0,"kb_used_meta":93440,"kb_avail":94239232,"statfs":{"total":96636764160,"available":96500973568,"internally_reserved":0,"allocated":40091648,"data_stored":634153344,"data_compressed":30106825,"data_compressed_allocated":39628800,"data_compressed_original":633978880,"omap_allocated":0,"internal_metadata":95682560},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654706138,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":131212,"kb_used_data":46076,"kb_used_omap":0,"kb_used_meta":85120,"kb_avail":94240628,"statfs":{"total":96636764160,"available":96502403072,"internally_reserved":0,"allocated":47181824,"data_stored":747988832,"data_compressed":35510198,"data_compressed_allocated":46739456,"data_compressed_original":747831296,"omap_allocated":0,"internal_metadata":87162880},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706137,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":130892,"kb_used_data":45756,"kb_used_omap":0,"kb_used_meta":85120,"kb_avail":94240948,"statfs":{"total":96636764160,"available":96502730752,"internally_reserved":0,"allocated":46854144,"data_stored":742353280,"data_compressed":35244636,"data_compressed_allocated":46391296,"data_compressed_original":742178816,"omap_allocated":0,"internal_metadata":87162880},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706138,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":143328,"kb_used_data":54028,"kb_used_omap":0,"kb_used_meta":89280,"kb_avail":94228512,"statfs":{"total":96636764160,"available":96489996288,"internally_reserved":0,"allocated":55324672,"data_stored":877947245,"data_compressed":41683200,"data_compressed_allocated":54865920,"data_compressed_original":877772800,"omap_allocated":0,"internal_metadata":91422720},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":54902784,"data_stored":878444544,"data_compressed":41712272,"data_compressed_allocated":54902784,"data_compressed_original":878444544,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":39677952,"data_stored":634847232,"data_compressed":30145233,"data_compressed_allocated":39677952,"data_compressed_original":634847232,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":46886912,"data_stored":750190592,"data_compressed":35622252,"data_compressed_allocated":46886912,"data_compressed_original":750190592,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":46850048,"data_stored":749600768,"data_compressed":35594222,"data_compressed_allocated":46850048,"data_compressed_original":749600768,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:57:07.823 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:57:07.831 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 76 16 15788 15772 12.9691 11.4375 0.0777998 0.0770577 2024-09-22T03:57:07.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:57:07.995+0000 7efdd2f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:57:08.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:57:08.004+0000 7efdd2f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:57:08.831 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 77 16 15971 15955 12.9492 11.4375 0.0784273 0.0771587 2024-09-22T03:57:09.831 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 78 16 16164 16148 12.9378 12.0625 0.0796234 0.0772126 2024-09-22T03:57:10.454 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:57:10.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:57:10.636+0000 7f7df5cac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:57:10.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:57:10.644+0000 7f7df5cac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:57:10.831 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 79 16 16355 16339 12.9251 11.9375 0.0952982 0.077309 2024-09-22T03:57:11.831 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:2024-09-22T03:57:11.831202+0000 min lat: 0.0157147 max lat: 0.204046 avg lat: 0.077429 2024-09-22T03:57:11.831 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-22T03:57:11.831 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 80 16 16538 16522 12.9065 11.4375 0.106377 0.077429 2024-09-22T03:57:12.687 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:57:12.687 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:57:12.687 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:57:12.831 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 81 16 16733 16717 12.8976 12.1875 0.0770495 0.0774871 2024-09-22T03:57:12.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:57:12.855+0000 7f0cfdd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:57:12.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:57:12.873+0000 7f0cfdd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:57:13.135 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:57:13.228 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:57:13.228 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-22T03:57:13.256 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":287,"stamp":"2024-09-22T03:57:13.065730+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1066009139,"num_objects":16261,"num_object_clones":0,"num_object_copies":48783,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":16338,"num_write_kb":1041556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16312,"ondisk_log_size":16312,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":557444,"kb_used_data":196100,"kb_used_omap":0,"kb_used_meta":361280,"kb_avail":376929916,"statfs":{"total":386547056640,"available":385976233984,"internally_reserved":0,"allocated":200806400,"data_stored":3184108493,"data_compressed":151171323,"data_compressed_allocated":198979584,"data_compressed_original":3183427584,"omap_allocated":0,"internal_metadata":369950720},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":137363456,"num_objects":2096,"num_object_clones":0,"num_object_copies":6288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2096,"num_write_kb":134144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002551"},"pg_stats":[{"pgid":"5.f","version":"52'1051","reported_seq":1063,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:57:11.087479+0000","last_change":"2024-09-22T03:55:50.938932+0000","last_active":"2024-09-22T03:57:11.087479+0000","last_peered":"2024-09-22T03:57:11.087479+0000","last_clean":"2024-09-22T03:57:11.087479+0000","last_became_active":"2024-09-22T03:55:50.929290+0000","last_became_peered":"2024-09-22T03:55:50.929290+0000","last_unstale":"2024-09-22T03:57:11.087479+0000","last_undegraded":"2024-09-22T03:57:11.087479+0000","last_fullsized":"2024-09-22T03:57:11.087479+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1051,"log_dups_size":0,"ondisk_log_size":1051,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68878336,"num_objects":1051,"num_object_clones":0,"num_object_copies":3153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1051,"num_write_kb":67264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"52'1001","reported_seq":1013,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:57:10.016893+0000","last_change":"2024-09-22T03:55:50.848180+0000","last_active":"2024-09-22T03:57:10.016893+0000","last_peered":"2024-09-22T03:57:10.016893+0000","last_clean":"2024-09-22T03:57:10.016893+0000","last_became_active":"2024-09-22T03:55:50.838302+0000","last_became_peered":"2024-09-22T03:55:50.838302+0000","last_unstale":"2024-09-22T03:57:10.016893+0000","last_undegraded":"2024-09-22T03:57:10.016893+0000","last_fullsized":"2024-09-22T03:57:10.016893+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1001,"log_dups_size":0,"ondisk_log_size":1001,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65601536,"num_objects":1001,"num_object_clones":0,"num_object_copies":3003,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1001,"num_write_kb":64064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"52'1068","reported_seq":1080,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:57:10.033235+0000","last_change":"2024-09-22T03:55:50.872362+0000","last_active":"2024-09-22T03:57:10.033235+0000","last_peered":"2024-09-22T03:57:10.033235+0000","last_clean":"2024-09-22T03:57:10.033235+0000","last_became_active":"2024-09-22T03:55:50.867322+0000","last_became_peered":"2024-09-22T03:55:50.867322+0000","last_unstale":"2024-09-22T03:57:10.033235+0000","last_undegraded":"2024-09-22T03:57:10.033235+0000","last_fullsized":"2024-09-22T03:57:10.033235+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1068,"log_dups_size":0,"ondisk_log_size":1068,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69992448,"num_objects":1068,"num_object_clones":0,"num_object_copies":3204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1068,"num_write_kb":68352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"52'1047","reported_seq":1059,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:57:11.063789+0000","last_change":"2024-09-22T03:55:50.942624+0000","last_active":"2024-09-22T03:57:11.063789+0000","last_peered":"2024-09-22T03:57:11.063789+0000","last_clean":"2024-09-22T03:57:11.063789+0000","last_became_active":"2024-09-22T03:55:50.922812+0000","last_became_peered":"2024-09-22T03:55:50.922812+0000","last_unstale":"2024-09-22T03:57:11.063789+0000","last_undegraded":"2024-09-22T03:57:11.063789+0000","last_fullsized":"2024-09-22T03:57:11.063789+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1047,"log_dups_size":0,"ondisk_log_size":1047,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68616192,"num_objects":1047,"num_object_clones":0,"num_object_copies":3141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1047,"num_write_kb":67008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"52'980","reported_seq":992,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:57:09.787665+0000","last_change":"2024-09-22T03:55:50.890353+0000","last_active":"2024-09-22T03:57:09.787665+0000","last_peered":"2024-09-22T03:57:09.787665+0000","last_clean":"2024-09-22T03:57:09.787665+0000","last_became_active":"2024-09-22T03:55:50.882633+0000","last_became_peered":"2024-09-22T03:55:50.882633+0000","last_unstale":"2024-09-22T03:57:09.787665+0000","last_undegraded":"2024-09-22T03:57:09.787665+0000","last_fullsized":"2024-09-22T03:57:09.787665+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":980,"log_dups_size":0,"ondisk_log_size":980,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64225280,"num_objects":980,"num_object_clones":0,"num_object_copies":2940,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":980,"num_write_kb":62720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.a","version":"52'1021","reported_seq":1033,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:57:10.037991+0000","last_change":"2024-09-22T03:55:50.891052+0000","last_active":"2024-09-22T03:57:10.037991+0000","last_peered":"2024-09-22T03:57:10.037991+0000","last_clean":"2024-09-22T03:57:10.037991+0000","last_became_active":"2024-09-22T03:55:50.880295+0000","last_became_peered":"2024-09-22T03:55:50.880295+0000","last_unstale":"2024-09-22T03:57:10.037991+0000","last_undegraded":"2024-09-22T03:57:10.037991+0000","last_fullsized":"2024-09-22T03:57:10.037991+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1021,"log_dups_size":0,"ondisk_log_size":1021,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66912256,"num_objects":1021,"num_object_clones":0,"num_object_copies":3063,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1021,"num_write_kb":65344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"52'1023","reported_seq":1035,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:57:09.934779+0000","last_change":"2024-09-22T03:55:50.906894+0000","last_active":"2024-09-22T03:57:09.934779+0000","last_peered":"2024-09-22T03:57:09.934779+0000","last_clean":"2024-09-22T03:57:09.934779+0000","last_became_active":"2024-09-22T03:55:50.896899+0000","last_became_peered":"2024-09-22T03:55:50.896899+0000","last_unstale":"2024-09-22T03:57:09.934779+0000","last_undegraded":"2024-09-22T03:57:09.934779+0000","last_fullsized":"2024-09-22T03:57:09.934779+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1023,"log_dups_size":0,"ondisk_log_size":1023,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67043328,"num_objects":1023,"num_object_clones":0,"num_object_copies":3069,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1023,"num_write_kb":65472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"52'981","reported_seq":993,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:57:10.050226+0000","last_change":"2024-09-22T03:55:50.859578+0000","last_active":"2024-09-22T03:57:10.050226+0000","last_peered":"2024-09-22T03:57:10.050226+0000","last_clean":"2024-09-22T03:57:10.050226+0000","last_became_active":"2024-09-22T03:55:50.843710+0000","last_became_peered":"2024-09-22T03:55:50.843710+0000","last_unstale":"2024-09-22T03:57:10.050226+0000","last_undegraded":"2024-09-22T03:57:10.050226+0000","last_fullsized":"2024-09-22T03:57:10.050226+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":981,"log_dups_size":0,"ondisk_log_size":981,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64290816,"num_objects":981,"num_object_clones":0,"num_object_copies":2943,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":981,"num_write_kb":62784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"52'1050","reported_seq":1062,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:57:09.989151+0000","last_change":"2024-09-22T03:55:50.968411+0000","last_active":"2024-09-22T03:57:09.989151+0000","last_peered":"2024-09-22T03:57:09.989151+0000","last_clean":"2024-09-22T03:57:09.989151+0000","last_became_active":"2024-09-22T03:55:50.961718+0000","last_became_peered":"2024-09-22T03:55:50.961718+0000","last_unstale":"2024-09-22T03:57:09.989151+0000","last_undegraded":"2024-09-22T03:57:09.989151+0000","last_fullsized":"2024-09-22T03:57:09.989151+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1050,"log_dups_size":0,"ondisk_log_size":1050,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68812800,"num_objects":1050,"num_object_clones":0,"num_object_copies":3150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1050,"num_write_kb":67200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":199,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:51.749469+0000","last_change":"2024-09-22T03:49:12.034704+0000","last_active":"2024-09-22T03:55:51.749469+0000","last_peered":"2024-09-22T03:55:51.749469+0000","last_clean":"2024-09-22T03:55:51.749469+0000","last_became_active":"2024-09-22T03:49:12.027470+0000","last_became_peered":"2024-09-22T03:49:12.027470+0000","last_unstale":"2024-09-22T03:55:51.749469+0000","last_undegraded":"2024-09-22T03:55:51.749469+0000","last_fullsized":"2024-09-22T03:55:51.749469+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_clean_scrub_stamp":"2024-09-22T03:49:10.979949+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":125,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:51.750162+0000","last_change":"2024-09-22T03:49:17.031458+0000","last_active":"2024-09-22T03:55:51.750162+0000","last_peered":"2024-09-22T03:55:51.750162+0000","last_clean":"2024-09-22T03:55:51.750162+0000","last_became_active":"2024-09-22T03:49:15.125490+0000","last_became_peered":"2024-09-22T03:49:15.125490+0000","last_unstale":"2024-09-22T03:55:51.750162+0000","last_undegraded":"2024-09-22T03:55:51.750162+0000","last_fullsized":"2024-09-22T03:55:51.750162+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.7","version":"52'1018","reported_seq":1030,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:57:09.790009+0000","last_change":"2024-09-22T03:55:50.910597+0000","last_active":"2024-09-22T03:57:09.790009+0000","last_peered":"2024-09-22T03:57:09.790009+0000","last_clean":"2024-09-22T03:57:09.790009+0000","last_became_active":"2024-09-22T03:55:50.901290+0000","last_became_peered":"2024-09-22T03:55:50.901290+0000","last_unstale":"2024-09-22T03:57:09.790009+0000","last_undegraded":"2024-09-22T03:57:09.790009+0000","last_fullsized":"2024-09-22T03:57:09.790009+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1018,"log_dups_size":0,"ondisk_log_size":1018,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66715648,"num_objects":1018,"num_object_clones":0,"num_object_copies":3054,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1018,"num_write_kb":65152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":124,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:51.742303+0000","last_change":"2024-09-22T03:49:17.029339+0000","last_active":"2024-09-22T03:55:51.742303+0000","last_peered":"2024-09-22T03:55:51.742303+0000","last_clean":"2024-09-22T03:55:51.742303+0000","last_became_active":"2024-09-22T03:49:15.097304+0000","last_became_peered":"2024-09-22T03:49:15.097304+0000","last_unstale":"2024-09-22T03:55:51.742303+0000","last_undegraded":"2024-09-22T03:55:51.742303+0000","last_fullsized":"2024-09-22T03:55:51.742303+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"52'1010","reported_seq":1022,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:57:10.885774+0000","last_change":"2024-09-22T03:55:50.918358+0000","last_active":"2024-09-22T03:57:10.885774+0000","last_peered":"2024-09-22T03:57:10.885774+0000","last_clean":"2024-09-22T03:57:10.885774+0000","last_became_active":"2024-09-22T03:55:50.889906+0000","last_became_peered":"2024-09-22T03:55:50.889906+0000","last_unstale":"2024-09-22T03:57:10.885774+0000","last_undegraded":"2024-09-22T03:57:10.885774+0000","last_fullsized":"2024-09-22T03:57:10.885774+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1010,"log_dups_size":0,"ondisk_log_size":1010,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66191360,"num_objects":1010,"num_object_clones":0,"num_object_copies":3030,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1010,"num_write_kb":64640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":124,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:51.751861+0000","last_change":"2024-09-22T03:49:17.029349+0000","last_active":"2024-09-22T03:55:51.751861+0000","last_peered":"2024-09-22T03:55:51.751861+0000","last_clean":"2024-09-22T03:55:51.751861+0000","last_became_active":"2024-09-22T03:49:15.094890+0000","last_became_peered":"2024-09-22T03:49:15.094890+0000","last_unstale":"2024-09-22T03:55:51.751861+0000","last_undegraded":"2024-09-22T03:55:51.751861+0000","last_fullsized":"2024-09-22T03:55:51.751861+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"52'1007","reported_seq":1019,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:57:10.093798+0000","last_change":"2024-09-22T03:55:50.939050+0000","last_active":"2024-09-22T03:57:10.093798+0000","last_peered":"2024-09-22T03:57:10.093798+0000","last_clean":"2024-09-22T03:57:10.093798+0000","last_became_active":"2024-09-22T03:55:50.929831+0000","last_became_peered":"2024-09-22T03:55:50.929831+0000","last_unstale":"2024-09-22T03:57:10.093798+0000","last_undegraded":"2024-09-22T03:57:10.093798+0000","last_fullsized":"2024-09-22T03:57:10.093798+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1007,"log_dups_size":0,"ondisk_log_size":1007,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65994752,"num_objects":1007,"num_object_clones":0,"num_object_copies":3021,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1007,"num_write_kb":64448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":126,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:51.749244+0000","last_change":"2024-09-22T03:49:17.031466+0000","last_active":"2024-09-22T03:55:51.749244+0000","last_peered":"2024-09-22T03:55:51.749244+0000","last_clean":"2024-09-22T03:55:51.749244+0000","last_became_active":"2024-09-22T03:49:15.098420+0000","last_became_peered":"2024-09-22T03:49:15.098420+0000","last_unstale":"2024-09-22T03:55:51.749244+0000","last_undegraded":"2024-09-22T03:55:51.749244+0000","last_fullsized":"2024-09-22T03:55:51.749244+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3","version":"52'975","reported_seq":987,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:57:10.081415+0000","last_change":"2024-09-22T03:55:50.862956+0000","last_active":"2024-09-22T03:57:10.081415+0000","last_peered":"2024-09-22T03:57:10.081415+0000","last_clean":"2024-09-22T03:57:10.081415+0000","last_became_active":"2024-09-22T03:55:50.854828+0000","last_became_peered":"2024-09-22T03:55:50.854828+0000","last_unstale":"2024-09-22T03:57:10.081415+0000","last_undegraded":"2024-09-22T03:57:10.081415+0000","last_fullsized":"2024-09-22T03:57:10.081415+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":975,"log_dups_size":0,"ondisk_log_size":975,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63897600,"num_objects":975,"num_object_clones":0,"num_object_copies":2925,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":975,"num_write_kb":62400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":124,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:51.754967+0000","last_change":"2024-09-22T03:49:17.036954+0000","last_active":"2024-09-22T03:55:51.754967+0000","last_peered":"2024-09-22T03:55:51.754967+0000","last_clean":"2024-09-22T03:55:51.754967+0000","last_became_active":"2024-09-22T03:49:15.110506+0000","last_became_peered":"2024-09-22T03:49:15.110506+0000","last_unstale":"2024-09-22T03:55:51.754967+0000","last_undegraded":"2024-09-22T03:55:51.754967+0000","last_fullsized":"2024-09-22T03:55:51.754967+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"52'993","reported_seq":1005,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:57:09.923029+0000","last_change":"2024-09-22T03:55:50.927264+0000","last_active":"2024-09-22T03:57:09.923029+0000","last_peered":"2024-09-22T03:57:09.923029+0000","last_clean":"2024-09-22T03:57:09.923029+0000","last_became_active":"2024-09-22T03:55:50.919600+0000","last_became_peered":"2024-09-22T03:55:50.919600+0000","last_unstale":"2024-09-22T03:57:09.923029+0000","last_undegraded":"2024-09-22T03:57:09.923029+0000","last_fullsized":"2024-09-22T03:57:09.923029+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":993,"log_dups_size":0,"ondisk_log_size":993,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65077248,"num_objects":993,"num_object_clones":0,"num_object_copies":2979,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":993,"num_write_kb":63552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":124,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:51.747974+0000","last_change":"2024-09-22T03:49:17.032989+0000","last_active":"2024-09-22T03:55:51.747974+0000","last_peered":"2024-09-22T03:55:51.747974+0000","last_clean":"2024-09-22T03:55:51.747974+0000","last_became_active":"2024-09-22T03:49:15.079260+0000","last_became_peered":"2024-09-22T03:49:15.079260+0000","last_unstale":"2024-09-22T03:55:51.747974+0000","last_undegraded":"2024-09-22T03:55:51.747974+0000","last_fullsized":"2024-09-22T03:55:51.747974+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"52'1037","reported_seq":1049,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:57:10.925856+0000","last_change":"2024-09-22T03:55:50.862926+0000","last_active":"2024-09-22T03:57:10.925856+0000","last_peered":"2024-09-22T03:57:10.925856+0000","last_clean":"2024-09-22T03:57:10.925856+0000","last_became_active":"2024-09-22T03:55:50.851824+0000","last_became_peered":"2024-09-22T03:55:50.851824+0000","last_unstale":"2024-09-22T03:57:10.925856+0000","last_undegraded":"2024-09-22T03:57:10.925856+0000","last_fullsized":"2024-09-22T03:57:10.925856+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1037,"log_dups_size":0,"ondisk_log_size":1037,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67960832,"num_objects":1037,"num_object_clones":0,"num_object_copies":3111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1037,"num_write_kb":66368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":124,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:51.758850+0000","last_change":"2024-09-22T03:49:17.036402+0000","last_active":"2024-09-22T03:55:51.758850+0000","last_peered":"2024-09-22T03:55:51.758850+0000","last_clean":"2024-09-22T03:55:51.758850+0000","last_became_active":"2024-09-22T03:49:15.108430+0000","last_became_peered":"2024-09-22T03:49:15.108430+0000","last_unstale":"2024-09-22T03:55:51.758850+0000","last_undegraded":"2024-09-22T03:55:51.758850+0000","last_fullsized":"2024-09-22T03:55:51.758850+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"52'995","reported_seq":1007,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:57:09.924481+0000","last_change":"2024-09-22T03:55:50.878789+0000","last_active":"2024-09-22T03:57:09.924481+0000","last_peered":"2024-09-22T03:57:09.924481+0000","last_clean":"2024-09-22T03:57:09.924481+0000","last_became_active":"2024-09-22T03:55:50.852561+0000","last_became_peered":"2024-09-22T03:55:50.852561+0000","last_unstale":"2024-09-22T03:57:09.924481+0000","last_undegraded":"2024-09-22T03:57:09.924481+0000","last_fullsized":"2024-09-22T03:57:09.924481+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":995,"log_dups_size":0,"ondisk_log_size":995,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65208320,"num_objects":995,"num_object_clones":0,"num_object_copies":2985,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":995,"num_write_kb":63680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":124,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:51.744448+0000","last_change":"2024-09-22T03:49:17.029128+0000","last_active":"2024-09-22T03:55:51.744448+0000","last_peered":"2024-09-22T03:55:51.744448+0000","last_clean":"2024-09-22T03:55:51.744448+0000","last_became_active":"2024-09-22T03:49:15.113396+0000","last_became_peered":"2024-09-22T03:49:15.113396+0000","last_unstale":"2024-09-22T03:55:51.744448+0000","last_undegraded":"2024-09-22T03:55:51.744448+0000","last_fullsized":"2024-09-22T03:55:51.744448+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":1065418752,"num_objects":16257,"num_object_clones":0,"num_object_copies":48771,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16257,"num_write_kb":1040448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":199716864,"data_stored":3195469824,"data_compressed":151734675,"data_compressed_allocated":199716864,"data_compressed_original":3195469824,"omap_allocated":0,"internal_metadata":0},"log_size":16257,"ondisk_log_size":16257,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949673439,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":139144,"kb_used_data":41528,"kb_used_omap":0,"kb_used_meta":97600,"kb_avail":94232696,"statfs":{"total":96636764160,"available":96494280704,"internally_reserved":0,"allocated":42524672,"data_stored":673081728,"data_compressed":31955353,"data_compressed_allocated":42061824,"data_compressed_original":672907264,"omap_allocated":0,"internal_metadata":99942400},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654706143,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":133984,"kb_used_data":48848,"kb_used_omap":0,"kb_used_meta":85120,"kb_avail":94237856,"statfs":{"total":96636764160,"available":96499564544,"internally_reserved":0,"allocated":50020352,"data_stored":793405280,"data_compressed":37666814,"data_compressed_allocated":49577984,"data_compressed_original":793247744,"omap_allocated":0,"internal_metadata":87162880},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706142,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":133580,"kb_used_data":48444,"kb_used_omap":0,"kb_used_meta":85120,"kb_avail":94238260,"statfs":{"total":96636764160,"available":96499978240,"internally_reserved":0,"allocated":49606656,"data_stored":786393472,"data_compressed":37335900,"data_compressed_allocated":49143808,"data_compressed_original":786219008,"omap_allocated":0,"internal_metadata":87162880},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706143,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":150736,"kb_used_data":57280,"kb_used_omap":0,"kb_used_meta":93440,"kb_avail":94221104,"statfs":{"total":96636764160,"available":96482410496,"internally_reserved":0,"allocated":58654720,"data_stored":931228013,"data_compressed":44213256,"data_compressed_allocated":58195968,"data_compressed_original":931053568,"omap_allocated":0,"internal_metadata":95682560},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":58212352,"data_stored":931397632,"data_compressed":44226768,"data_compressed_allocated":58212352,"data_compressed_original":931397632,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":42098688,"data_stored":673579008,"data_compressed":31984425,"data_compressed_allocated":42098688,"data_compressed_original":673579008,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":49721344,"data_stored":795541504,"data_compressed":37775756,"data_compressed_allocated":49721344,"data_compressed_original":795541504,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49684480,"data_stored":794951680,"data_compressed":37747726,"data_compressed_allocated":49684480,"data_compressed_original":794951680,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:57:13.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:57:13.300+0000 7faa91591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:57:13.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:57:13.310+0000 7faa91591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:57:13.831 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 82 16 16919 16903 12.8821 11.625 0.0557012 0.0775819 2024-09-22T03:57:14.831 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 83 16 17108 17092 12.8692 11.8125 0.0590448 0.0776553 2024-09-22T03:57:15.832 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 84 16 17303 17287 12.861 12.1875 0.120392 0.0777118 2024-09-22T03:57:15.993 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:57:16.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:57:16.142+0000 7f5285b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:57:16.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:57:16.154+0000 7f528492f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:57:16.832 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 85 16 17475 17459 12.8362 10.75 0.100978 0.0778509 2024-09-22T03:57:17.832 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 86 16 17658 17642 12.8199 11.4375 0.101121 0.0779496 2024-09-22T03:57:18.258 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:57:18.259 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:57:18.259 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:57:18.259 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:57:18.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:57:18.423+0000 7f2e2cb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:57:18.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:57:18.442+0000 7f2e2cb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:57:18.637 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:57:18.637 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:57:18.638 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:57:18.638 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:57:18.638 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:57:18.638 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:57:18.638 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:57:18.638 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:57:18.638 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:57:18.638 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:57:18.638 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:57:18.638 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:57:18.642 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:57:18.642 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:57:18.642 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:57:18.704 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:57:18.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:57:18.808+0000 7f07d1d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:57:18.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:57:18.827+0000 7f07d1d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:57:18.832 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 87 16 17841 17825 12.804 11.4375 0.045201 0.0780251 2024-09-22T03:57:18.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:57:18.872+0000 7fd086ec8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:57:18.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:57:18.885+0000 7fd086ec8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:57:18.999 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:57:18.999 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:57:18.999 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:57:18.999 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:57:18.999 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:57:18.999 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:57:18.999 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:57:18.999 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:57:18.999 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:57:18.999 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:57:18.999 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:57:18.999 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:57:19.002 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:57:19.003 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:57:19.003 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:57:19.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:57:19.175+0000 7fa53c6c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:57:19.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:57:19.189+0000 7fa53c6c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:57:19.360 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:57:19.361 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:57:19.361 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:57:19.361 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:57:19.361 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:57:19.361 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:57:19.361 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:57:19.361 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:57:19.361 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:57:19.361 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:57:19.361 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:57:19.361 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:57:19.364 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:57:19.365 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:57:19.365 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:57:19.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:57:19.525+0000 7f1950148640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:57:19.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:57:19.540+0000 7f1950148640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:57:19.574 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:57:19.574 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:57:19.574 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:57:19.574 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:57:19.574 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:57:19.574 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:57:19.574 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:57:19.575 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:57:19.575 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:57:19.575 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:57:19.575 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:57:19.575 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:57:19.578 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:57:19.579 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:57:19.832 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 88 16 18021 18005 12.7863 11.25 0.101306 0.0781712 2024-09-22T03:57:20.833 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 89 16 18212 18196 12.7767 11.9375 0.0895646 0.0782254 2024-09-22T03:57:21.486 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:57:21.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:57:21.629+0000 7fa4a5f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:57:21.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:57:21.639+0000 7fa4a5f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:57:21.833 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 90 12 18391 18379 12.7618 11.4375 0.0626871 0.0783253 2024-09-22T03:57:22.833 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Total time run: 90.0597 2024-09-22T03:57:22.833 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Total writes made: 18391 2024-09-22T03:57:22.833 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Write size: 65536 2024-09-22T03:57:22.833 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Object size: 65536 2024-09-22T03:57:22.833 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Bandwidth (MB/sec): 12.7631 2024-09-22T03:57:22.833 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Stddev Bandwidth: 1.02495 2024-09-22T03:57:22.833 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Max bandwidth (MB/sec): 15 2024-09-22T03:57:22.834 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Min bandwidth (MB/sec): 10.75 2024-09-22T03:57:22.834 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Average IOPS: 204 2024-09-22T03:57:22.834 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Stddev IOPS: 16.3992 2024-09-22T03:57:22.834 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Max IOPS: 240 2024-09-22T03:57:22.834 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Min IOPS: 172 2024-09-22T03:57:22.834 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Average Latency(s): 0.07832 2024-09-22T03:57:22.834 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Stddev Latency(s): 0.0272189 2024-09-22T03:57:22.834 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Max latency(s): 0.229051 2024-09-22T03:57:22.834 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Min latency(s): 0.0157147 2024-09-22T03:57:22.861 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Cleaning up (deleting benchmark objects) 2024-09-22T03:57:23.949 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:57:24.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:57:24.126+0000 7f8cee591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:57:24.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:57:24.135+0000 7f8cee591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:57:24.580 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:57:24.580 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:57:24.581 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:57:24.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:57:24.746+0000 7fb3c307f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:57:24.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:57:24.760+0000 7fb3c307f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:57:25.033 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:57:25.034 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-22T03:57:25.059 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":292,"stamp":"2024-09-22T03:57:23.067961+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1188168243,"num_objects":18125,"num_object_clones":0,"num_object_copies":54375,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":18202,"num_write_kb":1160852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18176,"ondisk_log_size":18176,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":575672,"kb_used_data":218488,"kb_used_omap":0,"kb_used_meta":357120,"kb_avail":376911688,"statfs":{"total":386547056640,"available":385957568512,"internally_reserved":0,"allocated":223731712,"data_stored":3550913485,"data_compressed":168589187,"data_compressed_allocated":221904896,"data_compressed_original":3550232576,"omap_allocated":0,"internal_metadata":365690880},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":136904704,"num_objects":2089,"num_object_clones":0,"num_object_copies":6267,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2089,"num_write_kb":133696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002720"},"pg_stats":[{"pgid":"5.f","version":"52'1156","reported_seq":1168,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:57:20.980445+0000","last_change":"2024-09-22T03:55:50.938932+0000","last_active":"2024-09-22T03:57:20.980445+0000","last_peered":"2024-09-22T03:57:20.980445+0000","last_clean":"2024-09-22T03:57:20.980445+0000","last_became_active":"2024-09-22T03:55:50.929290+0000","last_became_peered":"2024-09-22T03:55:50.929290+0000","last_unstale":"2024-09-22T03:57:20.980445+0000","last_undegraded":"2024-09-22T03:57:20.980445+0000","last_fullsized":"2024-09-22T03:57:20.980445+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1156,"log_dups_size":0,"ondisk_log_size":1156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75759616,"num_objects":1156,"num_object_clones":0,"num_object_copies":3468,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1156,"num_write_kb":73984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"52'1124","reported_seq":1136,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:57:20.040484+0000","last_change":"2024-09-22T03:55:50.848180+0000","last_active":"2024-09-22T03:57:20.040484+0000","last_peered":"2024-09-22T03:57:20.040484+0000","last_clean":"2024-09-22T03:57:20.040484+0000","last_became_active":"2024-09-22T03:55:50.838302+0000","last_became_peered":"2024-09-22T03:55:50.838302+0000","last_unstale":"2024-09-22T03:57:20.040484+0000","last_undegraded":"2024-09-22T03:57:20.040484+0000","last_fullsized":"2024-09-22T03:57:20.040484+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1124,"log_dups_size":0,"ondisk_log_size":1124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":73662464,"num_objects":1124,"num_object_clones":0,"num_object_copies":3372,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1124,"num_write_kb":71936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"52'1166","reported_seq":1178,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:57:19.990912+0000","last_change":"2024-09-22T03:55:50.872362+0000","last_active":"2024-09-22T03:57:19.990912+0000","last_peered":"2024-09-22T03:57:19.990912+0000","last_clean":"2024-09-22T03:57:19.990912+0000","last_became_active":"2024-09-22T03:55:50.867322+0000","last_became_peered":"2024-09-22T03:55:50.867322+0000","last_unstale":"2024-09-22T03:57:19.990912+0000","last_undegraded":"2024-09-22T03:57:19.990912+0000","last_fullsized":"2024-09-22T03:57:19.990912+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1166,"log_dups_size":0,"ondisk_log_size":1166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":76414976,"num_objects":1166,"num_object_clones":0,"num_object_copies":3498,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1166,"num_write_kb":74624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"52'1169","reported_seq":1181,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:57:21.047246+0000","last_change":"2024-09-22T03:55:50.942624+0000","last_active":"2024-09-22T03:57:21.047246+0000","last_peered":"2024-09-22T03:57:21.047246+0000","last_clean":"2024-09-22T03:57:21.047246+0000","last_became_active":"2024-09-22T03:55:50.922812+0000","last_became_peered":"2024-09-22T03:55:50.922812+0000","last_unstale":"2024-09-22T03:57:21.047246+0000","last_undegraded":"2024-09-22T03:57:21.047246+0000","last_fullsized":"2024-09-22T03:57:21.047246+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1169,"log_dups_size":0,"ondisk_log_size":1169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":76611584,"num_objects":1169,"num_object_clones":0,"num_object_copies":3507,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1169,"num_write_kb":74816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"52'1091","reported_seq":1103,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:57:19.864319+0000","last_change":"2024-09-22T03:55:50.890353+0000","last_active":"2024-09-22T03:57:19.864319+0000","last_peered":"2024-09-22T03:57:19.864319+0000","last_clean":"2024-09-22T03:57:19.864319+0000","last_became_active":"2024-09-22T03:55:50.882633+0000","last_became_peered":"2024-09-22T03:55:50.882633+0000","last_unstale":"2024-09-22T03:57:19.864319+0000","last_undegraded":"2024-09-22T03:57:19.864319+0000","last_fullsized":"2024-09-22T03:57:19.864319+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1091,"log_dups_size":0,"ondisk_log_size":1091,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71499776,"num_objects":1091,"num_object_clones":0,"num_object_copies":3273,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1091,"num_write_kb":69824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.a","version":"52'1127","reported_seq":1139,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:57:19.740233+0000","last_change":"2024-09-22T03:55:50.891052+0000","last_active":"2024-09-22T03:57:19.740233+0000","last_peered":"2024-09-22T03:57:19.740233+0000","last_clean":"2024-09-22T03:57:19.740233+0000","last_became_active":"2024-09-22T03:55:50.880295+0000","last_became_peered":"2024-09-22T03:55:50.880295+0000","last_unstale":"2024-09-22T03:57:19.740233+0000","last_undegraded":"2024-09-22T03:57:19.740233+0000","last_fullsized":"2024-09-22T03:57:19.740233+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1127,"log_dups_size":0,"ondisk_log_size":1127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":73859072,"num_objects":1127,"num_object_clones":0,"num_object_copies":3381,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1127,"num_write_kb":72128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"52'1137","reported_seq":1149,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:57:20.081350+0000","last_change":"2024-09-22T03:55:50.906894+0000","last_active":"2024-09-22T03:57:20.081350+0000","last_peered":"2024-09-22T03:57:20.081350+0000","last_clean":"2024-09-22T03:57:20.081350+0000","last_became_active":"2024-09-22T03:55:50.896899+0000","last_became_peered":"2024-09-22T03:55:50.896899+0000","last_unstale":"2024-09-22T03:57:20.081350+0000","last_undegraded":"2024-09-22T03:57:20.081350+0000","last_fullsized":"2024-09-22T03:57:20.081350+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1137,"log_dups_size":0,"ondisk_log_size":1137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74514432,"num_objects":1137,"num_object_clones":0,"num_object_copies":3411,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1137,"num_write_kb":72768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"52'1112","reported_seq":1124,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:57:19.967599+0000","last_change":"2024-09-22T03:55:50.859578+0000","last_active":"2024-09-22T03:57:19.967599+0000","last_peered":"2024-09-22T03:57:19.967599+0000","last_clean":"2024-09-22T03:57:19.967599+0000","last_became_active":"2024-09-22T03:55:50.843710+0000","last_became_peered":"2024-09-22T03:55:50.843710+0000","last_unstale":"2024-09-22T03:57:19.967599+0000","last_undegraded":"2024-09-22T03:57:19.967599+0000","last_fullsized":"2024-09-22T03:57:19.967599+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1112,"log_dups_size":0,"ondisk_log_size":1112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72876032,"num_objects":1112,"num_object_clones":0,"num_object_copies":3336,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1112,"num_write_kb":71168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"52'1163","reported_seq":1175,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:57:19.929888+0000","last_change":"2024-09-22T03:55:50.968411+0000","last_active":"2024-09-22T03:57:19.929888+0000","last_peered":"2024-09-22T03:57:19.929888+0000","last_clean":"2024-09-22T03:57:19.929888+0000","last_became_active":"2024-09-22T03:55:50.961718+0000","last_became_peered":"2024-09-22T03:55:50.961718+0000","last_unstale":"2024-09-22T03:57:19.929888+0000","last_undegraded":"2024-09-22T03:57:19.929888+0000","last_fullsized":"2024-09-22T03:57:19.929888+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1163,"log_dups_size":0,"ondisk_log_size":1163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":76218368,"num_objects":1163,"num_object_clones":0,"num_object_copies":3489,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1163,"num_write_kb":74432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":199,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:51.749469+0000","last_change":"2024-09-22T03:49:12.034704+0000","last_active":"2024-09-22T03:55:51.749469+0000","last_peered":"2024-09-22T03:55:51.749469+0000","last_clean":"2024-09-22T03:55:51.749469+0000","last_became_active":"2024-09-22T03:49:12.027470+0000","last_became_peered":"2024-09-22T03:49:12.027470+0000","last_unstale":"2024-09-22T03:55:51.749469+0000","last_undegraded":"2024-09-22T03:55:51.749469+0000","last_fullsized":"2024-09-22T03:55:51.749469+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_clean_scrub_stamp":"2024-09-22T03:49:10.979949+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":125,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:51.750162+0000","last_change":"2024-09-22T03:49:17.031458+0000","last_active":"2024-09-22T03:55:51.750162+0000","last_peered":"2024-09-22T03:55:51.750162+0000","last_clean":"2024-09-22T03:55:51.750162+0000","last_became_active":"2024-09-22T03:49:15.125490+0000","last_became_peered":"2024-09-22T03:49:15.125490+0000","last_unstale":"2024-09-22T03:55:51.750162+0000","last_undegraded":"2024-09-22T03:55:51.750162+0000","last_fullsized":"2024-09-22T03:55:51.750162+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.7","version":"52'1136","reported_seq":1148,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:57:19.917962+0000","last_change":"2024-09-22T03:55:50.910597+0000","last_active":"2024-09-22T03:57:19.917962+0000","last_peered":"2024-09-22T03:57:19.917962+0000","last_clean":"2024-09-22T03:57:19.917962+0000","last_became_active":"2024-09-22T03:55:50.901290+0000","last_became_peered":"2024-09-22T03:55:50.901290+0000","last_unstale":"2024-09-22T03:57:19.917962+0000","last_undegraded":"2024-09-22T03:57:19.917962+0000","last_fullsized":"2024-09-22T03:57:19.917962+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1136,"log_dups_size":0,"ondisk_log_size":1136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74448896,"num_objects":1136,"num_object_clones":0,"num_object_copies":3408,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1136,"num_write_kb":72704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":124,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:51.742303+0000","last_change":"2024-09-22T03:49:17.029339+0000","last_active":"2024-09-22T03:55:51.742303+0000","last_peered":"2024-09-22T03:55:51.742303+0000","last_clean":"2024-09-22T03:55:51.742303+0000","last_became_active":"2024-09-22T03:49:15.097304+0000","last_became_peered":"2024-09-22T03:49:15.097304+0000","last_unstale":"2024-09-22T03:55:51.742303+0000","last_undegraded":"2024-09-22T03:55:51.742303+0000","last_fullsized":"2024-09-22T03:55:51.742303+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"52'1124","reported_seq":1136,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:57:20.911353+0000","last_change":"2024-09-22T03:55:50.918358+0000","last_active":"2024-09-22T03:57:20.911353+0000","last_peered":"2024-09-22T03:57:20.911353+0000","last_clean":"2024-09-22T03:57:20.911353+0000","last_became_active":"2024-09-22T03:55:50.889906+0000","last_became_peered":"2024-09-22T03:55:50.889906+0000","last_unstale":"2024-09-22T03:57:20.911353+0000","last_undegraded":"2024-09-22T03:57:20.911353+0000","last_fullsized":"2024-09-22T03:57:20.911353+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1124,"log_dups_size":0,"ondisk_log_size":1124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":73662464,"num_objects":1124,"num_object_clones":0,"num_object_copies":3372,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1124,"num_write_kb":71936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":124,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:51.751861+0000","last_change":"2024-09-22T03:49:17.029349+0000","last_active":"2024-09-22T03:55:51.751861+0000","last_peered":"2024-09-22T03:55:51.751861+0000","last_clean":"2024-09-22T03:55:51.751861+0000","last_became_active":"2024-09-22T03:49:15.094890+0000","last_became_peered":"2024-09-22T03:49:15.094890+0000","last_unstale":"2024-09-22T03:55:51.751861+0000","last_undegraded":"2024-09-22T03:55:51.751861+0000","last_fullsized":"2024-09-22T03:55:51.751861+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"52'1143","reported_seq":1155,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:57:20.142893+0000","last_change":"2024-09-22T03:55:50.939050+0000","last_active":"2024-09-22T03:57:20.142893+0000","last_peered":"2024-09-22T03:57:20.142893+0000","last_clean":"2024-09-22T03:57:20.142893+0000","last_became_active":"2024-09-22T03:55:50.929831+0000","last_became_peered":"2024-09-22T03:55:50.929831+0000","last_unstale":"2024-09-22T03:57:20.142893+0000","last_undegraded":"2024-09-22T03:57:20.142893+0000","last_fullsized":"2024-09-22T03:57:20.142893+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1143,"log_dups_size":0,"ondisk_log_size":1143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74907648,"num_objects":1143,"num_object_clones":0,"num_object_copies":3429,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1143,"num_write_kb":73152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":126,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:51.749244+0000","last_change":"2024-09-22T03:49:17.031466+0000","last_active":"2024-09-22T03:55:51.749244+0000","last_peered":"2024-09-22T03:55:51.749244+0000","last_clean":"2024-09-22T03:55:51.749244+0000","last_became_active":"2024-09-22T03:49:15.098420+0000","last_became_peered":"2024-09-22T03:49:15.098420+0000","last_unstale":"2024-09-22T03:55:51.749244+0000","last_undegraded":"2024-09-22T03:55:51.749244+0000","last_fullsized":"2024-09-22T03:55:51.749244+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3","version":"52'1100","reported_seq":1112,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:57:20.089550+0000","last_change":"2024-09-22T03:55:50.862956+0000","last_active":"2024-09-22T03:57:20.089550+0000","last_peered":"2024-09-22T03:57:20.089550+0000","last_clean":"2024-09-22T03:57:20.089550+0000","last_became_active":"2024-09-22T03:55:50.854828+0000","last_became_peered":"2024-09-22T03:55:50.854828+0000","last_unstale":"2024-09-22T03:57:20.089550+0000","last_undegraded":"2024-09-22T03:57:20.089550+0000","last_fullsized":"2024-09-22T03:57:20.089550+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1100,"log_dups_size":0,"ondisk_log_size":1100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72089600,"num_objects":1100,"num_object_clones":0,"num_object_copies":3300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1100,"num_write_kb":70400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":124,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:51.754967+0000","last_change":"2024-09-22T03:49:17.036954+0000","last_active":"2024-09-22T03:55:51.754967+0000","last_peered":"2024-09-22T03:55:51.754967+0000","last_clean":"2024-09-22T03:55:51.754967+0000","last_became_active":"2024-09-22T03:49:15.110506+0000","last_became_peered":"2024-09-22T03:49:15.110506+0000","last_unstale":"2024-09-22T03:55:51.754967+0000","last_undegraded":"2024-09-22T03:55:51.754967+0000","last_fullsized":"2024-09-22T03:55:51.754967+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"52'1110","reported_seq":1122,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:57:20.009839+0000","last_change":"2024-09-22T03:55:50.927264+0000","last_active":"2024-09-22T03:57:20.009839+0000","last_peered":"2024-09-22T03:57:20.009839+0000","last_clean":"2024-09-22T03:57:20.009839+0000","last_became_active":"2024-09-22T03:55:50.919600+0000","last_became_peered":"2024-09-22T03:55:50.919600+0000","last_unstale":"2024-09-22T03:57:20.009839+0000","last_undegraded":"2024-09-22T03:57:20.009839+0000","last_fullsized":"2024-09-22T03:57:20.009839+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1110,"log_dups_size":0,"ondisk_log_size":1110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72744960,"num_objects":1110,"num_object_clones":0,"num_object_copies":3330,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1110,"num_write_kb":71040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":124,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:51.747974+0000","last_change":"2024-09-22T03:49:17.032989+0000","last_active":"2024-09-22T03:55:51.747974+0000","last_peered":"2024-09-22T03:55:51.747974+0000","last_clean":"2024-09-22T03:55:51.747974+0000","last_became_active":"2024-09-22T03:49:15.079260+0000","last_became_peered":"2024-09-22T03:49:15.079260+0000","last_unstale":"2024-09-22T03:55:51.747974+0000","last_undegraded":"2024-09-22T03:55:51.747974+0000","last_fullsized":"2024-09-22T03:55:51.747974+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"52'1151","reported_seq":1163,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:57:21.147286+0000","last_change":"2024-09-22T03:55:50.862926+0000","last_active":"2024-09-22T03:57:21.147286+0000","last_peered":"2024-09-22T03:57:21.147286+0000","last_clean":"2024-09-22T03:57:21.147286+0000","last_became_active":"2024-09-22T03:55:50.851824+0000","last_became_peered":"2024-09-22T03:55:50.851824+0000","last_unstale":"2024-09-22T03:57:21.147286+0000","last_undegraded":"2024-09-22T03:57:21.147286+0000","last_fullsized":"2024-09-22T03:57:21.147286+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1151,"log_dups_size":0,"ondisk_log_size":1151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75431936,"num_objects":1151,"num_object_clones":0,"num_object_copies":3453,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1151,"num_write_kb":73664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":124,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:51.758850+0000","last_change":"2024-09-22T03:49:17.036402+0000","last_active":"2024-09-22T03:55:51.758850+0000","last_peered":"2024-09-22T03:55:51.758850+0000","last_clean":"2024-09-22T03:55:51.758850+0000","last_became_active":"2024-09-22T03:49:15.108430+0000","last_became_peered":"2024-09-22T03:49:15.108430+0000","last_unstale":"2024-09-22T03:55:51.758850+0000","last_undegraded":"2024-09-22T03:55:51.758850+0000","last_fullsized":"2024-09-22T03:55:51.758850+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"52'1112","reported_seq":1124,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:57:20.057714+0000","last_change":"2024-09-22T03:55:50.878789+0000","last_active":"2024-09-22T03:57:20.057714+0000","last_peered":"2024-09-22T03:57:20.057714+0000","last_clean":"2024-09-22T03:57:20.057714+0000","last_became_active":"2024-09-22T03:55:50.852561+0000","last_became_peered":"2024-09-22T03:55:50.852561+0000","last_unstale":"2024-09-22T03:57:20.057714+0000","last_undegraded":"2024-09-22T03:57:20.057714+0000","last_fullsized":"2024-09-22T03:57:20.057714+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1112,"log_dups_size":0,"ondisk_log_size":1112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72876032,"num_objects":1112,"num_object_clones":0,"num_object_copies":3336,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1112,"num_write_kb":71168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":124,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:51.744448+0000","last_change":"2024-09-22T03:49:17.029128+0000","last_active":"2024-09-22T03:55:51.744448+0000","last_peered":"2024-09-22T03:55:51.744448+0000","last_clean":"2024-09-22T03:55:51.744448+0000","last_became_active":"2024-09-22T03:49:15.113396+0000","last_became_peered":"2024-09-22T03:49:15.113396+0000","last_unstale":"2024-09-22T03:55:51.744448+0000","last_undegraded":"2024-09-22T03:55:51.744448+0000","last_fullsized":"2024-09-22T03:55:51.744448+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":1187577856,"num_objects":18121,"num_object_clones":0,"num_object_copies":54363,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18121,"num_write_kb":1159744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":222588928,"data_stored":3561422848,"data_compressed":169112083,"data_compressed_allocated":222588928,"data_compressed_original":3561422848,"omap_allocated":0,"internal_metadata":0},"log_size":18121,"ondisk_log_size":18121,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949673449,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":131392,"kb_used_data":46256,"kb_used_omap":0,"kb_used_meta":85120,"kb_avail":94240448,"statfs":{"total":96636764160,"available":96502218752,"internally_reserved":0,"allocated":47366144,"data_stored":750545280,"data_compressed":35633737,"data_compressed_allocated":46903296,"data_compressed_original":750370816,"omap_allocated":0,"internal_metadata":87162880},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654706153,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":147840,"kb_used_data":54384,"kb_used_omap":0,"kb_used_meta":93440,"kb_avail":94224000,"statfs":{"total":96636764160,"available":96485376000,"internally_reserved":0,"allocated":55689216,"data_stored":884107104,"data_compressed":41973822,"data_compressed_allocated":55246848,"data_compressed_original":883949568,"omap_allocated":0,"internal_metadata":95682560},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706152,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":147536,"kb_used_data":54080,"kb_used_omap":0,"kb_used_meta":93440,"kb_avail":94224304,"statfs":{"total":96636764160,"available":96485687296,"internally_reserved":0,"allocated":55377920,"data_stored":878733696,"data_compressed":41720708,"data_compressed_allocated":54915072,"data_compressed_original":878559232,"omap_allocated":0,"internal_metadata":95682560},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706153,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":148904,"kb_used_data":63768,"kb_used_omap":0,"kb_used_meta":85120,"kb_avail":94222936,"statfs":{"total":96636764160,"available":96484286464,"internally_reserved":0,"allocated":65298432,"data_stored":1037527405,"data_compressed":49260920,"data_compressed_allocated":64839680,"data_compressed_original":1037352960,"omap_allocated":0,"internal_metadata":87162880},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":64835584,"data_stored":1037369344,"data_compressed":49258872,"data_compressed_allocated":64835584,"data_compressed_original":1037369344,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":46927872,"data_stored":750845952,"data_compressed":35653473,"data_compressed_allocated":46927872,"data_compressed_original":750845952,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55476224,"data_stored":887619584,"data_compressed":42148116,"data_compressed_allocated":55476224,"data_compressed_original":887619584,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":55349248,"data_stored":885587968,"data_compressed":42051622,"data_compressed_allocated":55349248,"data_compressed_original":885587968,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:57:26.661 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:57:26.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:57:26.828+0000 7f7f4e191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:57:26.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:57:26.836+0000 7f7f4e191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:57:29.281 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:57:29.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:57:29.446+0000 7f6bfd657640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:57:29.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:57:29.457+0000 7f6bfd657640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:57:30.061 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:57:30.061 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:57:30.062 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:57:30.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:57:30.224+0000 7f432bca3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:57:30.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:57:30.238+0000 7f432bca3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:57:30.626 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:57:30.627 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-22T03:57:30.645 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":295,"stamp":"2024-09-22T03:57:29.069287+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1171522123,"num_objects":17872,"num_object_clones":0,"num_object_copies":53616,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":18997,"num_write_kb":1178133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18971,"ondisk_log_size":18971,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":574376,"kb_used_data":217192,"kb_used_omap":0,"kb_used_meta":357120,"kb_avail":376912984,"statfs":{"total":386547056640,"available":385958895616,"internally_reserved":0,"allocated":222404608,"data_stored":3529483285,"data_compressed":167573247,"data_compressed_allocated":220565504,"data_compressed_original":3528802304,"omap_allocated":0,"internal_metadata":365690880},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":42663960,"num_objects":652,"num_object_clones":0,"num_object_copies":1956,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1700,"num_write_kb":75201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002697"},"pg_stats":[{"pgid":"5.f","version":"52'1201","reported_seq":1213,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:57:26.181900+0000","last_change":"2024-09-22T03:55:50.938932+0000","last_active":"2024-09-22T03:57:26.181900+0000","last_peered":"2024-09-22T03:57:26.181900+0000","last_clean":"2024-09-22T03:57:26.181900+0000","last_became_active":"2024-09-22T03:55:50.929290+0000","last_became_peered":"2024-09-22T03:55:50.929290+0000","last_unstale":"2024-09-22T03:57:26.181900+0000","last_undegraded":"2024-09-22T03:57:26.181900+0000","last_fullsized":"2024-09-22T03:57:26.181900+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1201,"log_dups_size":0,"ondisk_log_size":1201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":73334784,"num_objects":1119,"num_object_clones":0,"num_object_copies":3357,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1201,"num_write_kb":74240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"52'1164","reported_seq":1176,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:57:24.793299+0000","last_change":"2024-09-22T03:55:50.848180+0000","last_active":"2024-09-22T03:57:24.793299+0000","last_peered":"2024-09-22T03:57:24.793299+0000","last_clean":"2024-09-22T03:57:24.793299+0000","last_became_active":"2024-09-22T03:55:50.838302+0000","last_became_peered":"2024-09-22T03:55:50.838302+0000","last_unstale":"2024-09-22T03:57:24.793299+0000","last_undegraded":"2024-09-22T03:57:24.793299+0000","last_fullsized":"2024-09-22T03:57:24.793299+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1164,"log_dups_size":0,"ondisk_log_size":1164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":73269248,"num_objects":1118,"num_object_clones":0,"num_object_copies":3354,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1164,"num_write_kb":73024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"52'1215","reported_seq":1228,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:57:24.979819+0000","last_change":"2024-09-22T03:55:50.872362+0000","last_active":"2024-09-22T03:57:24.979819+0000","last_peered":"2024-09-22T03:57:24.979819+0000","last_clean":"2024-09-22T03:57:24.979819+0000","last_became_active":"2024-09-22T03:55:50.867322+0000","last_became_peered":"2024-09-22T03:55:50.867322+0000","last_unstale":"2024-09-22T03:57:24.979819+0000","last_undegraded":"2024-09-22T03:57:24.979819+0000","last_fullsized":"2024-09-22T03:57:24.979819+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1215,"log_dups_size":0,"ondisk_log_size":1215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":76283928,"num_objects":1165,"num_object_clones":0,"num_object_copies":3495,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1215,"num_write_kb":76097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"52'1217","reported_seq":1229,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:57:26.061573+0000","last_change":"2024-09-22T03:55:50.942624+0000","last_active":"2024-09-22T03:57:26.061573+0000","last_peered":"2024-09-22T03:57:26.061573+0000","last_clean":"2024-09-22T03:57:26.061573+0000","last_became_active":"2024-09-22T03:55:50.922812+0000","last_became_peered":"2024-09-22T03:55:50.922812+0000","last_unstale":"2024-09-22T03:57:26.061573+0000","last_undegraded":"2024-09-22T03:57:26.061573+0000","last_fullsized":"2024-09-22T03:57:26.061573+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1217,"log_dups_size":0,"ondisk_log_size":1217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74252288,"num_objects":1133,"num_object_clones":0,"num_object_copies":3399,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1217,"num_write_kb":75200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"52'1132","reported_seq":1144,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:57:24.936133+0000","last_change":"2024-09-22T03:55:50.890353+0000","last_active":"2024-09-22T03:57:24.936133+0000","last_peered":"2024-09-22T03:57:24.936133+0000","last_clean":"2024-09-22T03:57:24.936133+0000","last_became_active":"2024-09-22T03:55:50.882633+0000","last_became_peered":"2024-09-22T03:55:50.882633+0000","last_unstale":"2024-09-22T03:57:24.936133+0000","last_undegraded":"2024-09-22T03:57:24.936133+0000","last_fullsized":"2024-09-22T03:57:24.936133+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1132,"log_dups_size":0,"ondisk_log_size":1132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":1088,"num_object_clones":0,"num_object_copies":3264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1132,"num_write_kb":71040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.a","version":"52'1181","reported_seq":1193,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:57:25.074148+0000","last_change":"2024-09-22T03:55:50.891052+0000","last_active":"2024-09-22T03:57:25.074148+0000","last_peered":"2024-09-22T03:57:25.074148+0000","last_clean":"2024-09-22T03:57:25.074148+0000","last_became_active":"2024-09-22T03:55:50.880295+0000","last_became_peered":"2024-09-22T03:55:50.880295+0000","last_unstale":"2024-09-22T03:57:25.074148+0000","last_undegraded":"2024-09-22T03:57:25.074148+0000","last_fullsized":"2024-09-22T03:57:25.074148+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1181,"log_dups_size":0,"ondisk_log_size":1181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":73728000,"num_objects":1125,"num_object_clones":0,"num_object_copies":3375,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1181,"num_write_kb":73792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"52'1182","reported_seq":1194,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:57:25.054647+0000","last_change":"2024-09-22T03:55:50.906894+0000","last_active":"2024-09-22T03:57:25.054647+0000","last_peered":"2024-09-22T03:57:25.054647+0000","last_clean":"2024-09-22T03:57:25.054647+0000","last_became_active":"2024-09-22T03:55:50.896899+0000","last_became_peered":"2024-09-22T03:55:50.896899+0000","last_unstale":"2024-09-22T03:57:25.054647+0000","last_undegraded":"2024-09-22T03:57:25.054647+0000","last_fullsized":"2024-09-22T03:57:25.054647+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1182,"log_dups_size":0,"ondisk_log_size":1182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74186752,"num_objects":1132,"num_object_clones":0,"num_object_copies":3396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1182,"num_write_kb":74048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"52'1171","reported_seq":1183,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:57:25.046577+0000","last_change":"2024-09-22T03:55:50.859578+0000","last_active":"2024-09-22T03:57:25.046577+0000","last_peered":"2024-09-22T03:57:25.046577+0000","last_clean":"2024-09-22T03:57:25.046577+0000","last_became_active":"2024-09-22T03:55:50.843710+0000","last_became_peered":"2024-09-22T03:55:50.843710+0000","last_unstale":"2024-09-22T03:57:25.046577+0000","last_undegraded":"2024-09-22T03:57:25.046577+0000","last_fullsized":"2024-09-22T03:57:25.046577+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1171,"log_dups_size":0,"ondisk_log_size":1171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72155136,"num_objects":1101,"num_object_clones":0,"num_object_copies":3303,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1171,"num_write_kb":72704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"52'1215","reported_seq":1227,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:57:25.021932+0000","last_change":"2024-09-22T03:55:50.968411+0000","last_active":"2024-09-22T03:57:25.021932+0000","last_peered":"2024-09-22T03:57:25.021932+0000","last_clean":"2024-09-22T03:57:25.021932+0000","last_became_active":"2024-09-22T03:55:50.961718+0000","last_became_peered":"2024-09-22T03:55:50.961718+0000","last_unstale":"2024-09-22T03:57:25.021932+0000","last_undegraded":"2024-09-22T03:57:25.021932+0000","last_fullsized":"2024-09-22T03:57:25.021932+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1215,"log_dups_size":0,"ondisk_log_size":1215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75038720,"num_objects":1145,"num_object_clones":0,"num_object_copies":3435,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1215,"num_write_kb":75520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":199,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:51.749469+0000","last_change":"2024-09-22T03:49:12.034704+0000","last_active":"2024-09-22T03:55:51.749469+0000","last_peered":"2024-09-22T03:55:51.749469+0000","last_clean":"2024-09-22T03:55:51.749469+0000","last_became_active":"2024-09-22T03:49:12.027470+0000","last_became_peered":"2024-09-22T03:49:12.027470+0000","last_unstale":"2024-09-22T03:55:51.749469+0000","last_undegraded":"2024-09-22T03:55:51.749469+0000","last_fullsized":"2024-09-22T03:55:51.749469+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_clean_scrub_stamp":"2024-09-22T03:49:10.979949+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":125,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:51.750162+0000","last_change":"2024-09-22T03:49:17.031458+0000","last_active":"2024-09-22T03:55:51.750162+0000","last_peered":"2024-09-22T03:55:51.750162+0000","last_clean":"2024-09-22T03:55:51.750162+0000","last_became_active":"2024-09-22T03:49:15.125490+0000","last_became_peered":"2024-09-22T03:49:15.125490+0000","last_unstale":"2024-09-22T03:55:51.750162+0000","last_undegraded":"2024-09-22T03:55:51.750162+0000","last_fullsized":"2024-09-22T03:55:51.750162+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.7","version":"52'1180","reported_seq":1192,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:57:25.023897+0000","last_change":"2024-09-22T03:55:50.910597+0000","last_active":"2024-09-22T03:57:25.023897+0000","last_peered":"2024-09-22T03:57:25.023897+0000","last_clean":"2024-09-22T03:57:25.023897+0000","last_became_active":"2024-09-22T03:55:50.901290+0000","last_became_peered":"2024-09-22T03:55:50.901290+0000","last_unstale":"2024-09-22T03:57:25.023897+0000","last_undegraded":"2024-09-22T03:57:25.023897+0000","last_fullsized":"2024-09-22T03:57:25.023897+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1180,"log_dups_size":0,"ondisk_log_size":1180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":73924608,"num_objects":1128,"num_object_clones":0,"num_object_copies":3384,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1180,"num_write_kb":73856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":124,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:51.742303+0000","last_change":"2024-09-22T03:49:17.029339+0000","last_active":"2024-09-22T03:55:51.742303+0000","last_peered":"2024-09-22T03:55:51.742303+0000","last_clean":"2024-09-22T03:55:51.742303+0000","last_became_active":"2024-09-22T03:49:15.097304+0000","last_became_peered":"2024-09-22T03:49:15.097304+0000","last_unstale":"2024-09-22T03:55:51.742303+0000","last_undegraded":"2024-09-22T03:55:51.742303+0000","last_fullsized":"2024-09-22T03:55:51.742303+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"52'1167","reported_seq":1179,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:57:26.155506+0000","last_change":"2024-09-22T03:55:50.918358+0000","last_active":"2024-09-22T03:57:26.155506+0000","last_peered":"2024-09-22T03:57:26.155506+0000","last_clean":"2024-09-22T03:57:26.155506+0000","last_became_active":"2024-09-22T03:55:50.889906+0000","last_became_peered":"2024-09-22T03:55:50.889906+0000","last_unstale":"2024-09-22T03:57:26.155506+0000","last_undegraded":"2024-09-22T03:57:26.155506+0000","last_fullsized":"2024-09-22T03:57:26.155506+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1167,"log_dups_size":0,"ondisk_log_size":1167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71499776,"num_objects":1091,"num_object_clones":0,"num_object_copies":3273,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1167,"num_write_kb":72256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":124,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:51.751861+0000","last_change":"2024-09-22T03:49:17.029349+0000","last_active":"2024-09-22T03:55:51.751861+0000","last_peered":"2024-09-22T03:55:51.751861+0000","last_clean":"2024-09-22T03:55:51.751861+0000","last_became_active":"2024-09-22T03:49:15.094890+0000","last_became_peered":"2024-09-22T03:49:15.094890+0000","last_unstale":"2024-09-22T03:55:51.751861+0000","last_undegraded":"2024-09-22T03:55:51.751861+0000","last_fullsized":"2024-09-22T03:55:51.751861+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"52'1197","reported_seq":1209,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:57:25.035813+0000","last_change":"2024-09-22T03:55:50.939050+0000","last_active":"2024-09-22T03:57:25.035813+0000","last_peered":"2024-09-22T03:57:25.035813+0000","last_clean":"2024-09-22T03:57:25.035813+0000","last_became_active":"2024-09-22T03:55:50.929831+0000","last_became_peered":"2024-09-22T03:55:50.929831+0000","last_unstale":"2024-09-22T03:57:25.035813+0000","last_undegraded":"2024-09-22T03:57:25.035813+0000","last_fullsized":"2024-09-22T03:57:25.035813+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1197,"log_dups_size":0,"ondisk_log_size":1197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":73072640,"num_objects":1115,"num_object_clones":0,"num_object_copies":3345,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1197,"num_write_kb":73984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":126,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:51.749244+0000","last_change":"2024-09-22T03:49:17.031466+0000","last_active":"2024-09-22T03:55:51.749244+0000","last_peered":"2024-09-22T03:55:51.749244+0000","last_clean":"2024-09-22T03:55:51.749244+0000","last_became_active":"2024-09-22T03:49:15.098420+0000","last_became_peered":"2024-09-22T03:49:15.098420+0000","last_unstale":"2024-09-22T03:55:51.749244+0000","last_undegraded":"2024-09-22T03:55:51.749244+0000","last_fullsized":"2024-09-22T03:55:51.749244+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3","version":"52'1155","reported_seq":1167,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:57:25.065687+0000","last_change":"2024-09-22T03:55:50.862956+0000","last_active":"2024-09-22T03:57:25.065687+0000","last_peered":"2024-09-22T03:57:25.065687+0000","last_clean":"2024-09-22T03:57:25.065687+0000","last_became_active":"2024-09-22T03:55:50.854828+0000","last_became_peered":"2024-09-22T03:55:50.854828+0000","last_unstale":"2024-09-22T03:57:25.065687+0000","last_undegraded":"2024-09-22T03:57:25.065687+0000","last_fullsized":"2024-09-22T03:57:25.065687+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1155,"log_dups_size":0,"ondisk_log_size":1155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70975488,"num_objects":1083,"num_object_clones":0,"num_object_copies":3249,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1155,"num_write_kb":71616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":124,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:51.754967+0000","last_change":"2024-09-22T03:49:17.036954+0000","last_active":"2024-09-22T03:55:51.754967+0000","last_peered":"2024-09-22T03:55:51.754967+0000","last_clean":"2024-09-22T03:55:51.754967+0000","last_became_active":"2024-09-22T03:49:15.110506+0000","last_became_peered":"2024-09-22T03:49:15.110506+0000","last_unstale":"2024-09-22T03:55:51.754967+0000","last_undegraded":"2024-09-22T03:55:51.754967+0000","last_fullsized":"2024-09-22T03:55:51.754967+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"52'1168","reported_seq":1180,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:57:24.316636+0000","last_change":"2024-09-22T03:55:50.927264+0000","last_active":"2024-09-22T03:57:24.316636+0000","last_peered":"2024-09-22T03:57:24.316636+0000","last_clean":"2024-09-22T03:57:24.316636+0000","last_became_active":"2024-09-22T03:55:50.919600+0000","last_became_peered":"2024-09-22T03:55:50.919600+0000","last_unstale":"2024-09-22T03:57:24.316636+0000","last_undegraded":"2024-09-22T03:57:24.316636+0000","last_fullsized":"2024-09-22T03:57:24.316636+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1168,"log_dups_size":0,"ondisk_log_size":1168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71958528,"num_objects":1098,"num_object_clones":0,"num_object_copies":3294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1168,"num_write_kb":72512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":124,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:51.747974+0000","last_change":"2024-09-22T03:49:17.032989+0000","last_active":"2024-09-22T03:55:51.747974+0000","last_peered":"2024-09-22T03:55:51.747974+0000","last_clean":"2024-09-22T03:55:51.747974+0000","last_became_active":"2024-09-22T03:49:15.079260+0000","last_became_peered":"2024-09-22T03:49:15.079260+0000","last_unstale":"2024-09-22T03:55:51.747974+0000","last_undegraded":"2024-09-22T03:55:51.747974+0000","last_fullsized":"2024-09-22T03:55:51.747974+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"52'1194","reported_seq":1206,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:57:25.924568+0000","last_change":"2024-09-22T03:55:50.862926+0000","last_active":"2024-09-22T03:57:25.924568+0000","last_peered":"2024-09-22T03:57:25.924568+0000","last_clean":"2024-09-22T03:57:25.924568+0000","last_became_active":"2024-09-22T03:55:50.851824+0000","last_became_peered":"2024-09-22T03:55:50.851824+0000","last_unstale":"2024-09-22T03:57:25.924568+0000","last_undegraded":"2024-09-22T03:57:25.924568+0000","last_fullsized":"2024-09-22T03:57:25.924568+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1194,"log_dups_size":0,"ondisk_log_size":1194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74055680,"num_objects":1130,"num_object_clones":0,"num_object_copies":3390,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1194,"num_write_kb":74368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":124,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:51.758850+0000","last_change":"2024-09-22T03:49:17.036402+0000","last_active":"2024-09-22T03:55:51.758850+0000","last_peered":"2024-09-22T03:55:51.758850+0000","last_clean":"2024-09-22T03:55:51.758850+0000","last_became_active":"2024-09-22T03:49:15.108430+0000","last_became_peered":"2024-09-22T03:49:15.108430+0000","last_unstale":"2024-09-22T03:55:51.758850+0000","last_undegraded":"2024-09-22T03:55:51.758850+0000","last_fullsized":"2024-09-22T03:55:51.758850+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"52'1177","reported_seq":1189,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:57:25.050173+0000","last_change":"2024-09-22T03:55:50.878789+0000","last_active":"2024-09-22T03:57:25.050173+0000","last_peered":"2024-09-22T03:57:25.050173+0000","last_clean":"2024-09-22T03:57:25.050173+0000","last_became_active":"2024-09-22T03:55:50.852561+0000","last_became_peered":"2024-09-22T03:55:50.852561+0000","last_unstale":"2024-09-22T03:57:25.050173+0000","last_undegraded":"2024-09-22T03:57:25.050173+0000","last_fullsized":"2024-09-22T03:57:25.050173+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1177,"log_dups_size":0,"ondisk_log_size":1177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71892992,"num_objects":1097,"num_object_clones":0,"num_object_copies":3291,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1177,"num_write_kb":72768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":124,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:51.744448+0000","last_change":"2024-09-22T03:49:17.029128+0000","last_active":"2024-09-22T03:55:51.744448+0000","last_peered":"2024-09-22T03:55:51.744448+0000","last_clean":"2024-09-22T03:55:51.744448+0000","last_became_active":"2024-09-22T03:49:15.113396+0000","last_became_peered":"2024-09-22T03:49:15.113396+0000","last_unstale":"2024-09-22T03:55:51.744448+0000","last_undegraded":"2024-09-22T03:55:51.744448+0000","last_fullsized":"2024-09-22T03:55:51.744448+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":1170931736,"num_objects":17868,"num_object_clones":0,"num_object_copies":53604,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":18916,"num_write_kb":1177025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":219684864,"data_stored":3514761288,"data_compressed":166898211,"data_compressed_allocated":219672576,"data_compressed_original":3514761216,"omap_allocated":0,"internal_metadata":0},"log_size":18916,"ondisk_log_size":18916,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949673454,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":130040,"kb_used_data":44904,"kb_used_omap":0,"kb_used_meta":85120,"kb_avail":94241800,"statfs":{"total":96636764160,"available":96503603200,"internally_reserved":0,"allocated":45981696,"data_stored":728394112,"data_compressed":34582375,"data_compressed_allocated":45518848,"data_compressed_original":728219648,"omap_allocated":0,"internal_metadata":87162880},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654706158,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":147684,"kb_used_data":54228,"kb_used_omap":0,"kb_used_meta":93440,"kb_avail":94224156,"statfs":{"total":96636764160,"available":96485535744,"internally_reserved":0,"allocated":55529472,"data_stored":881485688,"data_compressed":41849750,"data_compressed_allocated":55083008,"data_compressed_original":881328128,"omap_allocated":0,"internal_metadata":95682560},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706157,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":148228,"kb_used_data":54772,"kb_used_omap":0,"kb_used_meta":93440,"kb_avail":94223612,"statfs":{"total":96636764160,"available":96484978688,"internally_reserved":0,"allocated":56086528,"data_stored":890005912,"data_compressed":42256257,"data_compressed_allocated":55619584,"data_compressed_original":889831424,"omap_allocated":0,"internal_metadata":95682560},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706158,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":148424,"kb_used_data":63288,"kb_used_omap":0,"kb_used_meta":85120,"kb_avail":94223416,"statfs":{"total":96636764160,"available":96484777984,"internally_reserved":0,"allocated":64806912,"data_stored":1029597573,"data_compressed":48884865,"data_compressed_allocated":64344064,"data_compressed_original":1029423104,"omap_allocated":0,"internal_metadata":87162880},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":64270336,"data_stored":1028259864,"data_compressed":48826810,"data_compressed_allocated":64266240,"data_compressed_original":1028259840,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":45400064,"data_stored":726401024,"data_compressed":34493210,"data_compressed_allocated":45400064,"data_compressed_original":726401024,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55025664,"data_stored":880345112,"data_compressed":41803105,"data_compressed_allocated":55021568,"data_compressed_original":880345088,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":54988800,"data_stored":879755288,"data_compressed":41775086,"data_compressed_allocated":54984704,"data_compressed_original":879755264,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:57:31.968 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:57:32.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:57:32.129+0000 7fd4300ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:57:32.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:57:32.137+0000 7fd4300ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:57:34.552 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:57:34.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:57:34.715+0000 7f8e82f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:57:34.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:57:34.724+0000 7f8e82f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:57:35.648 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:57:35.648 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-22T03:57:35.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:57:35.799+0000 7fb0e4991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:57:35.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:57:35.817+0000 7fb0e4991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:57:36.719 INFO:teuthology.orchestra.run.smithi037.stderr:reweighted osd.0 to 1 (10000) 2024-09-22T03:57:36.737 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-22T03:57:36.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:57:36.906+0000 7f8df7191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:57:36.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:57:36.929+0000 7f8df7191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:57:37.363 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:57:37.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:57:37.511+0000 7f63928ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:57:37.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:57:37.523+0000 7f63928ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:57:37.729 INFO:teuthology.orchestra.run.smithi037.stderr:reweighted osd.1 to 1 (10000) 2024-09-22T03:57:37.755 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-22T03:57:37.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:57:37.936+0000 7f19ab391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:57:37.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:57:37.953+0000 7f19ab391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:57:38.735 INFO:teuthology.orchestra.run.smithi037.stderr:reweighted osd.2 to 1 (10000) 2024-09-22T03:57:38.759 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-22T03:57:38.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:57:38.905+0000 7fbe99191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:57:38.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:57:38.921+0000 7fbe99191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:57:39.745 INFO:teuthology.orchestra.run.smithi037.stderr:reweighted osd.3 to 1 (10000) 2024-09-22T03:57:39.771 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-22T03:57:39.771 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:57:39.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:57:39.925+0000 7f08f3351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:57:39.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:57:39.941+0000 7f08f3351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:57:40.009 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:57:40.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:57:40.176+0000 7f347ecfd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:57:40.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:57:40.186+0000 7f347ecfd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:57:40.288 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:57:40.289 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-22T03:57:40.313 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":304,"stamp":"2024-09-22T03:57:39.745641+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1038811723,"num_objects":15847,"num_object_clones":0,"num_object_copies":47541,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":21022,"num_write_kb":1178133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":20996,"ondisk_log_size":20996,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":545804,"kb_used_data":192768,"kb_used_omap":0,"kb_used_meta":352960,"kb_avail":376941556,"statfs":{"total":386547056640,"available":385988153344,"internally_reserved":0,"allocated":197394432,"data_stored":3129320469,"data_compressed":148573021,"data_compressed_allocated":195555328,"data_compressed_original":3128639488,"omap_allocated":0,"internal_metadata":361431040},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-64946176,"num_objects":-991,"num_object_clones":0,"num_object_copies":-2973,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":991,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.675054"},"pg_stats":[{"pgid":"5.f","version":"52'1337","reported_seq":1349,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:57:35.776863+0000","last_change":"2024-09-22T03:55:50.938932+0000","last_active":"2024-09-22T03:57:35.776863+0000","last_peered":"2024-09-22T03:57:35.776863+0000","last_clean":"2024-09-22T03:57:35.776863+0000","last_became_active":"2024-09-22T03:55:50.929290+0000","last_became_peered":"2024-09-22T03:55:50.929290+0000","last_unstale":"2024-09-22T03:57:35.776863+0000","last_undegraded":"2024-09-22T03:57:35.776863+0000","last_fullsized":"2024-09-22T03:57:35.776863+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1337,"log_dups_size":0,"ondisk_log_size":1337,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64421888,"num_objects":983,"num_object_clones":0,"num_object_copies":2949,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1337,"num_write_kb":74240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"52'1285","reported_seq":1297,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:57:34.979153+0000","last_change":"2024-09-22T03:55:50.848180+0000","last_active":"2024-09-22T03:57:34.979153+0000","last_peered":"2024-09-22T03:57:34.979153+0000","last_clean":"2024-09-22T03:57:34.979153+0000","last_became_active":"2024-09-22T03:55:50.838302+0000","last_became_peered":"2024-09-22T03:55:50.838302+0000","last_unstale":"2024-09-22T03:57:34.979153+0000","last_undegraded":"2024-09-22T03:57:34.979153+0000","last_fullsized":"2024-09-22T03:57:34.979153+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1285,"log_dups_size":0,"ondisk_log_size":1285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65339392,"num_objects":997,"num_object_clones":0,"num_object_copies":2991,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1285,"num_write_kb":73024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"52'1360","reported_seq":1373,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:57:34.934942+0000","last_change":"2024-09-22T03:55:50.872362+0000","last_active":"2024-09-22T03:57:34.934942+0000","last_peered":"2024-09-22T03:57:34.934942+0000","last_clean":"2024-09-22T03:57:34.934942+0000","last_became_active":"2024-09-22T03:55:50.867322+0000","last_became_peered":"2024-09-22T03:55:50.867322+0000","last_unstale":"2024-09-22T03:57:34.934942+0000","last_undegraded":"2024-09-22T03:57:34.934942+0000","last_fullsized":"2024-09-22T03:57:34.934942+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1360,"log_dups_size":0,"ondisk_log_size":1360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66781208,"num_objects":1020,"num_object_clones":0,"num_object_copies":3060,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1360,"num_write_kb":76097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"52'1342","reported_seq":1354,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:57:36.188609+0000","last_change":"2024-09-22T03:55:50.942624+0000","last_active":"2024-09-22T03:57:36.188609+0000","last_peered":"2024-09-22T03:57:36.188609+0000","last_clean":"2024-09-22T03:57:36.188609+0000","last_became_active":"2024-09-22T03:55:50.922812+0000","last_became_peered":"2024-09-22T03:55:50.922812+0000","last_unstale":"2024-09-22T03:57:36.188609+0000","last_undegraded":"2024-09-22T03:57:36.188609+0000","last_fullsized":"2024-09-22T03:57:36.188609+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1342,"log_dups_size":0,"ondisk_log_size":1342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66060288,"num_objects":1008,"num_object_clones":0,"num_object_copies":3024,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1342,"num_write_kb":75200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"52'1275","reported_seq":1287,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:57:34.935300+0000","last_change":"2024-09-22T03:55:50.890353+0000","last_active":"2024-09-22T03:57:34.935300+0000","last_peered":"2024-09-22T03:57:34.935300+0000","last_clean":"2024-09-22T03:57:34.935300+0000","last_became_active":"2024-09-22T03:55:50.882633+0000","last_became_peered":"2024-09-22T03:55:50.882633+0000","last_unstale":"2024-09-22T03:57:34.935300+0000","last_undegraded":"2024-09-22T03:57:34.935300+0000","last_fullsized":"2024-09-22T03:57:34.935300+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1275,"log_dups_size":0,"ondisk_log_size":1275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61931520,"num_objects":945,"num_object_clones":0,"num_object_copies":2835,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1275,"num_write_kb":71040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.a","version":"52'1308","reported_seq":1320,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:57:35.099843+0000","last_change":"2024-09-22T03:55:50.891052+0000","last_active":"2024-09-22T03:57:35.099843+0000","last_peered":"2024-09-22T03:57:35.099843+0000","last_clean":"2024-09-22T03:57:35.099843+0000","last_became_active":"2024-09-22T03:55:50.880295+0000","last_became_peered":"2024-09-22T03:55:50.880295+0000","last_unstale":"2024-09-22T03:57:35.099843+0000","last_undegraded":"2024-09-22T03:57:35.099843+0000","last_fullsized":"2024-09-22T03:57:35.099843+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1308,"log_dups_size":0,"ondisk_log_size":1308,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65404928,"num_objects":998,"num_object_clones":0,"num_object_copies":2994,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1308,"num_write_kb":73792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"52'1307","reported_seq":1319,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:57:34.838985+0000","last_change":"2024-09-22T03:55:50.906894+0000","last_active":"2024-09-22T03:57:34.838985+0000","last_peered":"2024-09-22T03:57:34.838985+0000","last_clean":"2024-09-22T03:57:34.838985+0000","last_became_active":"2024-09-22T03:55:50.896899+0000","last_became_peered":"2024-09-22T03:55:50.896899+0000","last_unstale":"2024-09-22T03:57:34.838985+0000","last_undegraded":"2024-09-22T03:57:34.838985+0000","last_fullsized":"2024-09-22T03:57:34.838985+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1307,"log_dups_size":0,"ondisk_log_size":1307,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65994752,"num_objects":1007,"num_object_clones":0,"num_object_copies":3021,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1307,"num_write_kb":74048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"52'1295","reported_seq":1307,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:57:34.848429+0000","last_change":"2024-09-22T03:55:50.859578+0000","last_active":"2024-09-22T03:57:34.848429+0000","last_peered":"2024-09-22T03:57:34.848429+0000","last_clean":"2024-09-22T03:57:34.848429+0000","last_became_active":"2024-09-22T03:55:50.843710+0000","last_became_peered":"2024-09-22T03:55:50.843710+0000","last_unstale":"2024-09-22T03:57:34.848429+0000","last_undegraded":"2024-09-22T03:57:34.848429+0000","last_fullsized":"2024-09-22T03:57:34.848429+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1295,"log_dups_size":0,"ondisk_log_size":1295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64028672,"num_objects":977,"num_object_clones":0,"num_object_copies":2931,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1295,"num_write_kb":72704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"52'1334","reported_seq":1346,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:57:34.822097+0000","last_change":"2024-09-22T03:55:50.968411+0000","last_active":"2024-09-22T03:57:34.822097+0000","last_peered":"2024-09-22T03:57:34.822097+0000","last_clean":"2024-09-22T03:57:34.822097+0000","last_became_active":"2024-09-22T03:55:50.961718+0000","last_became_peered":"2024-09-22T03:55:50.961718+0000","last_unstale":"2024-09-22T03:57:34.822097+0000","last_undegraded":"2024-09-22T03:57:34.822097+0000","last_fullsized":"2024-09-22T03:57:34.822097+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1334,"log_dups_size":0,"ondisk_log_size":1334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67239936,"num_objects":1026,"num_object_clones":0,"num_object_copies":3078,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1334,"num_write_kb":75520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":199,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:51.749469+0000","last_change":"2024-09-22T03:49:12.034704+0000","last_active":"2024-09-22T03:55:51.749469+0000","last_peered":"2024-09-22T03:55:51.749469+0000","last_clean":"2024-09-22T03:55:51.749469+0000","last_became_active":"2024-09-22T03:49:12.027470+0000","last_became_peered":"2024-09-22T03:49:12.027470+0000","last_unstale":"2024-09-22T03:55:51.749469+0000","last_undegraded":"2024-09-22T03:55:51.749469+0000","last_fullsized":"2024-09-22T03:55:51.749469+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_clean_scrub_stamp":"2024-09-22T03:49:10.979949+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":125,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:51.750162+0000","last_change":"2024-09-22T03:49:17.031458+0000","last_active":"2024-09-22T03:55:51.750162+0000","last_peered":"2024-09-22T03:55:51.750162+0000","last_clean":"2024-09-22T03:55:51.750162+0000","last_became_active":"2024-09-22T03:49:15.125490+0000","last_became_peered":"2024-09-22T03:49:15.125490+0000","last_unstale":"2024-09-22T03:55:51.750162+0000","last_undegraded":"2024-09-22T03:55:51.750162+0000","last_fullsized":"2024-09-22T03:55:51.750162+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.7","version":"52'1315","reported_seq":1327,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:57:35.057770+0000","last_change":"2024-09-22T03:55:50.910597+0000","last_active":"2024-09-22T03:57:35.057770+0000","last_peered":"2024-09-22T03:57:35.057770+0000","last_clean":"2024-09-22T03:57:35.057770+0000","last_became_active":"2024-09-22T03:55:50.901290+0000","last_became_peered":"2024-09-22T03:55:50.901290+0000","last_unstale":"2024-09-22T03:57:35.057770+0000","last_undegraded":"2024-09-22T03:57:35.057770+0000","last_fullsized":"2024-09-22T03:57:35.057770+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1315,"log_dups_size":0,"ondisk_log_size":1315,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65077248,"num_objects":993,"num_object_clones":0,"num_object_copies":2979,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1315,"num_write_kb":73856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":124,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:51.742303+0000","last_change":"2024-09-22T03:49:17.029339+0000","last_active":"2024-09-22T03:55:51.742303+0000","last_peered":"2024-09-22T03:55:51.742303+0000","last_clean":"2024-09-22T03:55:51.742303+0000","last_became_active":"2024-09-22T03:49:15.097304+0000","last_became_peered":"2024-09-22T03:49:15.097304+0000","last_unstale":"2024-09-22T03:55:51.742303+0000","last_undegraded":"2024-09-22T03:55:51.742303+0000","last_fullsized":"2024-09-22T03:55:51.742303+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"52'1300","reported_seq":1312,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:57:35.633192+0000","last_change":"2024-09-22T03:55:50.918358+0000","last_active":"2024-09-22T03:57:35.633192+0000","last_peered":"2024-09-22T03:57:35.633192+0000","last_clean":"2024-09-22T03:57:35.633192+0000","last_became_active":"2024-09-22T03:55:50.889906+0000","last_became_peered":"2024-09-22T03:55:50.889906+0000","last_unstale":"2024-09-22T03:57:35.633192+0000","last_undegraded":"2024-09-22T03:57:35.633192+0000","last_fullsized":"2024-09-22T03:57:35.633192+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1300,"log_dups_size":0,"ondisk_log_size":1300,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62783488,"num_objects":958,"num_object_clones":0,"num_object_copies":2874,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1300,"num_write_kb":72256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":124,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:51.751861+0000","last_change":"2024-09-22T03:49:17.029349+0000","last_active":"2024-09-22T03:55:51.751861+0000","last_peered":"2024-09-22T03:55:51.751861+0000","last_clean":"2024-09-22T03:55:51.751861+0000","last_became_active":"2024-09-22T03:49:15.094890+0000","last_became_peered":"2024-09-22T03:49:15.094890+0000","last_unstale":"2024-09-22T03:55:51.751861+0000","last_undegraded":"2024-09-22T03:55:51.751861+0000","last_fullsized":"2024-09-22T03:55:51.751861+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"52'1308","reported_seq":1320,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:57:34.993562+0000","last_change":"2024-09-22T03:55:50.939050+0000","last_active":"2024-09-22T03:57:34.993562+0000","last_peered":"2024-09-22T03:57:34.993562+0000","last_clean":"2024-09-22T03:57:34.993562+0000","last_became_active":"2024-09-22T03:55:50.929831+0000","last_became_peered":"2024-09-22T03:55:50.929831+0000","last_unstale":"2024-09-22T03:57:34.993562+0000","last_undegraded":"2024-09-22T03:57:34.993562+0000","last_fullsized":"2024-09-22T03:57:34.993562+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1308,"log_dups_size":0,"ondisk_log_size":1308,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65798144,"num_objects":1004,"num_object_clones":0,"num_object_copies":3012,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1308,"num_write_kb":73984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":126,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:51.749244+0000","last_change":"2024-09-22T03:49:17.031466+0000","last_active":"2024-09-22T03:55:51.749244+0000","last_peered":"2024-09-22T03:55:51.749244+0000","last_clean":"2024-09-22T03:55:51.749244+0000","last_became_active":"2024-09-22T03:49:15.098420+0000","last_became_peered":"2024-09-22T03:49:15.098420+0000","last_unstale":"2024-09-22T03:55:51.749244+0000","last_undegraded":"2024-09-22T03:55:51.749244+0000","last_fullsized":"2024-09-22T03:55:51.749244+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3","version":"52'1276","reported_seq":1288,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:57:35.038633+0000","last_change":"2024-09-22T03:55:50.862956+0000","last_active":"2024-09-22T03:57:35.038633+0000","last_peered":"2024-09-22T03:57:35.038633+0000","last_clean":"2024-09-22T03:57:35.038633+0000","last_became_active":"2024-09-22T03:55:50.854828+0000","last_became_peered":"2024-09-22T03:55:50.854828+0000","last_unstale":"2024-09-22T03:57:35.038633+0000","last_undegraded":"2024-09-22T03:57:35.038633+0000","last_fullsized":"2024-09-22T03:57:35.038633+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1276,"log_dups_size":0,"ondisk_log_size":1276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63045632,"num_objects":962,"num_object_clones":0,"num_object_copies":2886,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1276,"num_write_kb":71616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":124,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:51.754967+0000","last_change":"2024-09-22T03:49:17.036954+0000","last_active":"2024-09-22T03:55:51.754967+0000","last_peered":"2024-09-22T03:55:51.754967+0000","last_clean":"2024-09-22T03:55:51.754967+0000","last_became_active":"2024-09-22T03:49:15.110506+0000","last_became_peered":"2024-09-22T03:49:15.110506+0000","last_unstale":"2024-09-22T03:55:51.754967+0000","last_undegraded":"2024-09-22T03:55:51.754967+0000","last_fullsized":"2024-09-22T03:55:51.754967+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"52'1289","reported_seq":1301,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:57:34.808075+0000","last_change":"2024-09-22T03:55:50.927264+0000","last_active":"2024-09-22T03:57:34.808075+0000","last_peered":"2024-09-22T03:57:34.808075+0000","last_clean":"2024-09-22T03:57:34.808075+0000","last_became_active":"2024-09-22T03:55:50.919600+0000","last_became_peered":"2024-09-22T03:55:50.919600+0000","last_unstale":"2024-09-22T03:57:34.808075+0000","last_undegraded":"2024-09-22T03:57:34.808075+0000","last_fullsized":"2024-09-22T03:57:34.808075+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1289,"log_dups_size":0,"ondisk_log_size":1289,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64028672,"num_objects":977,"num_object_clones":0,"num_object_copies":2931,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1289,"num_write_kb":72512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":124,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:51.747974+0000","last_change":"2024-09-22T03:49:17.032989+0000","last_active":"2024-09-22T03:55:51.747974+0000","last_peered":"2024-09-22T03:55:51.747974+0000","last_clean":"2024-09-22T03:55:51.747974+0000","last_became_active":"2024-09-22T03:49:15.079260+0000","last_became_peered":"2024-09-22T03:49:15.079260+0000","last_unstale":"2024-09-22T03:55:51.747974+0000","last_undegraded":"2024-09-22T03:55:51.747974+0000","last_fullsized":"2024-09-22T03:55:51.747974+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"52'1321","reported_seq":1333,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:57:36.138720+0000","last_change":"2024-09-22T03:55:50.862926+0000","last_active":"2024-09-22T03:57:36.138720+0000","last_peered":"2024-09-22T03:57:36.138720+0000","last_clean":"2024-09-22T03:57:36.138720+0000","last_became_active":"2024-09-22T03:55:50.851824+0000","last_became_peered":"2024-09-22T03:55:50.851824+0000","last_unstale":"2024-09-22T03:57:36.138720+0000","last_undegraded":"2024-09-22T03:57:36.138720+0000","last_fullsized":"2024-09-22T03:57:36.138720+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1321,"log_dups_size":0,"ondisk_log_size":1321,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65732608,"num_objects":1003,"num_object_clones":0,"num_object_copies":3009,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1321,"num_write_kb":74368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":124,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:51.758850+0000","last_change":"2024-09-22T03:49:17.036402+0000","last_active":"2024-09-22T03:55:51.758850+0000","last_peered":"2024-09-22T03:55:51.758850+0000","last_clean":"2024-09-22T03:55:51.758850+0000","last_became_active":"2024-09-22T03:49:15.108430+0000","last_became_peered":"2024-09-22T03:49:15.108430+0000","last_unstale":"2024-09-22T03:55:51.758850+0000","last_undegraded":"2024-09-22T03:55:51.758850+0000","last_fullsized":"2024-09-22T03:55:51.758850+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"52'1289","reported_seq":1301,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:57:34.900792+0000","last_change":"2024-09-22T03:55:50.878789+0000","last_active":"2024-09-22T03:57:34.900792+0000","last_peered":"2024-09-22T03:57:34.900792+0000","last_clean":"2024-09-22T03:57:34.900792+0000","last_became_active":"2024-09-22T03:55:50.852561+0000","last_became_peered":"2024-09-22T03:55:50.852561+0000","last_unstale":"2024-09-22T03:57:34.900792+0000","last_undegraded":"2024-09-22T03:57:34.900792+0000","last_fullsized":"2024-09-22T03:57:34.900792+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1289,"log_dups_size":0,"ondisk_log_size":1289,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64552960,"num_objects":985,"num_object_clones":0,"num_object_copies":2955,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1289,"num_write_kb":72768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":124,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:51.744448+0000","last_change":"2024-09-22T03:49:17.029128+0000","last_active":"2024-09-22T03:55:51.744448+0000","last_peered":"2024-09-22T03:55:51.744448+0000","last_clean":"2024-09-22T03:55:51.744448+0000","last_became_active":"2024-09-22T03:49:15.113396+0000","last_became_peered":"2024-09-22T03:49:15.113396+0000","last_unstale":"2024-09-22T03:55:51.744448+0000","last_undegraded":"2024-09-22T03:55:51.744448+0000","last_fullsized":"2024-09-22T03:55:51.744448+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":1038221336,"num_objects":15843,"num_object_clones":0,"num_object_copies":47529,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20941,"num_write_kb":1177025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":194727936,"data_stored":3115450440,"data_compressed":147938253,"data_compressed_allocated":194715648,"data_compressed_original":3115450368,"omap_allocated":0,"internal_metadata":0},"log_size":20941,"ondisk_log_size":20941,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949673464,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":129208,"kb_used_data":39908,"kb_used_omap":0,"kb_used_meta":89280,"kb_avail":94242632,"statfs":{"total":96636764160,"available":96504455168,"internally_reserved":0,"allocated":40865792,"data_stored":646539648,"data_compressed":30695703,"data_compressed_allocated":40402944,"data_compressed_original":646365184,"omap_allocated":0,"internal_metadata":91422720},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654706168,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":133272,"kb_used_data":48136,"kb_used_omap":0,"kb_used_meta":85120,"kb_avail":94238568,"statfs":{"total":96636764160,"available":96500293632,"internally_reserved":0,"allocated":49291264,"data_stored":781674360,"data_compressed":37110599,"data_compressed_allocated":48844800,"data_compressed_original":781516800,"omap_allocated":0,"internal_metadata":87162880},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706167,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":133740,"kb_used_data":48604,"kb_used_omap":0,"kb_used_meta":85120,"kb_avail":94238100,"statfs":{"total":96636764160,"available":96499814400,"internally_reserved":0,"allocated":49770496,"data_stored":788949400,"data_compressed":37458079,"data_compressed_allocated":49303552,"data_compressed_original":788774912,"omap_allocated":0,"internal_metadata":87162880},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706168,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":149584,"kb_used_data":56120,"kb_used_omap":0,"kb_used_meta":93440,"kb_avail":94222256,"statfs":{"total":96636764160,"available":96483590144,"internally_reserved":0,"allocated":57466880,"data_stored":912157061,"data_compressed":43308640,"data_compressed_allocated":57004032,"data_compressed_original":911982592,"omap_allocated":0,"internal_metadata":95682560},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":56938496,"data_stored":910950424,"data_compressed":43256800,"data_compressed_allocated":56934400,"data_compressed_original":910950400,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40316928,"data_stored":645070848,"data_compressed":30631415,"data_compressed_allocated":40316928,"data_compressed_original":645070848,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":48693248,"data_stored":779026456,"data_compressed":36992343,"data_compressed_allocated":48689152,"data_compressed_original":779026432,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":48779264,"data_stored":780402712,"data_compressed":37057695,"data_compressed_allocated":48775168,"data_compressed_original":780402688,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:57:40.314 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:57:40.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:57:40.467+0000 7fc1cfd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:57:40.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:57:40.483+0000 7fc1cfd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:57:40.869 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:57:40.869 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-22T03:57:40.894 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":304,"stamp":"2024-09-22T03:57:39.745641+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1038811723,"num_objects":15847,"num_object_clones":0,"num_object_copies":47541,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":21022,"num_write_kb":1178133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":20996,"ondisk_log_size":20996,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":545804,"kb_used_data":192768,"kb_used_omap":0,"kb_used_meta":352960,"kb_avail":376941556,"statfs":{"total":386547056640,"available":385988153344,"internally_reserved":0,"allocated":197394432,"data_stored":3129320469,"data_compressed":148573021,"data_compressed_allocated":195555328,"data_compressed_original":3128639488,"omap_allocated":0,"internal_metadata":361431040},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-64946176,"num_objects":-991,"num_object_clones":0,"num_object_copies":-2973,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":991,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.675054"},"pg_stats":[{"pgid":"5.f","version":"52'1337","reported_seq":1349,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:57:35.776863+0000","last_change":"2024-09-22T03:55:50.938932+0000","last_active":"2024-09-22T03:57:35.776863+0000","last_peered":"2024-09-22T03:57:35.776863+0000","last_clean":"2024-09-22T03:57:35.776863+0000","last_became_active":"2024-09-22T03:55:50.929290+0000","last_became_peered":"2024-09-22T03:55:50.929290+0000","last_unstale":"2024-09-22T03:57:35.776863+0000","last_undegraded":"2024-09-22T03:57:35.776863+0000","last_fullsized":"2024-09-22T03:57:35.776863+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1337,"log_dups_size":0,"ondisk_log_size":1337,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64421888,"num_objects":983,"num_object_clones":0,"num_object_copies":2949,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1337,"num_write_kb":74240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"52'1285","reported_seq":1297,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:57:34.979153+0000","last_change":"2024-09-22T03:55:50.848180+0000","last_active":"2024-09-22T03:57:34.979153+0000","last_peered":"2024-09-22T03:57:34.979153+0000","last_clean":"2024-09-22T03:57:34.979153+0000","last_became_active":"2024-09-22T03:55:50.838302+0000","last_became_peered":"2024-09-22T03:55:50.838302+0000","last_unstale":"2024-09-22T03:57:34.979153+0000","last_undegraded":"2024-09-22T03:57:34.979153+0000","last_fullsized":"2024-09-22T03:57:34.979153+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1285,"log_dups_size":0,"ondisk_log_size":1285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65339392,"num_objects":997,"num_object_clones":0,"num_object_copies":2991,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1285,"num_write_kb":73024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"52'1360","reported_seq":1373,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:57:34.934942+0000","last_change":"2024-09-22T03:55:50.872362+0000","last_active":"2024-09-22T03:57:34.934942+0000","last_peered":"2024-09-22T03:57:34.934942+0000","last_clean":"2024-09-22T03:57:34.934942+0000","last_became_active":"2024-09-22T03:55:50.867322+0000","last_became_peered":"2024-09-22T03:55:50.867322+0000","last_unstale":"2024-09-22T03:57:34.934942+0000","last_undegraded":"2024-09-22T03:57:34.934942+0000","last_fullsized":"2024-09-22T03:57:34.934942+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1360,"log_dups_size":0,"ondisk_log_size":1360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66781208,"num_objects":1020,"num_object_clones":0,"num_object_copies":3060,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1360,"num_write_kb":76097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"52'1342","reported_seq":1354,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:57:36.188609+0000","last_change":"2024-09-22T03:55:50.942624+0000","last_active":"2024-09-22T03:57:36.188609+0000","last_peered":"2024-09-22T03:57:36.188609+0000","last_clean":"2024-09-22T03:57:36.188609+0000","last_became_active":"2024-09-22T03:55:50.922812+0000","last_became_peered":"2024-09-22T03:55:50.922812+0000","last_unstale":"2024-09-22T03:57:36.188609+0000","last_undegraded":"2024-09-22T03:57:36.188609+0000","last_fullsized":"2024-09-22T03:57:36.188609+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1342,"log_dups_size":0,"ondisk_log_size":1342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66060288,"num_objects":1008,"num_object_clones":0,"num_object_copies":3024,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1342,"num_write_kb":75200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"52'1275","reported_seq":1287,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:57:34.935300+0000","last_change":"2024-09-22T03:55:50.890353+0000","last_active":"2024-09-22T03:57:34.935300+0000","last_peered":"2024-09-22T03:57:34.935300+0000","last_clean":"2024-09-22T03:57:34.935300+0000","last_became_active":"2024-09-22T03:55:50.882633+0000","last_became_peered":"2024-09-22T03:55:50.882633+0000","last_unstale":"2024-09-22T03:57:34.935300+0000","last_undegraded":"2024-09-22T03:57:34.935300+0000","last_fullsized":"2024-09-22T03:57:34.935300+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1275,"log_dups_size":0,"ondisk_log_size":1275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61931520,"num_objects":945,"num_object_clones":0,"num_object_copies":2835,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1275,"num_write_kb":71040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.a","version":"52'1308","reported_seq":1320,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:57:35.099843+0000","last_change":"2024-09-22T03:55:50.891052+0000","last_active":"2024-09-22T03:57:35.099843+0000","last_peered":"2024-09-22T03:57:35.099843+0000","last_clean":"2024-09-22T03:57:35.099843+0000","last_became_active":"2024-09-22T03:55:50.880295+0000","last_became_peered":"2024-09-22T03:55:50.880295+0000","last_unstale":"2024-09-22T03:57:35.099843+0000","last_undegraded":"2024-09-22T03:57:35.099843+0000","last_fullsized":"2024-09-22T03:57:35.099843+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1308,"log_dups_size":0,"ondisk_log_size":1308,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65404928,"num_objects":998,"num_object_clones":0,"num_object_copies":2994,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1308,"num_write_kb":73792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"52'1307","reported_seq":1319,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:57:34.838985+0000","last_change":"2024-09-22T03:55:50.906894+0000","last_active":"2024-09-22T03:57:34.838985+0000","last_peered":"2024-09-22T03:57:34.838985+0000","last_clean":"2024-09-22T03:57:34.838985+0000","last_became_active":"2024-09-22T03:55:50.896899+0000","last_became_peered":"2024-09-22T03:55:50.896899+0000","last_unstale":"2024-09-22T03:57:34.838985+0000","last_undegraded":"2024-09-22T03:57:34.838985+0000","last_fullsized":"2024-09-22T03:57:34.838985+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1307,"log_dups_size":0,"ondisk_log_size":1307,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65994752,"num_objects":1007,"num_object_clones":0,"num_object_copies":3021,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1307,"num_write_kb":74048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"52'1295","reported_seq":1307,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:57:34.848429+0000","last_change":"2024-09-22T03:55:50.859578+0000","last_active":"2024-09-22T03:57:34.848429+0000","last_peered":"2024-09-22T03:57:34.848429+0000","last_clean":"2024-09-22T03:57:34.848429+0000","last_became_active":"2024-09-22T03:55:50.843710+0000","last_became_peered":"2024-09-22T03:55:50.843710+0000","last_unstale":"2024-09-22T03:57:34.848429+0000","last_undegraded":"2024-09-22T03:57:34.848429+0000","last_fullsized":"2024-09-22T03:57:34.848429+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1295,"log_dups_size":0,"ondisk_log_size":1295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64028672,"num_objects":977,"num_object_clones":0,"num_object_copies":2931,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1295,"num_write_kb":72704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"52'1334","reported_seq":1346,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:57:34.822097+0000","last_change":"2024-09-22T03:55:50.968411+0000","last_active":"2024-09-22T03:57:34.822097+0000","last_peered":"2024-09-22T03:57:34.822097+0000","last_clean":"2024-09-22T03:57:34.822097+0000","last_became_active":"2024-09-22T03:55:50.961718+0000","last_became_peered":"2024-09-22T03:55:50.961718+0000","last_unstale":"2024-09-22T03:57:34.822097+0000","last_undegraded":"2024-09-22T03:57:34.822097+0000","last_fullsized":"2024-09-22T03:57:34.822097+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1334,"log_dups_size":0,"ondisk_log_size":1334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67239936,"num_objects":1026,"num_object_clones":0,"num_object_copies":3078,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1334,"num_write_kb":75520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":199,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:51.749469+0000","last_change":"2024-09-22T03:49:12.034704+0000","last_active":"2024-09-22T03:55:51.749469+0000","last_peered":"2024-09-22T03:55:51.749469+0000","last_clean":"2024-09-22T03:55:51.749469+0000","last_became_active":"2024-09-22T03:49:12.027470+0000","last_became_peered":"2024-09-22T03:49:12.027470+0000","last_unstale":"2024-09-22T03:55:51.749469+0000","last_undegraded":"2024-09-22T03:55:51.749469+0000","last_fullsized":"2024-09-22T03:55:51.749469+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_clean_scrub_stamp":"2024-09-22T03:49:10.979949+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":125,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:51.750162+0000","last_change":"2024-09-22T03:49:17.031458+0000","last_active":"2024-09-22T03:55:51.750162+0000","last_peered":"2024-09-22T03:55:51.750162+0000","last_clean":"2024-09-22T03:55:51.750162+0000","last_became_active":"2024-09-22T03:49:15.125490+0000","last_became_peered":"2024-09-22T03:49:15.125490+0000","last_unstale":"2024-09-22T03:55:51.750162+0000","last_undegraded":"2024-09-22T03:55:51.750162+0000","last_fullsized":"2024-09-22T03:55:51.750162+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.7","version":"52'1315","reported_seq":1327,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:57:35.057770+0000","last_change":"2024-09-22T03:55:50.910597+0000","last_active":"2024-09-22T03:57:35.057770+0000","last_peered":"2024-09-22T03:57:35.057770+0000","last_clean":"2024-09-22T03:57:35.057770+0000","last_became_active":"2024-09-22T03:55:50.901290+0000","last_became_peered":"2024-09-22T03:55:50.901290+0000","last_unstale":"2024-09-22T03:57:35.057770+0000","last_undegraded":"2024-09-22T03:57:35.057770+0000","last_fullsized":"2024-09-22T03:57:35.057770+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1315,"log_dups_size":0,"ondisk_log_size":1315,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65077248,"num_objects":993,"num_object_clones":0,"num_object_copies":2979,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1315,"num_write_kb":73856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":124,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:51.742303+0000","last_change":"2024-09-22T03:49:17.029339+0000","last_active":"2024-09-22T03:55:51.742303+0000","last_peered":"2024-09-22T03:55:51.742303+0000","last_clean":"2024-09-22T03:55:51.742303+0000","last_became_active":"2024-09-22T03:49:15.097304+0000","last_became_peered":"2024-09-22T03:49:15.097304+0000","last_unstale":"2024-09-22T03:55:51.742303+0000","last_undegraded":"2024-09-22T03:55:51.742303+0000","last_fullsized":"2024-09-22T03:55:51.742303+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"52'1300","reported_seq":1312,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:57:35.633192+0000","last_change":"2024-09-22T03:55:50.918358+0000","last_active":"2024-09-22T03:57:35.633192+0000","last_peered":"2024-09-22T03:57:35.633192+0000","last_clean":"2024-09-22T03:57:35.633192+0000","last_became_active":"2024-09-22T03:55:50.889906+0000","last_became_peered":"2024-09-22T03:55:50.889906+0000","last_unstale":"2024-09-22T03:57:35.633192+0000","last_undegraded":"2024-09-22T03:57:35.633192+0000","last_fullsized":"2024-09-22T03:57:35.633192+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1300,"log_dups_size":0,"ondisk_log_size":1300,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62783488,"num_objects":958,"num_object_clones":0,"num_object_copies":2874,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1300,"num_write_kb":72256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":124,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:51.751861+0000","last_change":"2024-09-22T03:49:17.029349+0000","last_active":"2024-09-22T03:55:51.751861+0000","last_peered":"2024-09-22T03:55:51.751861+0000","last_clean":"2024-09-22T03:55:51.751861+0000","last_became_active":"2024-09-22T03:49:15.094890+0000","last_became_peered":"2024-09-22T03:49:15.094890+0000","last_unstale":"2024-09-22T03:55:51.751861+0000","last_undegraded":"2024-09-22T03:55:51.751861+0000","last_fullsized":"2024-09-22T03:55:51.751861+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"52'1308","reported_seq":1320,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:57:34.993562+0000","last_change":"2024-09-22T03:55:50.939050+0000","last_active":"2024-09-22T03:57:34.993562+0000","last_peered":"2024-09-22T03:57:34.993562+0000","last_clean":"2024-09-22T03:57:34.993562+0000","last_became_active":"2024-09-22T03:55:50.929831+0000","last_became_peered":"2024-09-22T03:55:50.929831+0000","last_unstale":"2024-09-22T03:57:34.993562+0000","last_undegraded":"2024-09-22T03:57:34.993562+0000","last_fullsized":"2024-09-22T03:57:34.993562+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1308,"log_dups_size":0,"ondisk_log_size":1308,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65798144,"num_objects":1004,"num_object_clones":0,"num_object_copies":3012,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1308,"num_write_kb":73984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":126,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:51.749244+0000","last_change":"2024-09-22T03:49:17.031466+0000","last_active":"2024-09-22T03:55:51.749244+0000","last_peered":"2024-09-22T03:55:51.749244+0000","last_clean":"2024-09-22T03:55:51.749244+0000","last_became_active":"2024-09-22T03:49:15.098420+0000","last_became_peered":"2024-09-22T03:49:15.098420+0000","last_unstale":"2024-09-22T03:55:51.749244+0000","last_undegraded":"2024-09-22T03:55:51.749244+0000","last_fullsized":"2024-09-22T03:55:51.749244+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3","version":"52'1276","reported_seq":1288,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:57:35.038633+0000","last_change":"2024-09-22T03:55:50.862956+0000","last_active":"2024-09-22T03:57:35.038633+0000","last_peered":"2024-09-22T03:57:35.038633+0000","last_clean":"2024-09-22T03:57:35.038633+0000","last_became_active":"2024-09-22T03:55:50.854828+0000","last_became_peered":"2024-09-22T03:55:50.854828+0000","last_unstale":"2024-09-22T03:57:35.038633+0000","last_undegraded":"2024-09-22T03:57:35.038633+0000","last_fullsized":"2024-09-22T03:57:35.038633+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1276,"log_dups_size":0,"ondisk_log_size":1276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63045632,"num_objects":962,"num_object_clones":0,"num_object_copies":2886,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1276,"num_write_kb":71616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":124,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:51.754967+0000","last_change":"2024-09-22T03:49:17.036954+0000","last_active":"2024-09-22T03:55:51.754967+0000","last_peered":"2024-09-22T03:55:51.754967+0000","last_clean":"2024-09-22T03:55:51.754967+0000","last_became_active":"2024-09-22T03:49:15.110506+0000","last_became_peered":"2024-09-22T03:49:15.110506+0000","last_unstale":"2024-09-22T03:55:51.754967+0000","last_undegraded":"2024-09-22T03:55:51.754967+0000","last_fullsized":"2024-09-22T03:55:51.754967+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"52'1289","reported_seq":1301,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:57:34.808075+0000","last_change":"2024-09-22T03:55:50.927264+0000","last_active":"2024-09-22T03:57:34.808075+0000","last_peered":"2024-09-22T03:57:34.808075+0000","last_clean":"2024-09-22T03:57:34.808075+0000","last_became_active":"2024-09-22T03:55:50.919600+0000","last_became_peered":"2024-09-22T03:55:50.919600+0000","last_unstale":"2024-09-22T03:57:34.808075+0000","last_undegraded":"2024-09-22T03:57:34.808075+0000","last_fullsized":"2024-09-22T03:57:34.808075+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1289,"log_dups_size":0,"ondisk_log_size":1289,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64028672,"num_objects":977,"num_object_clones":0,"num_object_copies":2931,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1289,"num_write_kb":72512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":124,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:51.747974+0000","last_change":"2024-09-22T03:49:17.032989+0000","last_active":"2024-09-22T03:55:51.747974+0000","last_peered":"2024-09-22T03:55:51.747974+0000","last_clean":"2024-09-22T03:55:51.747974+0000","last_became_active":"2024-09-22T03:49:15.079260+0000","last_became_peered":"2024-09-22T03:49:15.079260+0000","last_unstale":"2024-09-22T03:55:51.747974+0000","last_undegraded":"2024-09-22T03:55:51.747974+0000","last_fullsized":"2024-09-22T03:55:51.747974+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"52'1321","reported_seq":1333,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:57:36.138720+0000","last_change":"2024-09-22T03:55:50.862926+0000","last_active":"2024-09-22T03:57:36.138720+0000","last_peered":"2024-09-22T03:57:36.138720+0000","last_clean":"2024-09-22T03:57:36.138720+0000","last_became_active":"2024-09-22T03:55:50.851824+0000","last_became_peered":"2024-09-22T03:55:50.851824+0000","last_unstale":"2024-09-22T03:57:36.138720+0000","last_undegraded":"2024-09-22T03:57:36.138720+0000","last_fullsized":"2024-09-22T03:57:36.138720+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1321,"log_dups_size":0,"ondisk_log_size":1321,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65732608,"num_objects":1003,"num_object_clones":0,"num_object_copies":3009,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1321,"num_write_kb":74368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":124,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:51.758850+0000","last_change":"2024-09-22T03:49:17.036402+0000","last_active":"2024-09-22T03:55:51.758850+0000","last_peered":"2024-09-22T03:55:51.758850+0000","last_clean":"2024-09-22T03:55:51.758850+0000","last_became_active":"2024-09-22T03:49:15.108430+0000","last_became_peered":"2024-09-22T03:49:15.108430+0000","last_unstale":"2024-09-22T03:55:51.758850+0000","last_undegraded":"2024-09-22T03:55:51.758850+0000","last_fullsized":"2024-09-22T03:55:51.758850+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"52'1289","reported_seq":1301,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:57:34.900792+0000","last_change":"2024-09-22T03:55:50.878789+0000","last_active":"2024-09-22T03:57:34.900792+0000","last_peered":"2024-09-22T03:57:34.900792+0000","last_clean":"2024-09-22T03:57:34.900792+0000","last_became_active":"2024-09-22T03:55:50.852561+0000","last_became_peered":"2024-09-22T03:55:50.852561+0000","last_unstale":"2024-09-22T03:57:34.900792+0000","last_undegraded":"2024-09-22T03:57:34.900792+0000","last_fullsized":"2024-09-22T03:57:34.900792+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1289,"log_dups_size":0,"ondisk_log_size":1289,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64552960,"num_objects":985,"num_object_clones":0,"num_object_copies":2955,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1289,"num_write_kb":72768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":124,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:51.744448+0000","last_change":"2024-09-22T03:49:17.029128+0000","last_active":"2024-09-22T03:55:51.744448+0000","last_peered":"2024-09-22T03:55:51.744448+0000","last_clean":"2024-09-22T03:55:51.744448+0000","last_became_active":"2024-09-22T03:49:15.113396+0000","last_became_peered":"2024-09-22T03:49:15.113396+0000","last_unstale":"2024-09-22T03:55:51.744448+0000","last_undegraded":"2024-09-22T03:55:51.744448+0000","last_fullsized":"2024-09-22T03:55:51.744448+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":1038221336,"num_objects":15843,"num_object_clones":0,"num_object_copies":47529,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20941,"num_write_kb":1177025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":194727936,"data_stored":3115450440,"data_compressed":147938253,"data_compressed_allocated":194715648,"data_compressed_original":3115450368,"omap_allocated":0,"internal_metadata":0},"log_size":20941,"ondisk_log_size":20941,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949673464,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":129208,"kb_used_data":39908,"kb_used_omap":0,"kb_used_meta":89280,"kb_avail":94242632,"statfs":{"total":96636764160,"available":96504455168,"internally_reserved":0,"allocated":40865792,"data_stored":646539648,"data_compressed":30695703,"data_compressed_allocated":40402944,"data_compressed_original":646365184,"omap_allocated":0,"internal_metadata":91422720},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654706168,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":133272,"kb_used_data":48136,"kb_used_omap":0,"kb_used_meta":85120,"kb_avail":94238568,"statfs":{"total":96636764160,"available":96500293632,"internally_reserved":0,"allocated":49291264,"data_stored":781674360,"data_compressed":37110599,"data_compressed_allocated":48844800,"data_compressed_original":781516800,"omap_allocated":0,"internal_metadata":87162880},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706167,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":133740,"kb_used_data":48604,"kb_used_omap":0,"kb_used_meta":85120,"kb_avail":94238100,"statfs":{"total":96636764160,"available":96499814400,"internally_reserved":0,"allocated":49770496,"data_stored":788949400,"data_compressed":37458079,"data_compressed_allocated":49303552,"data_compressed_original":788774912,"omap_allocated":0,"internal_metadata":87162880},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706168,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":149584,"kb_used_data":56120,"kb_used_omap":0,"kb_used_meta":93440,"kb_avail":94222256,"statfs":{"total":96636764160,"available":96483590144,"internally_reserved":0,"allocated":57466880,"data_stored":912157061,"data_compressed":43308640,"data_compressed_allocated":57004032,"data_compressed_original":911982592,"omap_allocated":0,"internal_metadata":95682560},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":56938496,"data_stored":910950424,"data_compressed":43256800,"data_compressed_allocated":56934400,"data_compressed_original":910950400,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40316928,"data_stored":645070848,"data_compressed":30631415,"data_compressed_allocated":40316928,"data_compressed_original":645070848,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":48693248,"data_stored":779026456,"data_compressed":36992343,"data_compressed_allocated":48689152,"data_compressed_original":779026432,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":48779264,"data_stored":780402712,"data_compressed":37057695,"data_compressed_allocated":48775168,"data_compressed_original":780402688,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:57:40.895 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-22T03:57:40.895 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:57:40.895 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:57:41.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:57:41.068+0000 7f82544bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:57:41.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:57:41.081+0000 7f82544bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:57:41.458 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:57:41.458 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-22T03:57:41.478 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":305,"stamp":"2024-09-22T03:57:41.071695+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":991298123,"num_objects":15122,"num_object_clones":0,"num_object_copies":45366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":21747,"num_write_kb":1178133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21721,"ondisk_log_size":21721,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":540792,"kb_used_data":183600,"kb_used_omap":0,"kb_used_meta":357120,"kb_avail":376946568,"statfs":{"total":386547056640,"available":385993285632,"internally_reserved":0,"allocated":188006400,"data_stored":2977706168,"data_compressed":141371853,"data_compressed_allocated":186077184,"data_compressed_original":2976989184,"omap_allocated":0,"internal_metadata":365690880},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-47513600,"num_objects":-725,"num_object_clones":0,"num_object_copies":-2175,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":725,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.349715"},"pg_stats":[{"pgid":"5.f","version":"52'1337","reported_seq":1349,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:57:35.776863+0000","last_change":"2024-09-22T03:55:50.938932+0000","last_active":"2024-09-22T03:57:35.776863+0000","last_peered":"2024-09-22T03:57:35.776863+0000","last_clean":"2024-09-22T03:57:35.776863+0000","last_became_active":"2024-09-22T03:55:50.929290+0000","last_became_peered":"2024-09-22T03:55:50.929290+0000","last_unstale":"2024-09-22T03:57:35.776863+0000","last_undegraded":"2024-09-22T03:57:35.776863+0000","last_fullsized":"2024-09-22T03:57:35.776863+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1337,"log_dups_size":0,"ondisk_log_size":1337,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64421888,"num_objects":983,"num_object_clones":0,"num_object_copies":2949,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1337,"num_write_kb":74240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"56'1344","reported_seq":1368,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-22T03:57:40.004858+0000","last_change":"2024-09-22T03:55:50.848180+0000","last_active":"2024-09-22T03:57:40.004858+0000","last_peered":"2024-09-22T03:57:40.004858+0000","last_clean":"2024-09-22T03:57:40.004858+0000","last_became_active":"2024-09-22T03:55:50.838302+0000","last_became_peered":"2024-09-22T03:55:50.838302+0000","last_unstale":"2024-09-22T03:57:40.004858+0000","last_undegraded":"2024-09-22T03:57:40.004858+0000","last_fullsized":"2024-09-22T03:57:40.004858+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1344,"log_dups_size":0,"ondisk_log_size":1344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61472768,"num_objects":938,"num_object_clones":0,"num_object_copies":2814,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1344,"num_write_kb":73024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"56'1431","reported_seq":1456,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-22T03:57:39.794278+0000","last_change":"2024-09-22T03:55:50.872362+0000","last_active":"2024-09-22T03:57:39.794278+0000","last_peered":"2024-09-22T03:57:39.794278+0000","last_clean":"2024-09-22T03:57:39.794278+0000","last_became_active":"2024-09-22T03:55:50.867322+0000","last_became_peered":"2024-09-22T03:55:50.867322+0000","last_unstale":"2024-09-22T03:57:39.794278+0000","last_undegraded":"2024-09-22T03:57:39.794278+0000","last_fullsized":"2024-09-22T03:57:39.794278+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1431,"log_dups_size":0,"ondisk_log_size":1431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62128152,"num_objects":949,"num_object_clones":0,"num_object_copies":2847,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1431,"num_write_kb":76097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"52'1342","reported_seq":1354,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:57:36.188609+0000","last_change":"2024-09-22T03:55:50.942624+0000","last_active":"2024-09-22T03:57:36.188609+0000","last_peered":"2024-09-22T03:57:36.188609+0000","last_clean":"2024-09-22T03:57:36.188609+0000","last_became_active":"2024-09-22T03:55:50.922812+0000","last_became_peered":"2024-09-22T03:55:50.922812+0000","last_unstale":"2024-09-22T03:57:36.188609+0000","last_undegraded":"2024-09-22T03:57:36.188609+0000","last_fullsized":"2024-09-22T03:57:36.188609+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1342,"log_dups_size":0,"ondisk_log_size":1342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66060288,"num_objects":1008,"num_object_clones":0,"num_object_copies":3024,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1342,"num_write_kb":75200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"56'1335","reported_seq":1359,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-22T03:57:39.959033+0000","last_change":"2024-09-22T03:55:50.890353+0000","last_active":"2024-09-22T03:57:39.959033+0000","last_peered":"2024-09-22T03:57:39.959033+0000","last_clean":"2024-09-22T03:57:39.959033+0000","last_became_active":"2024-09-22T03:55:50.882633+0000","last_became_peered":"2024-09-22T03:55:50.882633+0000","last_unstale":"2024-09-22T03:57:39.959033+0000","last_undegraded":"2024-09-22T03:57:39.959033+0000","last_fullsized":"2024-09-22T03:57:39.959033+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1335,"log_dups_size":0,"ondisk_log_size":1335,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57999360,"num_objects":885,"num_object_clones":0,"num_object_copies":2655,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1335,"num_write_kb":71040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.a","version":"56'1359","reported_seq":1383,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-22T03:57:39.800004+0000","last_change":"2024-09-22T03:55:50.891052+0000","last_active":"2024-09-22T03:57:39.800004+0000","last_peered":"2024-09-22T03:57:39.800004+0000","last_clean":"2024-09-22T03:57:39.800004+0000","last_became_active":"2024-09-22T03:55:50.880295+0000","last_became_peered":"2024-09-22T03:55:50.880295+0000","last_unstale":"2024-09-22T03:57:39.800004+0000","last_undegraded":"2024-09-22T03:57:39.800004+0000","last_fullsized":"2024-09-22T03:57:39.800004+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1359,"log_dups_size":0,"ondisk_log_size":1359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62062592,"num_objects":947,"num_object_clones":0,"num_object_copies":2841,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1359,"num_write_kb":73792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"55'1365","reported_seq":1389,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-22T03:57:39.804117+0000","last_change":"2024-09-22T03:55:50.906894+0000","last_active":"2024-09-22T03:57:39.804117+0000","last_peered":"2024-09-22T03:57:39.804117+0000","last_clean":"2024-09-22T03:57:39.804117+0000","last_became_active":"2024-09-22T03:55:50.896899+0000","last_became_peered":"2024-09-22T03:55:50.896899+0000","last_unstale":"2024-09-22T03:57:39.804117+0000","last_undegraded":"2024-09-22T03:57:39.804117+0000","last_fullsized":"2024-09-22T03:57:39.804117+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1365,"log_dups_size":0,"ondisk_log_size":1365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62193664,"num_objects":949,"num_object_clones":0,"num_object_copies":2847,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1365,"num_write_kb":74048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"56'1363","reported_seq":1387,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-22T03:57:40.090989+0000","last_change":"2024-09-22T03:55:50.859578+0000","last_active":"2024-09-22T03:57:40.090989+0000","last_peered":"2024-09-22T03:57:40.090989+0000","last_clean":"2024-09-22T03:57:40.090989+0000","last_became_active":"2024-09-22T03:55:50.843710+0000","last_became_peered":"2024-09-22T03:55:50.843710+0000","last_unstale":"2024-09-22T03:57:40.090989+0000","last_undegraded":"2024-09-22T03:57:40.090989+0000","last_fullsized":"2024-09-22T03:57:40.090989+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1363,"log_dups_size":0,"ondisk_log_size":1363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59572224,"num_objects":909,"num_object_clones":0,"num_object_copies":2727,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1363,"num_write_kb":72704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"56'1399","reported_seq":1423,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-22T03:57:39.798728+0000","last_change":"2024-09-22T03:55:50.968411+0000","last_active":"2024-09-22T03:57:39.798728+0000","last_peered":"2024-09-22T03:57:39.798728+0000","last_clean":"2024-09-22T03:57:39.798728+0000","last_became_active":"2024-09-22T03:55:50.961718+0000","last_became_peered":"2024-09-22T03:55:50.961718+0000","last_unstale":"2024-09-22T03:57:39.798728+0000","last_undegraded":"2024-09-22T03:57:39.798728+0000","last_fullsized":"2024-09-22T03:57:39.798728+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1399,"log_dups_size":0,"ondisk_log_size":1399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62980096,"num_objects":961,"num_object_clones":0,"num_object_copies":2883,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1399,"num_write_kb":75520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":199,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:51.749469+0000","last_change":"2024-09-22T03:49:12.034704+0000","last_active":"2024-09-22T03:55:51.749469+0000","last_peered":"2024-09-22T03:55:51.749469+0000","last_clean":"2024-09-22T03:55:51.749469+0000","last_became_active":"2024-09-22T03:49:12.027470+0000","last_became_peered":"2024-09-22T03:49:12.027470+0000","last_unstale":"2024-09-22T03:55:51.749469+0000","last_undegraded":"2024-09-22T03:55:51.749469+0000","last_fullsized":"2024-09-22T03:55:51.749469+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_clean_scrub_stamp":"2024-09-22T03:49:10.979949+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":137,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-22T03:57:39.802603+0000","last_change":"2024-09-22T03:49:17.031458+0000","last_active":"2024-09-22T03:57:39.802603+0000","last_peered":"2024-09-22T03:57:39.802603+0000","last_clean":"2024-09-22T03:57:39.802603+0000","last_became_active":"2024-09-22T03:49:15.125490+0000","last_became_peered":"2024-09-22T03:49:15.125490+0000","last_unstale":"2024-09-22T03:57:39.802603+0000","last_undegraded":"2024-09-22T03:57:39.802603+0000","last_fullsized":"2024-09-22T03:57:39.802603+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.7","version":"56'1383","reported_seq":1407,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-22T03:57:39.937056+0000","last_change":"2024-09-22T03:55:50.910597+0000","last_active":"2024-09-22T03:57:39.937056+0000","last_peered":"2024-09-22T03:57:39.937056+0000","last_clean":"2024-09-22T03:57:39.937056+0000","last_became_active":"2024-09-22T03:55:50.901290+0000","last_became_peered":"2024-09-22T03:55:50.901290+0000","last_unstale":"2024-09-22T03:57:39.937056+0000","last_undegraded":"2024-09-22T03:57:39.937056+0000","last_fullsized":"2024-09-22T03:57:39.937056+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1383,"log_dups_size":0,"ondisk_log_size":1383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60620800,"num_objects":925,"num_object_clones":0,"num_object_copies":2775,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1383,"num_write_kb":73856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":136,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-22T03:57:39.794072+0000","last_change":"2024-09-22T03:49:17.029339+0000","last_active":"2024-09-22T03:57:39.794072+0000","last_peered":"2024-09-22T03:57:39.794072+0000","last_clean":"2024-09-22T03:57:39.794072+0000","last_became_active":"2024-09-22T03:49:15.097304+0000","last_became_peered":"2024-09-22T03:49:15.097304+0000","last_unstale":"2024-09-22T03:57:39.794072+0000","last_undegraded":"2024-09-22T03:57:39.794072+0000","last_fullsized":"2024-09-22T03:57:39.794072+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"52'1300","reported_seq":1312,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:57:35.633192+0000","last_change":"2024-09-22T03:55:50.918358+0000","last_active":"2024-09-22T03:57:35.633192+0000","last_peered":"2024-09-22T03:57:35.633192+0000","last_clean":"2024-09-22T03:57:35.633192+0000","last_became_active":"2024-09-22T03:55:50.889906+0000","last_became_peered":"2024-09-22T03:55:50.889906+0000","last_unstale":"2024-09-22T03:57:35.633192+0000","last_undegraded":"2024-09-22T03:57:35.633192+0000","last_fullsized":"2024-09-22T03:57:35.633192+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1300,"log_dups_size":0,"ondisk_log_size":1300,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62783488,"num_objects":958,"num_object_clones":0,"num_object_copies":2874,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1300,"num_write_kb":72256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":136,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-22T03:57:39.796507+0000","last_change":"2024-09-22T03:49:17.029349+0000","last_active":"2024-09-22T03:57:39.796507+0000","last_peered":"2024-09-22T03:57:39.796507+0000","last_clean":"2024-09-22T03:57:39.796507+0000","last_became_active":"2024-09-22T03:49:15.094890+0000","last_became_peered":"2024-09-22T03:49:15.094890+0000","last_unstale":"2024-09-22T03:57:39.796507+0000","last_undegraded":"2024-09-22T03:57:39.796507+0000","last_fullsized":"2024-09-22T03:57:39.796507+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"56'1365","reported_seq":1389,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-22T03:57:40.024596+0000","last_change":"2024-09-22T03:55:50.939050+0000","last_active":"2024-09-22T03:57:40.024596+0000","last_peered":"2024-09-22T03:57:40.024596+0000","last_clean":"2024-09-22T03:57:40.024596+0000","last_became_active":"2024-09-22T03:55:50.929831+0000","last_became_peered":"2024-09-22T03:55:50.929831+0000","last_unstale":"2024-09-22T03:57:40.024596+0000","last_undegraded":"2024-09-22T03:57:40.024596+0000","last_fullsized":"2024-09-22T03:57:40.024596+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1365,"log_dups_size":0,"ondisk_log_size":1365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62062592,"num_objects":947,"num_object_clones":0,"num_object_copies":2841,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1365,"num_write_kb":73984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":138,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-22T03:57:39.799918+0000","last_change":"2024-09-22T03:49:17.031466+0000","last_active":"2024-09-22T03:57:39.799918+0000","last_peered":"2024-09-22T03:57:39.799918+0000","last_clean":"2024-09-22T03:57:39.799918+0000","last_became_active":"2024-09-22T03:49:15.098420+0000","last_became_peered":"2024-09-22T03:49:15.098420+0000","last_unstale":"2024-09-22T03:57:39.799918+0000","last_undegraded":"2024-09-22T03:57:39.799918+0000","last_fullsized":"2024-09-22T03:57:39.799918+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3","version":"56'1328","reported_seq":1352,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-22T03:57:39.890978+0000","last_change":"2024-09-22T03:55:50.862956+0000","last_active":"2024-09-22T03:57:39.890978+0000","last_peered":"2024-09-22T03:57:39.890978+0000","last_clean":"2024-09-22T03:57:39.890978+0000","last_became_active":"2024-09-22T03:55:50.854828+0000","last_became_peered":"2024-09-22T03:55:50.854828+0000","last_unstale":"2024-09-22T03:57:39.890978+0000","last_undegraded":"2024-09-22T03:57:39.890978+0000","last_fullsized":"2024-09-22T03:57:39.890978+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1328,"log_dups_size":0,"ondisk_log_size":1328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59637760,"num_objects":910,"num_object_clones":0,"num_object_copies":2730,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1328,"num_write_kb":71616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":124,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:51.754967+0000","last_change":"2024-09-22T03:49:17.036954+0000","last_active":"2024-09-22T03:55:51.754967+0000","last_peered":"2024-09-22T03:55:51.754967+0000","last_clean":"2024-09-22T03:55:51.754967+0000","last_became_active":"2024-09-22T03:49:15.110506+0000","last_became_peered":"2024-09-22T03:49:15.110506+0000","last_unstale":"2024-09-22T03:55:51.754967+0000","last_undegraded":"2024-09-22T03:55:51.754967+0000","last_fullsized":"2024-09-22T03:55:51.754967+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"56'1356","reported_seq":1380,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-22T03:57:40.031650+0000","last_change":"2024-09-22T03:55:50.927264+0000","last_active":"2024-09-22T03:57:40.031650+0000","last_peered":"2024-09-22T03:57:40.031650+0000","last_clean":"2024-09-22T03:57:40.031650+0000","last_became_active":"2024-09-22T03:55:50.919600+0000","last_became_peered":"2024-09-22T03:55:50.919600+0000","last_unstale":"2024-09-22T03:57:40.031650+0000","last_undegraded":"2024-09-22T03:57:40.031650+0000","last_fullsized":"2024-09-22T03:57:40.031650+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1356,"log_dups_size":0,"ondisk_log_size":1356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59637760,"num_objects":910,"num_object_clones":0,"num_object_copies":2730,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1356,"num_write_kb":72512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":124,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:51.747974+0000","last_change":"2024-09-22T03:49:17.032989+0000","last_active":"2024-09-22T03:55:51.747974+0000","last_peered":"2024-09-22T03:55:51.747974+0000","last_clean":"2024-09-22T03:55:51.747974+0000","last_became_active":"2024-09-22T03:49:15.079260+0000","last_became_peered":"2024-09-22T03:49:15.079260+0000","last_unstale":"2024-09-22T03:55:51.747974+0000","last_undegraded":"2024-09-22T03:55:51.747974+0000","last_fullsized":"2024-09-22T03:55:51.747974+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"52'1321","reported_seq":1333,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:57:36.138720+0000","last_change":"2024-09-22T03:55:50.862926+0000","last_active":"2024-09-22T03:57:36.138720+0000","last_peered":"2024-09-22T03:57:36.138720+0000","last_clean":"2024-09-22T03:57:36.138720+0000","last_became_active":"2024-09-22T03:55:50.851824+0000","last_became_peered":"2024-09-22T03:55:50.851824+0000","last_unstale":"2024-09-22T03:57:36.138720+0000","last_undegraded":"2024-09-22T03:57:36.138720+0000","last_fullsized":"2024-09-22T03:57:36.138720+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1321,"log_dups_size":0,"ondisk_log_size":1321,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65732608,"num_objects":1003,"num_object_clones":0,"num_object_copies":3009,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1321,"num_write_kb":74368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":124,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-22T03:55:51.758850+0000","last_change":"2024-09-22T03:49:17.036402+0000","last_active":"2024-09-22T03:55:51.758850+0000","last_peered":"2024-09-22T03:55:51.758850+0000","last_clean":"2024-09-22T03:55:51.758850+0000","last_became_active":"2024-09-22T03:49:15.108430+0000","last_became_peered":"2024-09-22T03:49:15.108430+0000","last_unstale":"2024-09-22T03:55:51.758850+0000","last_undegraded":"2024-09-22T03:55:51.758850+0000","last_fullsized":"2024-09-22T03:55:51.758850+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"56'1338","reported_seq":1362,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-22T03:57:39.984189+0000","last_change":"2024-09-22T03:55:50.878789+0000","last_active":"2024-09-22T03:57:39.984189+0000","last_peered":"2024-09-22T03:57:39.984189+0000","last_clean":"2024-09-22T03:57:39.984189+0000","last_became_active":"2024-09-22T03:55:50.852561+0000","last_became_peered":"2024-09-22T03:55:50.852561+0000","last_unstale":"2024-09-22T03:57:39.984189+0000","last_undegraded":"2024-09-22T03:57:39.984189+0000","last_fullsized":"2024-09-22T03:57:39.984189+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1338,"log_dups_size":0,"ondisk_log_size":1338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61341696,"num_objects":936,"num_object_clones":0,"num_object_copies":2808,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1338,"num_write_kb":72768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":136,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-22T03:57:39.795995+0000","last_change":"2024-09-22T03:49:17.029128+0000","last_active":"2024-09-22T03:57:39.795995+0000","last_peered":"2024-09-22T03:57:39.795995+0000","last_clean":"2024-09-22T03:57:39.795995+0000","last_became_active":"2024-09-22T03:49:15.113396+0000","last_became_peered":"2024-09-22T03:49:15.113396+0000","last_unstale":"2024-09-22T03:57:39.795995+0000","last_undegraded":"2024-09-22T03:57:39.795995+0000","last_fullsized":"2024-09-22T03:57:39.795995+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":990707736,"num_objects":15118,"num_object_clones":0,"num_object_copies":45354,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":21666,"num_write_kb":1177025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":185274368,"data_stored":2964193352,"data_compressed":140755757,"data_compressed_allocated":185262080,"data_compressed_original":2964193280,"omap_allocated":0,"internal_metadata":0},"log_size":21666,"ondisk_log_size":21666,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949673464,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":129208,"kb_used_data":39908,"kb_used_omap":0,"kb_used_meta":89280,"kb_avail":94242632,"statfs":{"total":96636764160,"available":96504455168,"internally_reserved":0,"allocated":40865792,"data_stored":646539648,"data_compressed":30695703,"data_compressed_allocated":40402944,"data_compressed_original":646365184,"omap_allocated":0,"internal_metadata":91422720},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654706173,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":130344,"kb_used_data":45208,"kb_used_omap":0,"kb_used_meta":85120,"kb_avail":94241496,"statfs":{"total":96636764160,"available":96503291904,"internally_reserved":0,"allocated":46292992,"data_stored":733190812,"data_compressed":34807719,"data_compressed_allocated":45813760,"data_compressed_original":733020160,"omap_allocated":0,"internal_metadata":87162880},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706172,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":130840,"kb_used_data":45704,"kb_used_omap":0,"kb_used_meta":85120,"kb_avail":94241000,"statfs":{"total":96636764160,"available":96502784000,"internally_reserved":0,"allocated":46800896,"data_stored":741052403,"data_compressed":35183207,"data_compressed_allocated":46309376,"data_compressed_original":740868096,"omap_allocated":0,"internal_metadata":87162880},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706173,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":150400,"kb_used_data":52780,"kb_used_omap":0,"kb_used_meta":97600,"kb_avail":94221440,"statfs":{"total":96636764160,"available":96482754560,"internally_reserved":0,"allocated":54046720,"data_stored":856923305,"data_compressed":40685224,"data_compressed_allocated":53551104,"data_compressed_original":856735744,"omap_allocated":0,"internal_metadata":99942400},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":53501952,"data_stored":855965720,"data_compressed":40645832,"data_compressed_allocated":53497856,"data_compressed_original":855965696,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40316928,"data_stored":645070848,"data_compressed":30631415,"data_compressed_allocated":40316928,"data_compressed_original":645070848,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45694976,"data_stored":731054104,"data_compressed":34714359,"data_compressed_allocated":45690880,"data_compressed_original":731054080,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45760512,"data_stored":732102680,"data_compressed":34764151,"data_compressed_allocated":45756416,"data_compressed_original":732102656,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:57:43.059 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:57:43.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:57:43.211+0000 7f00c1b11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:57:43.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:57:43.219+0000 7f00c1b11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:57:45.682 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:57:45.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:57:45.856+0000 7f2aaa4fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:57:45.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:57:45.867+0000 7f2aaa4fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:57:46.480 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:57:46.480 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:57:46.481 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:57:46.481 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:57:46.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:57:46.635+0000 7f56d32c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:57:46.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:57:46.649+0000 7f56d32c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:57:46.846 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:57:46.847 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:57:46.847 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:57:46.847 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:57:46.847 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:57:46.847 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:57:46.847 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:57:46.847 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:57:46.847 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:57:46.847 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:57:46.847 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:57:46.847 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:57:46.850 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:57:46.850 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:57:46.851 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:57:47.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:57:46.997+0000 7f8c46cec640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:57:47.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:57:47.013+0000 7f8c46cec640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:57:47.066 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:57:47.066 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:57:47.066 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:57:47.066 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:57:47.066 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:57:47.066 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:57:47.066 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:57:47.066 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:57:47.066 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:57:47.067 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:57:47.067 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:57:47.067 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:57:47.070 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:57:47.071 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:57:47.071 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:57:47.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:57:47.222+0000 7f7b8d0a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:57:47.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:57:47.236+0000 7f7b8d0a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:57:47.342 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:57:47.342 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:57:47.342 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:57:47.342 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:57:47.342 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:57:47.342 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:57:47.343 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:57:47.343 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:57:47.343 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:57:47.343 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:57:47.343 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:57:47.343 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:57:47.345 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:57:47.346 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:57:47.346 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:57:47.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:57:47.504+0000 7f87204fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:57:47.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:57:47.522+0000 7f87204fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:57:47.572 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:57:47.572 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:57:47.572 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:57:47.572 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:57:47.572 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:57:47.572 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:57:47.572 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:57:47.572 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:57:47.572 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:57:47.573 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:57:47.573 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:57:47.573 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:57:47.576 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:57:47.577 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:57:48.450 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:57:48.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:57:48.608+0000 7f595fb51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:57:48.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:57:48.617+0000 7f595fb51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:57:51.025 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:57:51.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:57:51.162+0000 7f5ed4ebd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:57:51.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:57:51.174+0000 7f5ed4ebd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:57:52.578 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:57:52.578 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:57:52.578 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:57:52.578 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:57:52.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:57:52.743+0000 7fcb29a4f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:57:52.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:57:52.755+0000 7fcb29a4f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:57:52.854 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:57:52.855 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:57:52.855 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:57:52.855 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:57:52.855 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:57:52.855 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:57:52.855 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:57:52.855 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:57:52.855 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:57:52.855 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:57:52.855 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:57:52.855 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:57:52.858 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:57:52.859 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:57:52.859 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:57:53.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:57:53.018+0000 7f85af2ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:57:53.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:57:53.036+0000 7f85af2ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:57:53.184 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:57:53.185 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:57:53.185 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:57:53.185 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:57:53.185 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:57:53.185 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:57:53.185 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:57:53.185 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:57:53.185 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:57:53.185 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:57:53.185 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:57:53.185 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:57:53.188 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:57:53.189 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:57:53.189 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:57:53.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:57:53.328+0000 7f9b1dafd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:57:53.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:57:53.349+0000 7f9b1dafd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:57:53.444 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:57:53.444 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:57:53.445 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:57:53.445 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:57:53.445 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:57:53.445 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:57:53.445 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:57:53.445 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:57:53.445 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:57:53.445 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:57:53.445 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:57:53.445 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:57:53.449 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:57:53.449 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:57:53.449 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:57:53.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:57:53.616+0000 7f71ef991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:57:53.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:57:53.632+0000 7f71ef991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:57:53.801 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:57:53.801 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:57:53.801 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:57:53.801 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:57:53.801 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:57:53.801 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:57:53.801 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:57:53.801 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:57:53.801 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:57:53.802 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:57:53.802 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:57:53.802 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:57:53.804 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:57:53.804 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:57:53.897 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:57:54.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:57:54.053+0000 7fd5b2391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:57:54.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:57:54.061+0000 7fd5b2391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:57:56.400 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:57:56.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:57:56.549+0000 7f0bc50fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:57:56.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:57:56.558+0000 7f0bc50fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:57:58.805 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:57:58.805 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-22T03:57:58.879 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:57:58.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:57:58.964+0000 7f2f9b191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:57:58.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:57:58.986+0000 7f2f9b191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:57:59.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:57:59.054+0000 7fca16791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:57:59.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:57:59.065+0000 7fca16791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:57:59.720 INFO:teuthology.orchestra.run.smithi037.stderr:reweighted osd.0 to 1 (10000) 2024-09-22T03:57:59.742 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-22T03:57:59.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:57:59.907+0000 7f763927d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:57:59.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:57:59.930+0000 7f763927d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:58:00.729 INFO:teuthology.orchestra.run.smithi037.stderr:reweighted osd.1 to 1 (10000) 2024-09-22T03:58:00.752 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-22T03:58:00.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:58:00.904+0000 7f1068308640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:58:00.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:58:00.923+0000 7f1068308640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:58:01.670 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:58:01.739 INFO:teuthology.orchestra.run.smithi037.stderr:reweighted osd.2 to 1 (10000) 2024-09-22T03:58:01.766 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-22T03:58:01.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:58:01.840+0000 7fd732f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:58:01.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:58:01.851+0000 7fd732f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:58:01.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:58:01.936+0000 7f5867d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:58:01.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:58:01.950+0000 7f5867d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:58:02.747 INFO:teuthology.orchestra.run.smithi037.stderr:reweighted osd.3 to 1 (10000) 2024-09-22T03:58:02.773 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-22T03:58:02.773 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:58:02.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:58:02.937+0000 7f26da111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:58:02.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:58:02.950+0000 7f26da111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:58:03.342 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:58:03.343 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-22T03:58:03.364 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":320,"stamp":"2024-09-22T03:58:03.076235+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":727843403,"num_objects":11102,"num_object_clones":0,"num_object_copies":33306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":25767,"num_write_kb":1178133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25741,"ondisk_log_size":25741,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":476992,"kb_used_data":136440,"kb_used_omap":0,"kb_used_meta":340480,"kb_avail":377010368,"statfs":{"total":386547056640,"available":386058616832,"internally_reserved":0,"allocated":139714560,"data_stored":2204014336,"data_compressed":104631581,"data_compressed_allocated":137719808,"data_compressed_original":2203271168,"omap_allocated":0,"internal_metadata":348651520},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-59637760,"num_objects":-910,"num_object_clones":0,"num_object_copies":-2730,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":910,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000661"},"pg_stats":[{"pgid":"5.f","version":"58'1621","reported_seq":1651,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:58:00.950858+0000","last_change":"2024-09-22T03:55:50.938932+0000","last_active":"2024-09-22T03:58:00.950858+0000","last_peered":"2024-09-22T03:58:00.950858+0000","last_clean":"2024-09-22T03:58:00.950858+0000","last_became_active":"2024-09-22T03:55:50.929290+0000","last_became_peered":"2024-09-22T03:55:50.929290+0000","last_unstale":"2024-09-22T03:58:00.950858+0000","last_undegraded":"2024-09-22T03:58:00.950858+0000","last_fullsized":"2024-09-22T03:58:00.950858+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1621,"log_dups_size":0,"ondisk_log_size":1621,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45809664,"num_objects":699,"num_object_clones":0,"num_object_copies":2097,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1621,"num_write_kb":74240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"57'1596","reported_seq":1623,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-22T03:58:00.020506+0000","last_change":"2024-09-22T03:55:50.848180+0000","last_active":"2024-09-22T03:58:00.020506+0000","last_peered":"2024-09-22T03:58:00.020506+0000","last_clean":"2024-09-22T03:58:00.020506+0000","last_became_active":"2024-09-22T03:55:50.838302+0000","last_became_peered":"2024-09-22T03:55:50.838302+0000","last_unstale":"2024-09-22T03:58:00.020506+0000","last_undegraded":"2024-09-22T03:58:00.020506+0000","last_fullsized":"2024-09-22T03:58:00.020506+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1596,"log_dups_size":0,"ondisk_log_size":1596,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44957696,"num_objects":686,"num_object_clones":0,"num_object_copies":2058,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1596,"num_write_kb":73024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"57'1680","reported_seq":1708,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-22T03:58:00.010902+0000","last_change":"2024-09-22T03:55:50.872362+0000","last_active":"2024-09-22T03:58:00.010902+0000","last_peered":"2024-09-22T03:58:00.010902+0000","last_clean":"2024-09-22T03:58:00.010902+0000","last_became_active":"2024-09-22T03:55:50.867322+0000","last_became_peered":"2024-09-22T03:55:50.867322+0000","last_unstale":"2024-09-22T03:58:00.010902+0000","last_undegraded":"2024-09-22T03:58:00.010902+0000","last_fullsized":"2024-09-22T03:58:00.010902+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1680,"log_dups_size":0,"ondisk_log_size":1680,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45809688,"num_objects":700,"num_object_clones":0,"num_object_copies":2100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1680,"num_write_kb":76097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"58'1651","reported_seq":1681,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:58:01.162221+0000","last_change":"2024-09-22T03:55:50.942624+0000","last_active":"2024-09-22T03:58:01.162221+0000","last_peered":"2024-09-22T03:58:01.162221+0000","last_clean":"2024-09-22T03:58:01.162221+0000","last_became_active":"2024-09-22T03:55:50.922812+0000","last_became_peered":"2024-09-22T03:55:50.922812+0000","last_unstale":"2024-09-22T03:58:01.162221+0000","last_undegraded":"2024-09-22T03:58:01.162221+0000","last_fullsized":"2024-09-22T03:58:01.162221+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1651,"log_dups_size":0,"ondisk_log_size":1651,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45809664,"num_objects":699,"num_object_clones":0,"num_object_copies":2097,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1651,"num_write_kb":75200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"57'1554","reported_seq":1581,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-22T03:58:00.066849+0000","last_change":"2024-09-22T03:55:50.890353+0000","last_active":"2024-09-22T03:58:00.066849+0000","last_peered":"2024-09-22T03:58:00.066849+0000","last_clean":"2024-09-22T03:58:00.066849+0000","last_became_active":"2024-09-22T03:55:50.882633+0000","last_became_peered":"2024-09-22T03:55:50.882633+0000","last_unstale":"2024-09-22T03:58:00.066849+0000","last_undegraded":"2024-09-22T03:58:00.066849+0000","last_fullsized":"2024-09-22T03:58:00.066849+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1554,"log_dups_size":0,"ondisk_log_size":1554,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43646976,"num_objects":666,"num_object_clones":0,"num_object_copies":1998,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1554,"num_write_kb":71040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.a","version":"57'1597","reported_seq":1624,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-22T03:57:59.971439+0000","last_change":"2024-09-22T03:55:50.891052+0000","last_active":"2024-09-22T03:57:59.971439+0000","last_peered":"2024-09-22T03:57:59.971439+0000","last_clean":"2024-09-22T03:57:59.971439+0000","last_became_active":"2024-09-22T03:55:50.880295+0000","last_became_peered":"2024-09-22T03:55:50.880295+0000","last_unstale":"2024-09-22T03:57:59.971439+0000","last_undegraded":"2024-09-22T03:57:59.971439+0000","last_fullsized":"2024-09-22T03:57:59.971439+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1597,"log_dups_size":0,"ondisk_log_size":1597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46465024,"num_objects":709,"num_object_clones":0,"num_object_copies":2127,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1597,"num_write_kb":73792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"57'1607","reported_seq":1634,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-22T03:57:59.919904+0000","last_change":"2024-09-22T03:55:50.906894+0000","last_active":"2024-09-22T03:57:59.919904+0000","last_peered":"2024-09-22T03:57:59.919904+0000","last_clean":"2024-09-22T03:57:59.919904+0000","last_became_active":"2024-09-22T03:55:50.896899+0000","last_became_peered":"2024-09-22T03:55:50.896899+0000","last_unstale":"2024-09-22T03:57:59.919904+0000","last_undegraded":"2024-09-22T03:57:59.919904+0000","last_fullsized":"2024-09-22T03:57:59.919904+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1607,"log_dups_size":0,"ondisk_log_size":1607,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46333952,"num_objects":707,"num_object_clones":0,"num_object_copies":2121,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1607,"num_write_kb":74048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"57'1593","reported_seq":1620,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-22T03:57:59.908726+0000","last_change":"2024-09-22T03:55:50.859578+0000","last_active":"2024-09-22T03:57:59.908726+0000","last_peered":"2024-09-22T03:57:59.908726+0000","last_clean":"2024-09-22T03:57:59.908726+0000","last_became_active":"2024-09-22T03:55:50.843710+0000","last_became_peered":"2024-09-22T03:55:50.843710+0000","last_unstale":"2024-09-22T03:57:59.908726+0000","last_undegraded":"2024-09-22T03:57:59.908726+0000","last_fullsized":"2024-09-22T03:57:59.908726+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1593,"log_dups_size":0,"ondisk_log_size":1593,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44498944,"num_objects":679,"num_object_clones":0,"num_object_copies":2037,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1593,"num_write_kb":72704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"57'1638","reported_seq":1665,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-22T03:58:00.108069+0000","last_change":"2024-09-22T03:55:50.968411+0000","last_active":"2024-09-22T03:58:00.108069+0000","last_peered":"2024-09-22T03:58:00.108069+0000","last_clean":"2024-09-22T03:58:00.108069+0000","last_became_active":"2024-09-22T03:55:50.961718+0000","last_became_peered":"2024-09-22T03:55:50.961718+0000","last_unstale":"2024-09-22T03:58:00.108069+0000","last_undegraded":"2024-09-22T03:58:00.108069+0000","last_fullsized":"2024-09-22T03:58:00.108069+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1638,"log_dups_size":0,"ondisk_log_size":1638,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47316992,"num_objects":722,"num_object_clones":0,"num_object_copies":2166,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1638,"num_write_kb":75520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":217,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:58:00.773536+0000","last_change":"2024-09-22T03:49:12.034704+0000","last_active":"2024-09-22T03:58:00.773536+0000","last_peered":"2024-09-22T03:58:00.773536+0000","last_clean":"2024-09-22T03:58:00.773536+0000","last_became_active":"2024-09-22T03:49:12.027470+0000","last_became_peered":"2024-09-22T03:49:12.027470+0000","last_unstale":"2024-09-22T03:58:00.773536+0000","last_undegraded":"2024-09-22T03:58:00.773536+0000","last_fullsized":"2024-09-22T03:58:00.773536+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_clean_scrub_stamp":"2024-09-22T03:49:10.979949+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":140,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-22T03:57:59.765831+0000","last_change":"2024-09-22T03:49:17.031458+0000","last_active":"2024-09-22T03:57:59.765831+0000","last_peered":"2024-09-22T03:57:59.765831+0000","last_clean":"2024-09-22T03:57:59.765831+0000","last_became_active":"2024-09-22T03:49:15.125490+0000","last_became_peered":"2024-09-22T03:49:15.125490+0000","last_unstale":"2024-09-22T03:57:59.765831+0000","last_undegraded":"2024-09-22T03:57:59.765831+0000","last_fullsized":"2024-09-22T03:57:59.765831+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.7","version":"57'1617","reported_seq":1644,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-22T03:58:00.059362+0000","last_change":"2024-09-22T03:55:50.910597+0000","last_active":"2024-09-22T03:58:00.059362+0000","last_peered":"2024-09-22T03:58:00.059362+0000","last_clean":"2024-09-22T03:58:00.059362+0000","last_became_active":"2024-09-22T03:55:50.901290+0000","last_became_peered":"2024-09-22T03:55:50.901290+0000","last_unstale":"2024-09-22T03:58:00.059362+0000","last_undegraded":"2024-09-22T03:58:00.059362+0000","last_fullsized":"2024-09-22T03:58:00.059362+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1617,"log_dups_size":0,"ondisk_log_size":1617,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45285376,"num_objects":691,"num_object_clones":0,"num_object_copies":2073,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1617,"num_write_kb":73856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":139,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-22T03:57:59.754645+0000","last_change":"2024-09-22T03:49:17.029339+0000","last_active":"2024-09-22T03:57:59.754645+0000","last_peered":"2024-09-22T03:57:59.754645+0000","last_clean":"2024-09-22T03:57:59.754645+0000","last_became_active":"2024-09-22T03:49:15.097304+0000","last_became_peered":"2024-09-22T03:49:15.097304+0000","last_unstale":"2024-09-22T03:57:59.754645+0000","last_undegraded":"2024-09-22T03:57:59.754645+0000","last_fullsized":"2024-09-22T03:57:59.754645+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"58'1601","reported_seq":1631,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:58:00.982509+0000","last_change":"2024-09-22T03:55:50.918358+0000","last_active":"2024-09-22T03:58:00.982509+0000","last_peered":"2024-09-22T03:58:00.982509+0000","last_clean":"2024-09-22T03:58:00.982509+0000","last_became_active":"2024-09-22T03:55:50.889906+0000","last_became_peered":"2024-09-22T03:55:50.889906+0000","last_unstale":"2024-09-22T03:58:00.982509+0000","last_undegraded":"2024-09-22T03:58:00.982509+0000","last_fullsized":"2024-09-22T03:58:00.982509+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1601,"log_dups_size":0,"ondisk_log_size":1601,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43057152,"num_objects":657,"num_object_clones":0,"num_object_copies":1971,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1601,"num_write_kb":72256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":139,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-22T03:57:59.772334+0000","last_change":"2024-09-22T03:49:17.029349+0000","last_active":"2024-09-22T03:57:59.772334+0000","last_peered":"2024-09-22T03:57:59.772334+0000","last_clean":"2024-09-22T03:57:59.772334+0000","last_became_active":"2024-09-22T03:49:15.094890+0000","last_became_peered":"2024-09-22T03:49:15.094890+0000","last_unstale":"2024-09-22T03:57:59.772334+0000","last_undegraded":"2024-09-22T03:57:59.772334+0000","last_fullsized":"2024-09-22T03:57:59.772334+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"57'1622","reported_seq":1649,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-22T03:57:59.938422+0000","last_change":"2024-09-22T03:55:50.939050+0000","last_active":"2024-09-22T03:57:59.938422+0000","last_peered":"2024-09-22T03:57:59.938422+0000","last_clean":"2024-09-22T03:57:59.938422+0000","last_became_active":"2024-09-22T03:55:50.929831+0000","last_became_peered":"2024-09-22T03:55:50.929831+0000","last_unstale":"2024-09-22T03:57:59.938422+0000","last_undegraded":"2024-09-22T03:57:59.938422+0000","last_fullsized":"2024-09-22T03:57:59.938422+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1622,"log_dups_size":0,"ondisk_log_size":1622,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45219840,"num_objects":690,"num_object_clones":0,"num_object_copies":2070,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1622,"num_write_kb":73984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":141,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-22T03:57:59.761610+0000","last_change":"2024-09-22T03:49:17.031466+0000","last_active":"2024-09-22T03:57:59.761610+0000","last_peered":"2024-09-22T03:57:59.761610+0000","last_clean":"2024-09-22T03:57:59.761610+0000","last_became_active":"2024-09-22T03:49:15.098420+0000","last_became_peered":"2024-09-22T03:49:15.098420+0000","last_unstale":"2024-09-22T03:57:59.761610+0000","last_undegraded":"2024-09-22T03:57:59.761610+0000","last_fullsized":"2024-09-22T03:57:59.761610+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3","version":"57'1544","reported_seq":1571,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-22T03:57:59.879402+0000","last_change":"2024-09-22T03:55:50.862956+0000","last_active":"2024-09-22T03:57:59.879402+0000","last_peered":"2024-09-22T03:57:59.879402+0000","last_clean":"2024-09-22T03:57:59.879402+0000","last_became_active":"2024-09-22T03:55:50.854828+0000","last_became_peered":"2024-09-22T03:55:50.854828+0000","last_unstale":"2024-09-22T03:57:59.879402+0000","last_undegraded":"2024-09-22T03:57:59.879402+0000","last_fullsized":"2024-09-22T03:57:59.879402+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1544,"log_dups_size":0,"ondisk_log_size":1544,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45481984,"num_objects":694,"num_object_clones":0,"num_object_copies":2082,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1544,"num_write_kb":71616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":142,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:58:00.790803+0000","last_change":"2024-09-22T03:49:17.036954+0000","last_active":"2024-09-22T03:58:00.790803+0000","last_peered":"2024-09-22T03:58:00.790803+0000","last_clean":"2024-09-22T03:58:00.790803+0000","last_became_active":"2024-09-22T03:49:15.110506+0000","last_became_peered":"2024-09-22T03:49:15.110506+0000","last_unstale":"2024-09-22T03:58:00.790803+0000","last_undegraded":"2024-09-22T03:58:00.790803+0000","last_fullsized":"2024-09-22T03:58:00.790803+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"57'1592","reported_seq":1619,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-22T03:58:00.019989+0000","last_change":"2024-09-22T03:55:50.927264+0000","last_active":"2024-09-22T03:58:00.019989+0000","last_peered":"2024-09-22T03:58:00.019989+0000","last_clean":"2024-09-22T03:58:00.019989+0000","last_became_active":"2024-09-22T03:55:50.919600+0000","last_became_peered":"2024-09-22T03:55:50.919600+0000","last_unstale":"2024-09-22T03:58:00.019989+0000","last_undegraded":"2024-09-22T03:58:00.019989+0000","last_fullsized":"2024-09-22T03:58:00.019989+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1592,"log_dups_size":0,"ondisk_log_size":1592,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44171264,"num_objects":674,"num_object_clones":0,"num_object_copies":2022,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1592,"num_write_kb":72512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":142,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:58:00.772306+0000","last_change":"2024-09-22T03:49:17.032989+0000","last_active":"2024-09-22T03:58:00.772306+0000","last_peered":"2024-09-22T03:58:00.772306+0000","last_clean":"2024-09-22T03:58:00.772306+0000","last_became_active":"2024-09-22T03:49:15.079260+0000","last_became_peered":"2024-09-22T03:49:15.079260+0000","last_unstale":"2024-09-22T03:58:00.772306+0000","last_undegraded":"2024-09-22T03:58:00.772306+0000","last_fullsized":"2024-09-22T03:58:00.772306+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"58'1617","reported_seq":1647,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:58:01.075915+0000","last_change":"2024-09-22T03:55:50.862926+0000","last_active":"2024-09-22T03:58:01.075915+0000","last_peered":"2024-09-22T03:58:01.075915+0000","last_clean":"2024-09-22T03:58:01.075915+0000","last_became_active":"2024-09-22T03:55:50.851824+0000","last_became_peered":"2024-09-22T03:55:50.851824+0000","last_unstale":"2024-09-22T03:58:01.075915+0000","last_undegraded":"2024-09-22T03:58:01.075915+0000","last_fullsized":"2024-09-22T03:58:01.075915+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1617,"log_dups_size":0,"ondisk_log_size":1617,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46333952,"num_objects":707,"num_object_clones":0,"num_object_copies":2121,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1617,"num_write_kb":74368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":142,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:58:00.773182+0000","last_change":"2024-09-22T03:49:17.036402+0000","last_active":"2024-09-22T03:58:00.773182+0000","last_peered":"2024-09-22T03:58:00.773182+0000","last_clean":"2024-09-22T03:58:00.773182+0000","last_became_active":"2024-09-22T03:49:15.108430+0000","last_became_peered":"2024-09-22T03:49:15.108430+0000","last_unstale":"2024-09-22T03:58:00.773182+0000","last_undegraded":"2024-09-22T03:58:00.773182+0000","last_fullsized":"2024-09-22T03:58:00.773182+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"56'1556","reported_seq":1583,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-22T03:57:59.760605+0000","last_change":"2024-09-22T03:55:50.878789+0000","last_active":"2024-09-22T03:57:59.760605+0000","last_peered":"2024-09-22T03:57:59.760605+0000","last_clean":"2024-09-22T03:57:59.760605+0000","last_became_active":"2024-09-22T03:55:50.852561+0000","last_became_peered":"2024-09-22T03:55:50.852561+0000","last_unstale":"2024-09-22T03:57:59.760605+0000","last_undegraded":"2024-09-22T03:57:59.760605+0000","last_fullsized":"2024-09-22T03:57:59.760605+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1556,"log_dups_size":0,"ondisk_log_size":1556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47054848,"num_objects":718,"num_object_clones":0,"num_object_copies":2154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1556,"num_write_kb":72768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":139,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-22T03:57:59.755545+0000","last_change":"2024-09-22T03:49:17.029128+0000","last_active":"2024-09-22T03:57:59.755545+0000","last_peered":"2024-09-22T03:57:59.755545+0000","last_clean":"2024-09-22T03:57:59.755545+0000","last_became_active":"2024-09-22T03:49:15.113396+0000","last_became_peered":"2024-09-22T03:49:15.113396+0000","last_unstale":"2024-09-22T03:57:59.755545+0000","last_undegraded":"2024-09-22T03:57:59.755545+0000","last_fullsized":"2024-09-22T03:57:59.755545+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":727253016,"num_objects":11098,"num_object_clones":0,"num_object_copies":33294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":25686,"num_write_kb":1177025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":136441856,"data_stored":2182873160,"data_compressed":103654493,"data_compressed_allocated":136429568,"data_compressed_original":2182873088,"omap_allocated":0,"internal_metadata":0},"log_size":25686,"ondisk_log_size":25686,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949673489,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":113292,"kb_used_data":28156,"kb_used_omap":0,"kb_used_meta":85120,"kb_avail":94258548,"statfs":{"total":96636764160,"available":96520753152,"internally_reserved":0,"allocated":28831744,"data_stored":453228086,"data_compressed":21515303,"data_compressed_allocated":28319744,"data_compressed_original":453033984,"omap_allocated":0,"internal_metadata":87162880},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654706193,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":115000,"kb_used_data":34020,"kb_used_omap":0,"kb_used_meta":80960,"kb_avail":94256840,"statfs":{"total":96636764160,"available":96519004160,"internally_reserved":0,"allocated":34836480,"data_stored":549758821,"data_compressed":26097231,"data_compressed_allocated":34349056,"data_compressed_original":549584896,"omap_allocated":0,"internal_metadata":82903040},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706192,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":115100,"kb_used_data":34120,"kb_used_omap":0,"kb_used_meta":80960,"kb_avail":94256740,"statfs":{"total":96636764160,"available":96518901760,"internally_reserved":0,"allocated":34938880,"data_stored":551132348,"data_compressed":26164631,"data_compressed_allocated":34439168,"data_compressed_original":550944768,"omap_allocated":0,"internal_metadata":82903040},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706192,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":133600,"kb_used_data":40144,"kb_used_omap":0,"kb_used_meta":93440,"kb_avail":94238240,"statfs":{"total":96636764160,"available":96499957760,"internally_reserved":0,"allocated":41107456,"data_stored":649895081,"data_compressed":30854416,"data_compressed_allocated":40611840,"data_compressed_original":649707520,"omap_allocated":0,"internal_metadata":95682560},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":39931904,"data_stored":638844952,"data_compressed":30335776,"data_compressed_allocated":39927808,"data_compressed_original":638844928,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28254208,"data_stored":452067328,"data_compressed":21466575,"data_compressed_allocated":28254208,"data_compressed_original":452067328,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":33955840,"data_stored":543227928,"data_compressed":25795367,"data_compressed_allocated":33951744,"data_compressed_original":543227904,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":34299904,"data_stored":548732952,"data_compressed":26056775,"data_compressed_allocated":34295808,"data_compressed_original":548732928,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:58:03.365 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:58:03.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:58:03.536+0000 7fe8a22d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:58:03.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:58:03.552+0000 7fe8a22d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:58:03.854 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:58:03.855 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-22T03:58:03.876 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":320,"stamp":"2024-09-22T03:58:03.076235+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":727843403,"num_objects":11102,"num_object_clones":0,"num_object_copies":33306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":25767,"num_write_kb":1178133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25741,"ondisk_log_size":25741,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":476992,"kb_used_data":136440,"kb_used_omap":0,"kb_used_meta":340480,"kb_avail":377010368,"statfs":{"total":386547056640,"available":386058616832,"internally_reserved":0,"allocated":139714560,"data_stored":2204014336,"data_compressed":104631581,"data_compressed_allocated":137719808,"data_compressed_original":2203271168,"omap_allocated":0,"internal_metadata":348651520},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-59637760,"num_objects":-910,"num_object_clones":0,"num_object_copies":-2730,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":910,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000661"},"pg_stats":[{"pgid":"5.f","version":"58'1621","reported_seq":1651,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:58:00.950858+0000","last_change":"2024-09-22T03:55:50.938932+0000","last_active":"2024-09-22T03:58:00.950858+0000","last_peered":"2024-09-22T03:58:00.950858+0000","last_clean":"2024-09-22T03:58:00.950858+0000","last_became_active":"2024-09-22T03:55:50.929290+0000","last_became_peered":"2024-09-22T03:55:50.929290+0000","last_unstale":"2024-09-22T03:58:00.950858+0000","last_undegraded":"2024-09-22T03:58:00.950858+0000","last_fullsized":"2024-09-22T03:58:00.950858+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1621,"log_dups_size":0,"ondisk_log_size":1621,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45809664,"num_objects":699,"num_object_clones":0,"num_object_copies":2097,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1621,"num_write_kb":74240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"57'1596","reported_seq":1623,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-22T03:58:00.020506+0000","last_change":"2024-09-22T03:55:50.848180+0000","last_active":"2024-09-22T03:58:00.020506+0000","last_peered":"2024-09-22T03:58:00.020506+0000","last_clean":"2024-09-22T03:58:00.020506+0000","last_became_active":"2024-09-22T03:55:50.838302+0000","last_became_peered":"2024-09-22T03:55:50.838302+0000","last_unstale":"2024-09-22T03:58:00.020506+0000","last_undegraded":"2024-09-22T03:58:00.020506+0000","last_fullsized":"2024-09-22T03:58:00.020506+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1596,"log_dups_size":0,"ondisk_log_size":1596,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44957696,"num_objects":686,"num_object_clones":0,"num_object_copies":2058,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1596,"num_write_kb":73024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"57'1680","reported_seq":1708,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-22T03:58:00.010902+0000","last_change":"2024-09-22T03:55:50.872362+0000","last_active":"2024-09-22T03:58:00.010902+0000","last_peered":"2024-09-22T03:58:00.010902+0000","last_clean":"2024-09-22T03:58:00.010902+0000","last_became_active":"2024-09-22T03:55:50.867322+0000","last_became_peered":"2024-09-22T03:55:50.867322+0000","last_unstale":"2024-09-22T03:58:00.010902+0000","last_undegraded":"2024-09-22T03:58:00.010902+0000","last_fullsized":"2024-09-22T03:58:00.010902+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1680,"log_dups_size":0,"ondisk_log_size":1680,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45809688,"num_objects":700,"num_object_clones":0,"num_object_copies":2100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1680,"num_write_kb":76097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"58'1651","reported_seq":1681,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:58:01.162221+0000","last_change":"2024-09-22T03:55:50.942624+0000","last_active":"2024-09-22T03:58:01.162221+0000","last_peered":"2024-09-22T03:58:01.162221+0000","last_clean":"2024-09-22T03:58:01.162221+0000","last_became_active":"2024-09-22T03:55:50.922812+0000","last_became_peered":"2024-09-22T03:55:50.922812+0000","last_unstale":"2024-09-22T03:58:01.162221+0000","last_undegraded":"2024-09-22T03:58:01.162221+0000","last_fullsized":"2024-09-22T03:58:01.162221+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1651,"log_dups_size":0,"ondisk_log_size":1651,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45809664,"num_objects":699,"num_object_clones":0,"num_object_copies":2097,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1651,"num_write_kb":75200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"57'1554","reported_seq":1581,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-22T03:58:00.066849+0000","last_change":"2024-09-22T03:55:50.890353+0000","last_active":"2024-09-22T03:58:00.066849+0000","last_peered":"2024-09-22T03:58:00.066849+0000","last_clean":"2024-09-22T03:58:00.066849+0000","last_became_active":"2024-09-22T03:55:50.882633+0000","last_became_peered":"2024-09-22T03:55:50.882633+0000","last_unstale":"2024-09-22T03:58:00.066849+0000","last_undegraded":"2024-09-22T03:58:00.066849+0000","last_fullsized":"2024-09-22T03:58:00.066849+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1554,"log_dups_size":0,"ondisk_log_size":1554,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43646976,"num_objects":666,"num_object_clones":0,"num_object_copies":1998,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1554,"num_write_kb":71040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.a","version":"57'1597","reported_seq":1624,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-22T03:57:59.971439+0000","last_change":"2024-09-22T03:55:50.891052+0000","last_active":"2024-09-22T03:57:59.971439+0000","last_peered":"2024-09-22T03:57:59.971439+0000","last_clean":"2024-09-22T03:57:59.971439+0000","last_became_active":"2024-09-22T03:55:50.880295+0000","last_became_peered":"2024-09-22T03:55:50.880295+0000","last_unstale":"2024-09-22T03:57:59.971439+0000","last_undegraded":"2024-09-22T03:57:59.971439+0000","last_fullsized":"2024-09-22T03:57:59.971439+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1597,"log_dups_size":0,"ondisk_log_size":1597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46465024,"num_objects":709,"num_object_clones":0,"num_object_copies":2127,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1597,"num_write_kb":73792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"57'1607","reported_seq":1634,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-22T03:57:59.919904+0000","last_change":"2024-09-22T03:55:50.906894+0000","last_active":"2024-09-22T03:57:59.919904+0000","last_peered":"2024-09-22T03:57:59.919904+0000","last_clean":"2024-09-22T03:57:59.919904+0000","last_became_active":"2024-09-22T03:55:50.896899+0000","last_became_peered":"2024-09-22T03:55:50.896899+0000","last_unstale":"2024-09-22T03:57:59.919904+0000","last_undegraded":"2024-09-22T03:57:59.919904+0000","last_fullsized":"2024-09-22T03:57:59.919904+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1607,"log_dups_size":0,"ondisk_log_size":1607,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46333952,"num_objects":707,"num_object_clones":0,"num_object_copies":2121,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1607,"num_write_kb":74048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"57'1593","reported_seq":1620,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-22T03:57:59.908726+0000","last_change":"2024-09-22T03:55:50.859578+0000","last_active":"2024-09-22T03:57:59.908726+0000","last_peered":"2024-09-22T03:57:59.908726+0000","last_clean":"2024-09-22T03:57:59.908726+0000","last_became_active":"2024-09-22T03:55:50.843710+0000","last_became_peered":"2024-09-22T03:55:50.843710+0000","last_unstale":"2024-09-22T03:57:59.908726+0000","last_undegraded":"2024-09-22T03:57:59.908726+0000","last_fullsized":"2024-09-22T03:57:59.908726+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1593,"log_dups_size":0,"ondisk_log_size":1593,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44498944,"num_objects":679,"num_object_clones":0,"num_object_copies":2037,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1593,"num_write_kb":72704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"57'1638","reported_seq":1665,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-22T03:58:00.108069+0000","last_change":"2024-09-22T03:55:50.968411+0000","last_active":"2024-09-22T03:58:00.108069+0000","last_peered":"2024-09-22T03:58:00.108069+0000","last_clean":"2024-09-22T03:58:00.108069+0000","last_became_active":"2024-09-22T03:55:50.961718+0000","last_became_peered":"2024-09-22T03:55:50.961718+0000","last_unstale":"2024-09-22T03:58:00.108069+0000","last_undegraded":"2024-09-22T03:58:00.108069+0000","last_fullsized":"2024-09-22T03:58:00.108069+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1638,"log_dups_size":0,"ondisk_log_size":1638,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47316992,"num_objects":722,"num_object_clones":0,"num_object_copies":2166,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1638,"num_write_kb":75520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":217,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:58:00.773536+0000","last_change":"2024-09-22T03:49:12.034704+0000","last_active":"2024-09-22T03:58:00.773536+0000","last_peered":"2024-09-22T03:58:00.773536+0000","last_clean":"2024-09-22T03:58:00.773536+0000","last_became_active":"2024-09-22T03:49:12.027470+0000","last_became_peered":"2024-09-22T03:49:12.027470+0000","last_unstale":"2024-09-22T03:58:00.773536+0000","last_undegraded":"2024-09-22T03:58:00.773536+0000","last_fullsized":"2024-09-22T03:58:00.773536+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_clean_scrub_stamp":"2024-09-22T03:49:10.979949+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":140,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-22T03:57:59.765831+0000","last_change":"2024-09-22T03:49:17.031458+0000","last_active":"2024-09-22T03:57:59.765831+0000","last_peered":"2024-09-22T03:57:59.765831+0000","last_clean":"2024-09-22T03:57:59.765831+0000","last_became_active":"2024-09-22T03:49:15.125490+0000","last_became_peered":"2024-09-22T03:49:15.125490+0000","last_unstale":"2024-09-22T03:57:59.765831+0000","last_undegraded":"2024-09-22T03:57:59.765831+0000","last_fullsized":"2024-09-22T03:57:59.765831+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.7","version":"57'1617","reported_seq":1644,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-22T03:58:00.059362+0000","last_change":"2024-09-22T03:55:50.910597+0000","last_active":"2024-09-22T03:58:00.059362+0000","last_peered":"2024-09-22T03:58:00.059362+0000","last_clean":"2024-09-22T03:58:00.059362+0000","last_became_active":"2024-09-22T03:55:50.901290+0000","last_became_peered":"2024-09-22T03:55:50.901290+0000","last_unstale":"2024-09-22T03:58:00.059362+0000","last_undegraded":"2024-09-22T03:58:00.059362+0000","last_fullsized":"2024-09-22T03:58:00.059362+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1617,"log_dups_size":0,"ondisk_log_size":1617,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45285376,"num_objects":691,"num_object_clones":0,"num_object_copies":2073,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1617,"num_write_kb":73856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":139,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-22T03:57:59.754645+0000","last_change":"2024-09-22T03:49:17.029339+0000","last_active":"2024-09-22T03:57:59.754645+0000","last_peered":"2024-09-22T03:57:59.754645+0000","last_clean":"2024-09-22T03:57:59.754645+0000","last_became_active":"2024-09-22T03:49:15.097304+0000","last_became_peered":"2024-09-22T03:49:15.097304+0000","last_unstale":"2024-09-22T03:57:59.754645+0000","last_undegraded":"2024-09-22T03:57:59.754645+0000","last_fullsized":"2024-09-22T03:57:59.754645+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"58'1601","reported_seq":1631,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:58:00.982509+0000","last_change":"2024-09-22T03:55:50.918358+0000","last_active":"2024-09-22T03:58:00.982509+0000","last_peered":"2024-09-22T03:58:00.982509+0000","last_clean":"2024-09-22T03:58:00.982509+0000","last_became_active":"2024-09-22T03:55:50.889906+0000","last_became_peered":"2024-09-22T03:55:50.889906+0000","last_unstale":"2024-09-22T03:58:00.982509+0000","last_undegraded":"2024-09-22T03:58:00.982509+0000","last_fullsized":"2024-09-22T03:58:00.982509+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1601,"log_dups_size":0,"ondisk_log_size":1601,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43057152,"num_objects":657,"num_object_clones":0,"num_object_copies":1971,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1601,"num_write_kb":72256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":139,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-22T03:57:59.772334+0000","last_change":"2024-09-22T03:49:17.029349+0000","last_active":"2024-09-22T03:57:59.772334+0000","last_peered":"2024-09-22T03:57:59.772334+0000","last_clean":"2024-09-22T03:57:59.772334+0000","last_became_active":"2024-09-22T03:49:15.094890+0000","last_became_peered":"2024-09-22T03:49:15.094890+0000","last_unstale":"2024-09-22T03:57:59.772334+0000","last_undegraded":"2024-09-22T03:57:59.772334+0000","last_fullsized":"2024-09-22T03:57:59.772334+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"57'1622","reported_seq":1649,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-22T03:57:59.938422+0000","last_change":"2024-09-22T03:55:50.939050+0000","last_active":"2024-09-22T03:57:59.938422+0000","last_peered":"2024-09-22T03:57:59.938422+0000","last_clean":"2024-09-22T03:57:59.938422+0000","last_became_active":"2024-09-22T03:55:50.929831+0000","last_became_peered":"2024-09-22T03:55:50.929831+0000","last_unstale":"2024-09-22T03:57:59.938422+0000","last_undegraded":"2024-09-22T03:57:59.938422+0000","last_fullsized":"2024-09-22T03:57:59.938422+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1622,"log_dups_size":0,"ondisk_log_size":1622,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45219840,"num_objects":690,"num_object_clones":0,"num_object_copies":2070,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1622,"num_write_kb":73984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":141,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-22T03:57:59.761610+0000","last_change":"2024-09-22T03:49:17.031466+0000","last_active":"2024-09-22T03:57:59.761610+0000","last_peered":"2024-09-22T03:57:59.761610+0000","last_clean":"2024-09-22T03:57:59.761610+0000","last_became_active":"2024-09-22T03:49:15.098420+0000","last_became_peered":"2024-09-22T03:49:15.098420+0000","last_unstale":"2024-09-22T03:57:59.761610+0000","last_undegraded":"2024-09-22T03:57:59.761610+0000","last_fullsized":"2024-09-22T03:57:59.761610+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3","version":"57'1544","reported_seq":1571,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-22T03:57:59.879402+0000","last_change":"2024-09-22T03:55:50.862956+0000","last_active":"2024-09-22T03:57:59.879402+0000","last_peered":"2024-09-22T03:57:59.879402+0000","last_clean":"2024-09-22T03:57:59.879402+0000","last_became_active":"2024-09-22T03:55:50.854828+0000","last_became_peered":"2024-09-22T03:55:50.854828+0000","last_unstale":"2024-09-22T03:57:59.879402+0000","last_undegraded":"2024-09-22T03:57:59.879402+0000","last_fullsized":"2024-09-22T03:57:59.879402+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1544,"log_dups_size":0,"ondisk_log_size":1544,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45481984,"num_objects":694,"num_object_clones":0,"num_object_copies":2082,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1544,"num_write_kb":71616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":142,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:58:00.790803+0000","last_change":"2024-09-22T03:49:17.036954+0000","last_active":"2024-09-22T03:58:00.790803+0000","last_peered":"2024-09-22T03:58:00.790803+0000","last_clean":"2024-09-22T03:58:00.790803+0000","last_became_active":"2024-09-22T03:49:15.110506+0000","last_became_peered":"2024-09-22T03:49:15.110506+0000","last_unstale":"2024-09-22T03:58:00.790803+0000","last_undegraded":"2024-09-22T03:58:00.790803+0000","last_fullsized":"2024-09-22T03:58:00.790803+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"57'1592","reported_seq":1619,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-22T03:58:00.019989+0000","last_change":"2024-09-22T03:55:50.927264+0000","last_active":"2024-09-22T03:58:00.019989+0000","last_peered":"2024-09-22T03:58:00.019989+0000","last_clean":"2024-09-22T03:58:00.019989+0000","last_became_active":"2024-09-22T03:55:50.919600+0000","last_became_peered":"2024-09-22T03:55:50.919600+0000","last_unstale":"2024-09-22T03:58:00.019989+0000","last_undegraded":"2024-09-22T03:58:00.019989+0000","last_fullsized":"2024-09-22T03:58:00.019989+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1592,"log_dups_size":0,"ondisk_log_size":1592,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44171264,"num_objects":674,"num_object_clones":0,"num_object_copies":2022,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1592,"num_write_kb":72512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":142,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:58:00.772306+0000","last_change":"2024-09-22T03:49:17.032989+0000","last_active":"2024-09-22T03:58:00.772306+0000","last_peered":"2024-09-22T03:58:00.772306+0000","last_clean":"2024-09-22T03:58:00.772306+0000","last_became_active":"2024-09-22T03:49:15.079260+0000","last_became_peered":"2024-09-22T03:49:15.079260+0000","last_unstale":"2024-09-22T03:58:00.772306+0000","last_undegraded":"2024-09-22T03:58:00.772306+0000","last_fullsized":"2024-09-22T03:58:00.772306+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"58'1617","reported_seq":1647,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:58:01.075915+0000","last_change":"2024-09-22T03:55:50.862926+0000","last_active":"2024-09-22T03:58:01.075915+0000","last_peered":"2024-09-22T03:58:01.075915+0000","last_clean":"2024-09-22T03:58:01.075915+0000","last_became_active":"2024-09-22T03:55:50.851824+0000","last_became_peered":"2024-09-22T03:55:50.851824+0000","last_unstale":"2024-09-22T03:58:01.075915+0000","last_undegraded":"2024-09-22T03:58:01.075915+0000","last_fullsized":"2024-09-22T03:58:01.075915+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1617,"log_dups_size":0,"ondisk_log_size":1617,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46333952,"num_objects":707,"num_object_clones":0,"num_object_copies":2121,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1617,"num_write_kb":74368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":142,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:58:00.773182+0000","last_change":"2024-09-22T03:49:17.036402+0000","last_active":"2024-09-22T03:58:00.773182+0000","last_peered":"2024-09-22T03:58:00.773182+0000","last_clean":"2024-09-22T03:58:00.773182+0000","last_became_active":"2024-09-22T03:49:15.108430+0000","last_became_peered":"2024-09-22T03:49:15.108430+0000","last_unstale":"2024-09-22T03:58:00.773182+0000","last_undegraded":"2024-09-22T03:58:00.773182+0000","last_fullsized":"2024-09-22T03:58:00.773182+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"56'1556","reported_seq":1583,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-22T03:57:59.760605+0000","last_change":"2024-09-22T03:55:50.878789+0000","last_active":"2024-09-22T03:57:59.760605+0000","last_peered":"2024-09-22T03:57:59.760605+0000","last_clean":"2024-09-22T03:57:59.760605+0000","last_became_active":"2024-09-22T03:55:50.852561+0000","last_became_peered":"2024-09-22T03:55:50.852561+0000","last_unstale":"2024-09-22T03:57:59.760605+0000","last_undegraded":"2024-09-22T03:57:59.760605+0000","last_fullsized":"2024-09-22T03:57:59.760605+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1556,"log_dups_size":0,"ondisk_log_size":1556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47054848,"num_objects":718,"num_object_clones":0,"num_object_copies":2154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1556,"num_write_kb":72768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":139,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-22T03:57:59.755545+0000","last_change":"2024-09-22T03:49:17.029128+0000","last_active":"2024-09-22T03:57:59.755545+0000","last_peered":"2024-09-22T03:57:59.755545+0000","last_clean":"2024-09-22T03:57:59.755545+0000","last_became_active":"2024-09-22T03:49:15.113396+0000","last_became_peered":"2024-09-22T03:49:15.113396+0000","last_unstale":"2024-09-22T03:57:59.755545+0000","last_undegraded":"2024-09-22T03:57:59.755545+0000","last_fullsized":"2024-09-22T03:57:59.755545+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":727253016,"num_objects":11098,"num_object_clones":0,"num_object_copies":33294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":25686,"num_write_kb":1177025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":136441856,"data_stored":2182873160,"data_compressed":103654493,"data_compressed_allocated":136429568,"data_compressed_original":2182873088,"omap_allocated":0,"internal_metadata":0},"log_size":25686,"ondisk_log_size":25686,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949673489,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":113292,"kb_used_data":28156,"kb_used_omap":0,"kb_used_meta":85120,"kb_avail":94258548,"statfs":{"total":96636764160,"available":96520753152,"internally_reserved":0,"allocated":28831744,"data_stored":453228086,"data_compressed":21515303,"data_compressed_allocated":28319744,"data_compressed_original":453033984,"omap_allocated":0,"internal_metadata":87162880},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654706193,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":115000,"kb_used_data":34020,"kb_used_omap":0,"kb_used_meta":80960,"kb_avail":94256840,"statfs":{"total":96636764160,"available":96519004160,"internally_reserved":0,"allocated":34836480,"data_stored":549758821,"data_compressed":26097231,"data_compressed_allocated":34349056,"data_compressed_original":549584896,"omap_allocated":0,"internal_metadata":82903040},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706192,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":115100,"kb_used_data":34120,"kb_used_omap":0,"kb_used_meta":80960,"kb_avail":94256740,"statfs":{"total":96636764160,"available":96518901760,"internally_reserved":0,"allocated":34938880,"data_stored":551132348,"data_compressed":26164631,"data_compressed_allocated":34439168,"data_compressed_original":550944768,"omap_allocated":0,"internal_metadata":82903040},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706192,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":133600,"kb_used_data":40144,"kb_used_omap":0,"kb_used_meta":93440,"kb_avail":94238240,"statfs":{"total":96636764160,"available":96499957760,"internally_reserved":0,"allocated":41107456,"data_stored":649895081,"data_compressed":30854416,"data_compressed_allocated":40611840,"data_compressed_original":649707520,"omap_allocated":0,"internal_metadata":95682560},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":39931904,"data_stored":638844952,"data_compressed":30335776,"data_compressed_allocated":39927808,"data_compressed_original":638844928,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28254208,"data_stored":452067328,"data_compressed":21466575,"data_compressed_allocated":28254208,"data_compressed_original":452067328,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":33955840,"data_stored":543227928,"data_compressed":25795367,"data_compressed_allocated":33951744,"data_compressed_original":543227904,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":34299904,"data_stored":548732952,"data_compressed":26056775,"data_compressed_allocated":34295808,"data_compressed_original":548732928,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:58:03.877 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-22T03:58:03.877 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:58:03.877 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:58:04.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:58:04.035+0000 7f298f551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:58:04.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:58:04.048+0000 7f298f551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:58:04.192 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:58:04.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:58:04.365+0000 7f20e94bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:58:04.379 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:58:04.380 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-22T03:58:04.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:58:04.381+0000 7f20e94bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:58:04.404 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":320,"stamp":"2024-09-22T03:58:03.076235+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":727843403,"num_objects":11102,"num_object_clones":0,"num_object_copies":33306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":25767,"num_write_kb":1178133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25741,"ondisk_log_size":25741,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":476992,"kb_used_data":136440,"kb_used_omap":0,"kb_used_meta":340480,"kb_avail":377010368,"statfs":{"total":386547056640,"available":386058616832,"internally_reserved":0,"allocated":139714560,"data_stored":2204014336,"data_compressed":104631581,"data_compressed_allocated":137719808,"data_compressed_original":2203271168,"omap_allocated":0,"internal_metadata":348651520},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-59637760,"num_objects":-910,"num_object_clones":0,"num_object_copies":-2730,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":910,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000661"},"pg_stats":[{"pgid":"5.f","version":"58'1621","reported_seq":1651,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:58:00.950858+0000","last_change":"2024-09-22T03:55:50.938932+0000","last_active":"2024-09-22T03:58:00.950858+0000","last_peered":"2024-09-22T03:58:00.950858+0000","last_clean":"2024-09-22T03:58:00.950858+0000","last_became_active":"2024-09-22T03:55:50.929290+0000","last_became_peered":"2024-09-22T03:55:50.929290+0000","last_unstale":"2024-09-22T03:58:00.950858+0000","last_undegraded":"2024-09-22T03:58:00.950858+0000","last_fullsized":"2024-09-22T03:58:00.950858+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1621,"log_dups_size":0,"ondisk_log_size":1621,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45809664,"num_objects":699,"num_object_clones":0,"num_object_copies":2097,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1621,"num_write_kb":74240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"57'1596","reported_seq":1623,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-22T03:58:00.020506+0000","last_change":"2024-09-22T03:55:50.848180+0000","last_active":"2024-09-22T03:58:00.020506+0000","last_peered":"2024-09-22T03:58:00.020506+0000","last_clean":"2024-09-22T03:58:00.020506+0000","last_became_active":"2024-09-22T03:55:50.838302+0000","last_became_peered":"2024-09-22T03:55:50.838302+0000","last_unstale":"2024-09-22T03:58:00.020506+0000","last_undegraded":"2024-09-22T03:58:00.020506+0000","last_fullsized":"2024-09-22T03:58:00.020506+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1596,"log_dups_size":0,"ondisk_log_size":1596,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44957696,"num_objects":686,"num_object_clones":0,"num_object_copies":2058,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1596,"num_write_kb":73024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"57'1680","reported_seq":1708,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-22T03:58:00.010902+0000","last_change":"2024-09-22T03:55:50.872362+0000","last_active":"2024-09-22T03:58:00.010902+0000","last_peered":"2024-09-22T03:58:00.010902+0000","last_clean":"2024-09-22T03:58:00.010902+0000","last_became_active":"2024-09-22T03:55:50.867322+0000","last_became_peered":"2024-09-22T03:55:50.867322+0000","last_unstale":"2024-09-22T03:58:00.010902+0000","last_undegraded":"2024-09-22T03:58:00.010902+0000","last_fullsized":"2024-09-22T03:58:00.010902+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1680,"log_dups_size":0,"ondisk_log_size":1680,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45809688,"num_objects":700,"num_object_clones":0,"num_object_copies":2100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1680,"num_write_kb":76097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"58'1651","reported_seq":1681,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:58:01.162221+0000","last_change":"2024-09-22T03:55:50.942624+0000","last_active":"2024-09-22T03:58:01.162221+0000","last_peered":"2024-09-22T03:58:01.162221+0000","last_clean":"2024-09-22T03:58:01.162221+0000","last_became_active":"2024-09-22T03:55:50.922812+0000","last_became_peered":"2024-09-22T03:55:50.922812+0000","last_unstale":"2024-09-22T03:58:01.162221+0000","last_undegraded":"2024-09-22T03:58:01.162221+0000","last_fullsized":"2024-09-22T03:58:01.162221+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1651,"log_dups_size":0,"ondisk_log_size":1651,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45809664,"num_objects":699,"num_object_clones":0,"num_object_copies":2097,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1651,"num_write_kb":75200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"57'1554","reported_seq":1581,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-22T03:58:00.066849+0000","last_change":"2024-09-22T03:55:50.890353+0000","last_active":"2024-09-22T03:58:00.066849+0000","last_peered":"2024-09-22T03:58:00.066849+0000","last_clean":"2024-09-22T03:58:00.066849+0000","last_became_active":"2024-09-22T03:55:50.882633+0000","last_became_peered":"2024-09-22T03:55:50.882633+0000","last_unstale":"2024-09-22T03:58:00.066849+0000","last_undegraded":"2024-09-22T03:58:00.066849+0000","last_fullsized":"2024-09-22T03:58:00.066849+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1554,"log_dups_size":0,"ondisk_log_size":1554,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43646976,"num_objects":666,"num_object_clones":0,"num_object_copies":1998,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1554,"num_write_kb":71040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.a","version":"57'1597","reported_seq":1624,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-22T03:57:59.971439+0000","last_change":"2024-09-22T03:55:50.891052+0000","last_active":"2024-09-22T03:57:59.971439+0000","last_peered":"2024-09-22T03:57:59.971439+0000","last_clean":"2024-09-22T03:57:59.971439+0000","last_became_active":"2024-09-22T03:55:50.880295+0000","last_became_peered":"2024-09-22T03:55:50.880295+0000","last_unstale":"2024-09-22T03:57:59.971439+0000","last_undegraded":"2024-09-22T03:57:59.971439+0000","last_fullsized":"2024-09-22T03:57:59.971439+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1597,"log_dups_size":0,"ondisk_log_size":1597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46465024,"num_objects":709,"num_object_clones":0,"num_object_copies":2127,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1597,"num_write_kb":73792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"57'1607","reported_seq":1634,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-22T03:57:59.919904+0000","last_change":"2024-09-22T03:55:50.906894+0000","last_active":"2024-09-22T03:57:59.919904+0000","last_peered":"2024-09-22T03:57:59.919904+0000","last_clean":"2024-09-22T03:57:59.919904+0000","last_became_active":"2024-09-22T03:55:50.896899+0000","last_became_peered":"2024-09-22T03:55:50.896899+0000","last_unstale":"2024-09-22T03:57:59.919904+0000","last_undegraded":"2024-09-22T03:57:59.919904+0000","last_fullsized":"2024-09-22T03:57:59.919904+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1607,"log_dups_size":0,"ondisk_log_size":1607,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46333952,"num_objects":707,"num_object_clones":0,"num_object_copies":2121,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1607,"num_write_kb":74048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"57'1593","reported_seq":1620,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-22T03:57:59.908726+0000","last_change":"2024-09-22T03:55:50.859578+0000","last_active":"2024-09-22T03:57:59.908726+0000","last_peered":"2024-09-22T03:57:59.908726+0000","last_clean":"2024-09-22T03:57:59.908726+0000","last_became_active":"2024-09-22T03:55:50.843710+0000","last_became_peered":"2024-09-22T03:55:50.843710+0000","last_unstale":"2024-09-22T03:57:59.908726+0000","last_undegraded":"2024-09-22T03:57:59.908726+0000","last_fullsized":"2024-09-22T03:57:59.908726+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1593,"log_dups_size":0,"ondisk_log_size":1593,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44498944,"num_objects":679,"num_object_clones":0,"num_object_copies":2037,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1593,"num_write_kb":72704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"57'1638","reported_seq":1665,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-22T03:58:00.108069+0000","last_change":"2024-09-22T03:55:50.968411+0000","last_active":"2024-09-22T03:58:00.108069+0000","last_peered":"2024-09-22T03:58:00.108069+0000","last_clean":"2024-09-22T03:58:00.108069+0000","last_became_active":"2024-09-22T03:55:50.961718+0000","last_became_peered":"2024-09-22T03:55:50.961718+0000","last_unstale":"2024-09-22T03:58:00.108069+0000","last_undegraded":"2024-09-22T03:58:00.108069+0000","last_fullsized":"2024-09-22T03:58:00.108069+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1638,"log_dups_size":0,"ondisk_log_size":1638,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47316992,"num_objects":722,"num_object_clones":0,"num_object_copies":2166,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1638,"num_write_kb":75520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":217,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:58:00.773536+0000","last_change":"2024-09-22T03:49:12.034704+0000","last_active":"2024-09-22T03:58:00.773536+0000","last_peered":"2024-09-22T03:58:00.773536+0000","last_clean":"2024-09-22T03:58:00.773536+0000","last_became_active":"2024-09-22T03:49:12.027470+0000","last_became_peered":"2024-09-22T03:49:12.027470+0000","last_unstale":"2024-09-22T03:58:00.773536+0000","last_undegraded":"2024-09-22T03:58:00.773536+0000","last_fullsized":"2024-09-22T03:58:00.773536+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_clean_scrub_stamp":"2024-09-22T03:49:10.979949+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":140,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-22T03:57:59.765831+0000","last_change":"2024-09-22T03:49:17.031458+0000","last_active":"2024-09-22T03:57:59.765831+0000","last_peered":"2024-09-22T03:57:59.765831+0000","last_clean":"2024-09-22T03:57:59.765831+0000","last_became_active":"2024-09-22T03:49:15.125490+0000","last_became_peered":"2024-09-22T03:49:15.125490+0000","last_unstale":"2024-09-22T03:57:59.765831+0000","last_undegraded":"2024-09-22T03:57:59.765831+0000","last_fullsized":"2024-09-22T03:57:59.765831+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.7","version":"57'1617","reported_seq":1644,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-22T03:58:00.059362+0000","last_change":"2024-09-22T03:55:50.910597+0000","last_active":"2024-09-22T03:58:00.059362+0000","last_peered":"2024-09-22T03:58:00.059362+0000","last_clean":"2024-09-22T03:58:00.059362+0000","last_became_active":"2024-09-22T03:55:50.901290+0000","last_became_peered":"2024-09-22T03:55:50.901290+0000","last_unstale":"2024-09-22T03:58:00.059362+0000","last_undegraded":"2024-09-22T03:58:00.059362+0000","last_fullsized":"2024-09-22T03:58:00.059362+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1617,"log_dups_size":0,"ondisk_log_size":1617,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45285376,"num_objects":691,"num_object_clones":0,"num_object_copies":2073,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1617,"num_write_kb":73856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":139,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-22T03:57:59.754645+0000","last_change":"2024-09-22T03:49:17.029339+0000","last_active":"2024-09-22T03:57:59.754645+0000","last_peered":"2024-09-22T03:57:59.754645+0000","last_clean":"2024-09-22T03:57:59.754645+0000","last_became_active":"2024-09-22T03:49:15.097304+0000","last_became_peered":"2024-09-22T03:49:15.097304+0000","last_unstale":"2024-09-22T03:57:59.754645+0000","last_undegraded":"2024-09-22T03:57:59.754645+0000","last_fullsized":"2024-09-22T03:57:59.754645+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"58'1601","reported_seq":1631,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:58:00.982509+0000","last_change":"2024-09-22T03:55:50.918358+0000","last_active":"2024-09-22T03:58:00.982509+0000","last_peered":"2024-09-22T03:58:00.982509+0000","last_clean":"2024-09-22T03:58:00.982509+0000","last_became_active":"2024-09-22T03:55:50.889906+0000","last_became_peered":"2024-09-22T03:55:50.889906+0000","last_unstale":"2024-09-22T03:58:00.982509+0000","last_undegraded":"2024-09-22T03:58:00.982509+0000","last_fullsized":"2024-09-22T03:58:00.982509+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1601,"log_dups_size":0,"ondisk_log_size":1601,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43057152,"num_objects":657,"num_object_clones":0,"num_object_copies":1971,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1601,"num_write_kb":72256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":139,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-22T03:57:59.772334+0000","last_change":"2024-09-22T03:49:17.029349+0000","last_active":"2024-09-22T03:57:59.772334+0000","last_peered":"2024-09-22T03:57:59.772334+0000","last_clean":"2024-09-22T03:57:59.772334+0000","last_became_active":"2024-09-22T03:49:15.094890+0000","last_became_peered":"2024-09-22T03:49:15.094890+0000","last_unstale":"2024-09-22T03:57:59.772334+0000","last_undegraded":"2024-09-22T03:57:59.772334+0000","last_fullsized":"2024-09-22T03:57:59.772334+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"57'1622","reported_seq":1649,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-22T03:57:59.938422+0000","last_change":"2024-09-22T03:55:50.939050+0000","last_active":"2024-09-22T03:57:59.938422+0000","last_peered":"2024-09-22T03:57:59.938422+0000","last_clean":"2024-09-22T03:57:59.938422+0000","last_became_active":"2024-09-22T03:55:50.929831+0000","last_became_peered":"2024-09-22T03:55:50.929831+0000","last_unstale":"2024-09-22T03:57:59.938422+0000","last_undegraded":"2024-09-22T03:57:59.938422+0000","last_fullsized":"2024-09-22T03:57:59.938422+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1622,"log_dups_size":0,"ondisk_log_size":1622,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45219840,"num_objects":690,"num_object_clones":0,"num_object_copies":2070,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1622,"num_write_kb":73984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":141,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-22T03:57:59.761610+0000","last_change":"2024-09-22T03:49:17.031466+0000","last_active":"2024-09-22T03:57:59.761610+0000","last_peered":"2024-09-22T03:57:59.761610+0000","last_clean":"2024-09-22T03:57:59.761610+0000","last_became_active":"2024-09-22T03:49:15.098420+0000","last_became_peered":"2024-09-22T03:49:15.098420+0000","last_unstale":"2024-09-22T03:57:59.761610+0000","last_undegraded":"2024-09-22T03:57:59.761610+0000","last_fullsized":"2024-09-22T03:57:59.761610+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3","version":"57'1544","reported_seq":1571,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-22T03:57:59.879402+0000","last_change":"2024-09-22T03:55:50.862956+0000","last_active":"2024-09-22T03:57:59.879402+0000","last_peered":"2024-09-22T03:57:59.879402+0000","last_clean":"2024-09-22T03:57:59.879402+0000","last_became_active":"2024-09-22T03:55:50.854828+0000","last_became_peered":"2024-09-22T03:55:50.854828+0000","last_unstale":"2024-09-22T03:57:59.879402+0000","last_undegraded":"2024-09-22T03:57:59.879402+0000","last_fullsized":"2024-09-22T03:57:59.879402+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1544,"log_dups_size":0,"ondisk_log_size":1544,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45481984,"num_objects":694,"num_object_clones":0,"num_object_copies":2082,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1544,"num_write_kb":71616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":142,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:58:00.790803+0000","last_change":"2024-09-22T03:49:17.036954+0000","last_active":"2024-09-22T03:58:00.790803+0000","last_peered":"2024-09-22T03:58:00.790803+0000","last_clean":"2024-09-22T03:58:00.790803+0000","last_became_active":"2024-09-22T03:49:15.110506+0000","last_became_peered":"2024-09-22T03:49:15.110506+0000","last_unstale":"2024-09-22T03:58:00.790803+0000","last_undegraded":"2024-09-22T03:58:00.790803+0000","last_fullsized":"2024-09-22T03:58:00.790803+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"57'1592","reported_seq":1619,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-22T03:58:00.019989+0000","last_change":"2024-09-22T03:55:50.927264+0000","last_active":"2024-09-22T03:58:00.019989+0000","last_peered":"2024-09-22T03:58:00.019989+0000","last_clean":"2024-09-22T03:58:00.019989+0000","last_became_active":"2024-09-22T03:55:50.919600+0000","last_became_peered":"2024-09-22T03:55:50.919600+0000","last_unstale":"2024-09-22T03:58:00.019989+0000","last_undegraded":"2024-09-22T03:58:00.019989+0000","last_fullsized":"2024-09-22T03:58:00.019989+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1592,"log_dups_size":0,"ondisk_log_size":1592,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44171264,"num_objects":674,"num_object_clones":0,"num_object_copies":2022,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1592,"num_write_kb":72512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":142,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:58:00.772306+0000","last_change":"2024-09-22T03:49:17.032989+0000","last_active":"2024-09-22T03:58:00.772306+0000","last_peered":"2024-09-22T03:58:00.772306+0000","last_clean":"2024-09-22T03:58:00.772306+0000","last_became_active":"2024-09-22T03:49:15.079260+0000","last_became_peered":"2024-09-22T03:49:15.079260+0000","last_unstale":"2024-09-22T03:58:00.772306+0000","last_undegraded":"2024-09-22T03:58:00.772306+0000","last_fullsized":"2024-09-22T03:58:00.772306+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"58'1617","reported_seq":1647,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:58:01.075915+0000","last_change":"2024-09-22T03:55:50.862926+0000","last_active":"2024-09-22T03:58:01.075915+0000","last_peered":"2024-09-22T03:58:01.075915+0000","last_clean":"2024-09-22T03:58:01.075915+0000","last_became_active":"2024-09-22T03:55:50.851824+0000","last_became_peered":"2024-09-22T03:55:50.851824+0000","last_unstale":"2024-09-22T03:58:01.075915+0000","last_undegraded":"2024-09-22T03:58:01.075915+0000","last_fullsized":"2024-09-22T03:58:01.075915+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1617,"log_dups_size":0,"ondisk_log_size":1617,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46333952,"num_objects":707,"num_object_clones":0,"num_object_copies":2121,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1617,"num_write_kb":74368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":142,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-22T03:58:00.773182+0000","last_change":"2024-09-22T03:49:17.036402+0000","last_active":"2024-09-22T03:58:00.773182+0000","last_peered":"2024-09-22T03:58:00.773182+0000","last_clean":"2024-09-22T03:58:00.773182+0000","last_became_active":"2024-09-22T03:49:15.108430+0000","last_became_peered":"2024-09-22T03:49:15.108430+0000","last_unstale":"2024-09-22T03:58:00.773182+0000","last_undegraded":"2024-09-22T03:58:00.773182+0000","last_fullsized":"2024-09-22T03:58:00.773182+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"56'1556","reported_seq":1583,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-22T03:57:59.760605+0000","last_change":"2024-09-22T03:55:50.878789+0000","last_active":"2024-09-22T03:57:59.760605+0000","last_peered":"2024-09-22T03:57:59.760605+0000","last_clean":"2024-09-22T03:57:59.760605+0000","last_became_active":"2024-09-22T03:55:50.852561+0000","last_became_peered":"2024-09-22T03:55:50.852561+0000","last_unstale":"2024-09-22T03:57:59.760605+0000","last_undegraded":"2024-09-22T03:57:59.760605+0000","last_fullsized":"2024-09-22T03:57:59.760605+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1556,"log_dups_size":0,"ondisk_log_size":1556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47054848,"num_objects":718,"num_object_clones":0,"num_object_copies":2154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1556,"num_write_kb":72768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":139,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-22T03:57:59.755545+0000","last_change":"2024-09-22T03:49:17.029128+0000","last_active":"2024-09-22T03:57:59.755545+0000","last_peered":"2024-09-22T03:57:59.755545+0000","last_clean":"2024-09-22T03:57:59.755545+0000","last_became_active":"2024-09-22T03:49:15.113396+0000","last_became_peered":"2024-09-22T03:49:15.113396+0000","last_unstale":"2024-09-22T03:57:59.755545+0000","last_undegraded":"2024-09-22T03:57:59.755545+0000","last_fullsized":"2024-09-22T03:57:59.755545+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":727253016,"num_objects":11098,"num_object_clones":0,"num_object_copies":33294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":25686,"num_write_kb":1177025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":136441856,"data_stored":2182873160,"data_compressed":103654493,"data_compressed_allocated":136429568,"data_compressed_original":2182873088,"omap_allocated":0,"internal_metadata":0},"log_size":25686,"ondisk_log_size":25686,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949673489,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":113292,"kb_used_data":28156,"kb_used_omap":0,"kb_used_meta":85120,"kb_avail":94258548,"statfs":{"total":96636764160,"available":96520753152,"internally_reserved":0,"allocated":28831744,"data_stored":453228086,"data_compressed":21515303,"data_compressed_allocated":28319744,"data_compressed_original":453033984,"omap_allocated":0,"internal_metadata":87162880},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654706193,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":115000,"kb_used_data":34020,"kb_used_omap":0,"kb_used_meta":80960,"kb_avail":94256840,"statfs":{"total":96636764160,"available":96519004160,"internally_reserved":0,"allocated":34836480,"data_stored":549758821,"data_compressed":26097231,"data_compressed_allocated":34349056,"data_compressed_original":549584896,"omap_allocated":0,"internal_metadata":82903040},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706192,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":115100,"kb_used_data":34120,"kb_used_omap":0,"kb_used_meta":80960,"kb_avail":94256740,"statfs":{"total":96636764160,"available":96518901760,"internally_reserved":0,"allocated":34938880,"data_stored":551132348,"data_compressed":26164631,"data_compressed_allocated":34439168,"data_compressed_original":550944768,"omap_allocated":0,"internal_metadata":82903040},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706192,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":133600,"kb_used_data":40144,"kb_used_omap":0,"kb_used_meta":93440,"kb_avail":94238240,"statfs":{"total":96636764160,"available":96499957760,"internally_reserved":0,"allocated":41107456,"data_stored":649895081,"data_compressed":30854416,"data_compressed_allocated":40611840,"data_compressed_original":649707520,"omap_allocated":0,"internal_metadata":95682560},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":39931904,"data_stored":638844952,"data_compressed":30335776,"data_compressed_allocated":39927808,"data_compressed_original":638844928,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28254208,"data_stored":452067328,"data_compressed":21466575,"data_compressed_allocated":28254208,"data_compressed_original":452067328,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":33955840,"data_stored":543227928,"data_compressed":25795367,"data_compressed_allocated":33951744,"data_compressed_original":543227904,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":34299904,"data_stored":548732952,"data_compressed":26056775,"data_compressed_allocated":34295808,"data_compressed_original":548732928,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:58:06.820 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:58:06.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:58:06.991+0000 7f289b391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:58:07.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:58:07.001+0000 7f289b391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:58:09.405 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:58:09.406 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:58:09.406 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:58:09.406 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:58:09.500 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:58:09.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:58:09.570+0000 7f514af91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:58:09.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:58:09.588+0000 7f514af91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:58:09.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:58:09.665+0000 7f15b7a9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:58:09.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:58:09.675+0000 7f15b7a9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:58:09.804 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:58:09.804 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:58:09.804 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:58:09.804 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:58:09.804 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:58:09.804 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:58:09.804 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:58:09.804 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:58:09.804 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:58:09.804 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:58:09.805 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:58:09.805 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:58:09.807 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:58:09.807 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:58:09.808 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:58:09.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:58:09.965+0000 7f8423351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:58:09.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:58:09.983+0000 7f8423351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:58:10.019 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:58:10.020 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:58:10.020 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:58:10.020 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:58:10.020 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:58:10.020 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:58:10.020 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:58:10.020 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:58:10.020 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:58:10.020 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:58:10.020 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:58:10.020 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:58:10.024 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:58:10.024 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:58:10.025 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:58:10.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:58:10.190+0000 7f094f151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:58:10.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:58:10.209+0000 7f094f151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:58:10.239 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:58:10.239 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:58:10.239 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:58:10.239 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:58:10.239 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:58:10.239 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:58:10.239 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:58:10.239 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:58:10.239 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:58:10.239 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:58:10.240 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:58:10.240 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:58:10.243 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:58:10.243 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:58:10.243 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:58:10.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:58:10.439+0000 7f5284f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:58:10.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:58:10.458+0000 7f5284f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:58:10.518 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:58:10.518 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:58:10.518 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:58:10.518 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:58:10.518 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:58:10.518 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:58:10.518 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:58:10.518 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:58:10.519 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:58:10.519 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:58:10.519 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:58:10.519 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:58:10.523 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:58:10.523 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:58:12.188 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:58:12.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:58:12.349+0000 7f05146fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:58:12.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:58:12.357+0000 7f05146fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:58:15.024 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:58:15.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:58:15.184+0000 7f35d1f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:58:15.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:58:15.194+0000 7f35d1f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:58:15.523 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:58:15.524 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-22T03:58:15.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:58:15.702+0000 7fc317088640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:58:15.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:58:15.722+0000 7fc317088640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:58:16.724 INFO:teuthology.orchestra.run.smithi037.stderr:reweighted osd.0 to 1 (10000) 2024-09-22T03:58:16.745 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-22T03:58:16.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:58:16.924+0000 7f9d19791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:58:16.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:58:16.940+0000 7f9d19791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:58:17.563 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:58:17.734 INFO:teuthology.orchestra.run.smithi037.stderr:reweighted osd.1 to 1 (10000) 2024-09-22T03:58:17.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:58:17.736+0000 7f44a4f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:58:17.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:58:17.753+0000 7f44a4f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:58:17.758 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-22T03:58:17.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:58:17.937+0000 7fc054191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:58:17.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:58:17.956+0000 7fc054191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:58:18.735 INFO:teuthology.orchestra.run.smithi037.stderr:reweighted osd.2 to 1 (10000) 2024-09-22T03:58:18.761 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-22T03:58:18.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:58:18.925+0000 7f11c3857640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:58:18.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:58:18.944+0000 7f11c3857640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:58:19.740 INFO:teuthology.orchestra.run.smithi037.stderr:reweighted osd.3 to 1 (10000) 2024-09-22T03:58:19.758 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-22T03:58:19.758 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:58:19.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:58:19.932+0000 7f3842591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:58:19.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:58:19.944+0000 7f3842591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:58:20.291 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:58:20.291 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-22T03:58:20.314 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":332,"stamp":"2024-09-22T03:58:19.742523+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":552600139,"num_objects":8428,"num_object_clones":0,"num_object_copies":25284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":28441,"num_write_kb":1178133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28415,"ondisk_log_size":28415,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":461980,"kb_used_data":104788,"kb_used_omap":0,"kb_used_meta":357120,"kb_avail":377025380,"statfs":{"total":386547056640,"available":386073989120,"internally_reserved":0,"allocated":107302912,"data_stored":1683766581,"data_compressed":79925413,"data_compressed_allocated":105201664,"data_compressed_original":1682980864,"omap_allocated":0,"internal_metadata":365690880},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-58851328,"num_objects":-898,"num_object_clones":0,"num_object_copies":-2694,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":898,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.664046"},"pg_stats":[{"pgid":"5.f","version":"60'1802","reported_seq":1838,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-22T03:58:15.837742+0000","last_change":"2024-09-22T03:55:50.938932+0000","last_active":"2024-09-22T03:58:15.837742+0000","last_peered":"2024-09-22T03:58:15.837742+0000","last_clean":"2024-09-22T03:58:15.837742+0000","last_became_active":"2024-09-22T03:55:50.929290+0000","last_became_peered":"2024-09-22T03:55:50.929290+0000","last_unstale":"2024-09-22T03:58:15.837742+0000","last_undegraded":"2024-09-22T03:58:15.837742+0000","last_fullsized":"2024-09-22T03:58:15.837742+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1802,"log_dups_size":0,"ondisk_log_size":1802,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33947648,"num_objects":518,"num_object_clones":0,"num_object_copies":1554,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1802,"num_write_kb":74240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"60'1757","reported_seq":1793,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-22T03:58:14.966863+0000","last_change":"2024-09-22T03:55:50.848180+0000","last_active":"2024-09-22T03:58:14.966863+0000","last_peered":"2024-09-22T03:58:14.966863+0000","last_clean":"2024-09-22T03:58:14.966863+0000","last_became_active":"2024-09-22T03:55:50.838302+0000","last_became_peered":"2024-09-22T03:55:50.838302+0000","last_unstale":"2024-09-22T03:58:14.966863+0000","last_undegraded":"2024-09-22T03:58:14.966863+0000","last_fullsized":"2024-09-22T03:58:14.966863+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1757,"log_dups_size":0,"ondisk_log_size":1757,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34406400,"num_objects":525,"num_object_clones":0,"num_object_copies":1575,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1757,"num_write_kb":73024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"60'1847","reported_seq":1884,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-22T03:58:15.069581+0000","last_change":"2024-09-22T03:55:50.872362+0000","last_active":"2024-09-22T03:58:15.069581+0000","last_peered":"2024-09-22T03:58:15.069581+0000","last_clean":"2024-09-22T03:58:15.069581+0000","last_became_active":"2024-09-22T03:55:50.867322+0000","last_became_peered":"2024-09-22T03:55:50.867322+0000","last_unstale":"2024-09-22T03:58:15.069581+0000","last_undegraded":"2024-09-22T03:58:15.069581+0000","last_fullsized":"2024-09-22T03:58:15.069581+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1847,"log_dups_size":0,"ondisk_log_size":1847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34865176,"num_objects":533,"num_object_clones":0,"num_object_copies":1599,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1847,"num_write_kb":76097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"60'1825","reported_seq":1861,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-22T03:58:16.127764+0000","last_change":"2024-09-22T03:55:50.942624+0000","last_active":"2024-09-22T03:58:16.127764+0000","last_peered":"2024-09-22T03:58:16.127764+0000","last_clean":"2024-09-22T03:58:16.127764+0000","last_became_active":"2024-09-22T03:55:50.922812+0000","last_became_peered":"2024-09-22T03:55:50.922812+0000","last_unstale":"2024-09-22T03:58:16.127764+0000","last_undegraded":"2024-09-22T03:58:16.127764+0000","last_fullsized":"2024-09-22T03:58:16.127764+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1825,"log_dups_size":0,"ondisk_log_size":1825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34406400,"num_objects":525,"num_object_clones":0,"num_object_copies":1575,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1825,"num_write_kb":75200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"60'1713","reported_seq":1749,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-22T03:58:14.785239+0000","last_change":"2024-09-22T03:55:50.890353+0000","last_active":"2024-09-22T03:58:14.785239+0000","last_peered":"2024-09-22T03:58:14.785239+0000","last_clean":"2024-09-22T03:58:14.785239+0000","last_became_active":"2024-09-22T03:55:50.882633+0000","last_became_peered":"2024-09-22T03:55:50.882633+0000","last_unstale":"2024-09-22T03:58:14.785239+0000","last_undegraded":"2024-09-22T03:58:14.785239+0000","last_fullsized":"2024-09-22T03:58:14.785239+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1713,"log_dups_size":0,"ondisk_log_size":1713,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33226752,"num_objects":507,"num_object_clones":0,"num_object_copies":1521,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1713,"num_write_kb":71040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.a","version":"60'1768","reported_seq":1804,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-22T03:58:15.052205+0000","last_change":"2024-09-22T03:55:50.891052+0000","last_active":"2024-09-22T03:58:15.052205+0000","last_peered":"2024-09-22T03:58:15.052205+0000","last_clean":"2024-09-22T03:58:15.052205+0000","last_became_active":"2024-09-22T03:55:50.880295+0000","last_became_peered":"2024-09-22T03:55:50.880295+0000","last_unstale":"2024-09-22T03:58:15.052205+0000","last_undegraded":"2024-09-22T03:58:15.052205+0000","last_fullsized":"2024-09-22T03:58:15.052205+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1768,"log_dups_size":0,"ondisk_log_size":1768,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35258368,"num_objects":538,"num_object_clones":0,"num_object_copies":1614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1768,"num_write_kb":73792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"60'1766","reported_seq":1802,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-22T03:58:14.781706+0000","last_change":"2024-09-22T03:55:50.906894+0000","last_active":"2024-09-22T03:58:14.781706+0000","last_peered":"2024-09-22T03:58:14.781706+0000","last_clean":"2024-09-22T03:58:14.781706+0000","last_became_active":"2024-09-22T03:55:50.896899+0000","last_became_peered":"2024-09-22T03:55:50.896899+0000","last_unstale":"2024-09-22T03:58:14.781706+0000","last_undegraded":"2024-09-22T03:58:14.781706+0000","last_fullsized":"2024-09-22T03:58:14.781706+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1766,"log_dups_size":0,"ondisk_log_size":1766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35913728,"num_objects":548,"num_object_clones":0,"num_object_copies":1644,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1766,"num_write_kb":74048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"60'1752","reported_seq":1788,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-22T03:58:15.035264+0000","last_change":"2024-09-22T03:55:50.859578+0000","last_active":"2024-09-22T03:58:15.035264+0000","last_peered":"2024-09-22T03:58:15.035264+0000","last_clean":"2024-09-22T03:58:15.035264+0000","last_became_active":"2024-09-22T03:55:50.843710+0000","last_became_peered":"2024-09-22T03:55:50.843710+0000","last_unstale":"2024-09-22T03:58:15.035264+0000","last_undegraded":"2024-09-22T03:58:15.035264+0000","last_fullsized":"2024-09-22T03:58:15.035264+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1752,"log_dups_size":0,"ondisk_log_size":1752,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34078720,"num_objects":520,"num_object_clones":0,"num_object_copies":1560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1752,"num_write_kb":72704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"60'1813","reported_seq":1849,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-22T03:58:14.837418+0000","last_change":"2024-09-22T03:55:50.968411+0000","last_active":"2024-09-22T03:58:14.837418+0000","last_peered":"2024-09-22T03:58:14.837418+0000","last_clean":"2024-09-22T03:58:14.837418+0000","last_became_active":"2024-09-22T03:55:50.961718+0000","last_became_peered":"2024-09-22T03:55:50.961718+0000","last_unstale":"2024-09-22T03:58:14.837418+0000","last_undegraded":"2024-09-22T03:58:14.837418+0000","last_fullsized":"2024-09-22T03:58:14.837418+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1813,"log_dups_size":0,"ondisk_log_size":1813,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35848192,"num_objects":547,"num_object_clones":0,"num_object_copies":1641,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1813,"num_write_kb":75520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":223,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-22T03:58:02.790507+0000","last_change":"2024-09-22T03:49:12.034704+0000","last_active":"2024-09-22T03:58:02.790507+0000","last_peered":"2024-09-22T03:58:02.790507+0000","last_clean":"2024-09-22T03:58:02.790507+0000","last_became_active":"2024-09-22T03:49:12.027470+0000","last_became_peered":"2024-09-22T03:49:12.027470+0000","last_unstale":"2024-09-22T03:58:02.790507+0000","last_undegraded":"2024-09-22T03:58:02.790507+0000","last_fullsized":"2024-09-22T03:58:02.790507+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_clean_scrub_stamp":"2024-09-22T03:49:10.979949+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":149,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-22T03:58:02.810805+0000","last_change":"2024-09-22T03:49:17.031458+0000","last_active":"2024-09-22T03:58:02.810805+0000","last_peered":"2024-09-22T03:58:02.810805+0000","last_clean":"2024-09-22T03:58:02.810805+0000","last_became_active":"2024-09-22T03:49:15.125490+0000","last_became_peered":"2024-09-22T03:49:15.125490+0000","last_unstale":"2024-09-22T03:58:02.810805+0000","last_undegraded":"2024-09-22T03:58:02.810805+0000","last_fullsized":"2024-09-22T03:58:02.810805+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.7","version":"60'1793","reported_seq":1829,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-22T03:58:14.976191+0000","last_change":"2024-09-22T03:55:50.910597+0000","last_active":"2024-09-22T03:58:14.976191+0000","last_peered":"2024-09-22T03:58:14.976191+0000","last_clean":"2024-09-22T03:58:14.976191+0000","last_became_active":"2024-09-22T03:55:50.901290+0000","last_became_peered":"2024-09-22T03:55:50.901290+0000","last_unstale":"2024-09-22T03:58:14.976191+0000","last_undegraded":"2024-09-22T03:58:14.976191+0000","last_fullsized":"2024-09-22T03:58:14.976191+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1793,"log_dups_size":0,"ondisk_log_size":1793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33751040,"num_objects":515,"num_object_clones":0,"num_object_copies":1545,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1793,"num_write_kb":73856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":148,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-22T03:58:02.775897+0000","last_change":"2024-09-22T03:49:17.029339+0000","last_active":"2024-09-22T03:58:02.775897+0000","last_peered":"2024-09-22T03:58:02.775897+0000","last_clean":"2024-09-22T03:58:02.775897+0000","last_became_active":"2024-09-22T03:49:15.097304+0000","last_became_peered":"2024-09-22T03:49:15.097304+0000","last_unstale":"2024-09-22T03:58:02.775897+0000","last_undegraded":"2024-09-22T03:58:02.775897+0000","last_fullsized":"2024-09-22T03:58:02.775897+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"60'1768","reported_seq":1804,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-22T03:58:16.173633+0000","last_change":"2024-09-22T03:55:50.918358+0000","last_active":"2024-09-22T03:58:16.173633+0000","last_peered":"2024-09-22T03:58:16.173633+0000","last_clean":"2024-09-22T03:58:16.173633+0000","last_became_active":"2024-09-22T03:55:50.889906+0000","last_became_peered":"2024-09-22T03:55:50.889906+0000","last_unstale":"2024-09-22T03:58:16.173633+0000","last_undegraded":"2024-09-22T03:58:16.173633+0000","last_fullsized":"2024-09-22T03:58:16.173633+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1768,"log_dups_size":0,"ondisk_log_size":1768,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32112640,"num_objects":490,"num_object_clones":0,"num_object_copies":1470,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1768,"num_write_kb":72256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":148,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-22T03:58:02.789992+0000","last_change":"2024-09-22T03:49:17.029349+0000","last_active":"2024-09-22T03:58:02.789992+0000","last_peered":"2024-09-22T03:58:02.789992+0000","last_clean":"2024-09-22T03:58:02.789992+0000","last_became_active":"2024-09-22T03:49:15.094890+0000","last_became_peered":"2024-09-22T03:49:15.094890+0000","last_unstale":"2024-09-22T03:58:02.789992+0000","last_undegraded":"2024-09-22T03:58:02.789992+0000","last_fullsized":"2024-09-22T03:58:02.789992+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"60'1775","reported_seq":1811,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-22T03:58:14.941935+0000","last_change":"2024-09-22T03:55:50.939050+0000","last_active":"2024-09-22T03:58:14.941935+0000","last_peered":"2024-09-22T03:58:14.941935+0000","last_clean":"2024-09-22T03:58:14.941935+0000","last_became_active":"2024-09-22T03:55:50.929831+0000","last_became_peered":"2024-09-22T03:55:50.929831+0000","last_unstale":"2024-09-22T03:58:14.941935+0000","last_undegraded":"2024-09-22T03:58:14.941935+0000","last_fullsized":"2024-09-22T03:58:14.941935+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1775,"log_dups_size":0,"ondisk_log_size":1775,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35192832,"num_objects":537,"num_object_clones":0,"num_object_copies":1611,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1775,"num_write_kb":73984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":150,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-22T03:58:02.782406+0000","last_change":"2024-09-22T03:49:17.031466+0000","last_active":"2024-09-22T03:58:02.782406+0000","last_peered":"2024-09-22T03:58:02.782406+0000","last_clean":"2024-09-22T03:58:02.782406+0000","last_became_active":"2024-09-22T03:49:15.098420+0000","last_became_peered":"2024-09-22T03:49:15.098420+0000","last_unstale":"2024-09-22T03:58:02.782406+0000","last_undegraded":"2024-09-22T03:58:02.782406+0000","last_fullsized":"2024-09-22T03:58:02.782406+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3","version":"60'1720","reported_seq":1756,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-22T03:58:15.131328+0000","last_change":"2024-09-22T03:55:50.862956+0000","last_active":"2024-09-22T03:58:15.131328+0000","last_peered":"2024-09-22T03:58:15.131328+0000","last_clean":"2024-09-22T03:58:15.131328+0000","last_became_active":"2024-09-22T03:55:50.854828+0000","last_became_peered":"2024-09-22T03:55:50.854828+0000","last_unstale":"2024-09-22T03:58:15.131328+0000","last_undegraded":"2024-09-22T03:58:15.131328+0000","last_fullsized":"2024-09-22T03:58:15.131328+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1720,"log_dups_size":0,"ondisk_log_size":1720,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33947648,"num_objects":518,"num_object_clones":0,"num_object_copies":1554,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1720,"num_write_kb":71616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":148,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-22T03:58:02.796475+0000","last_change":"2024-09-22T03:49:17.036954+0000","last_active":"2024-09-22T03:58:02.796475+0000","last_peered":"2024-09-22T03:58:02.796475+0000","last_clean":"2024-09-22T03:58:02.796475+0000","last_became_active":"2024-09-22T03:49:15.110506+0000","last_became_peered":"2024-09-22T03:49:15.110506+0000","last_unstale":"2024-09-22T03:58:02.796475+0000","last_undegraded":"2024-09-22T03:58:02.796475+0000","last_fullsized":"2024-09-22T03:58:02.796475+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"60'1743","reported_seq":1779,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-22T03:58:14.754080+0000","last_change":"2024-09-22T03:55:50.927264+0000","last_active":"2024-09-22T03:58:14.754080+0000","last_peered":"2024-09-22T03:58:14.754080+0000","last_clean":"2024-09-22T03:58:14.754080+0000","last_became_active":"2024-09-22T03:55:50.919600+0000","last_became_peered":"2024-09-22T03:55:50.919600+0000","last_unstale":"2024-09-22T03:58:14.754080+0000","last_undegraded":"2024-09-22T03:58:14.754080+0000","last_fullsized":"2024-09-22T03:58:14.754080+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1743,"log_dups_size":0,"ondisk_log_size":1743,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34275328,"num_objects":523,"num_object_clones":0,"num_object_copies":1569,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1743,"num_write_kb":72512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":148,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-22T03:58:02.786442+0000","last_change":"2024-09-22T03:49:17.032989+0000","last_active":"2024-09-22T03:58:02.786442+0000","last_peered":"2024-09-22T03:58:02.786442+0000","last_clean":"2024-09-22T03:58:02.786442+0000","last_became_active":"2024-09-22T03:49:15.079260+0000","last_became_peered":"2024-09-22T03:49:15.079260+0000","last_unstale":"2024-09-22T03:58:02.786442+0000","last_undegraded":"2024-09-22T03:58:02.786442+0000","last_fullsized":"2024-09-22T03:58:02.786442+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"60'1789","reported_seq":1825,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-22T03:58:15.937686+0000","last_change":"2024-09-22T03:55:50.862926+0000","last_active":"2024-09-22T03:58:15.937686+0000","last_peered":"2024-09-22T03:58:15.937686+0000","last_clean":"2024-09-22T03:58:15.937686+0000","last_became_active":"2024-09-22T03:55:50.851824+0000","last_became_peered":"2024-09-22T03:55:50.851824+0000","last_unstale":"2024-09-22T03:58:15.937686+0000","last_undegraded":"2024-09-22T03:58:15.937686+0000","last_fullsized":"2024-09-22T03:58:15.937686+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1789,"log_dups_size":0,"ondisk_log_size":1789,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35061760,"num_objects":535,"num_object_clones":0,"num_object_copies":1605,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1789,"num_write_kb":74368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":148,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-22T03:58:02.796671+0000","last_change":"2024-09-22T03:49:17.036402+0000","last_active":"2024-09-22T03:58:02.796671+0000","last_peered":"2024-09-22T03:58:02.796671+0000","last_clean":"2024-09-22T03:58:02.796671+0000","last_became_active":"2024-09-22T03:49:15.108430+0000","last_became_peered":"2024-09-22T03:49:15.108430+0000","last_unstale":"2024-09-22T03:58:02.796671+0000","last_undegraded":"2024-09-22T03:58:02.796671+0000","last_fullsized":"2024-09-22T03:58:02.796671+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"60'1729","reported_seq":1765,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-22T03:58:14.989389+0000","last_change":"2024-09-22T03:55:50.878789+0000","last_active":"2024-09-22T03:58:14.989389+0000","last_peered":"2024-09-22T03:58:14.989389+0000","last_clean":"2024-09-22T03:58:14.989389+0000","last_became_active":"2024-09-22T03:55:50.852561+0000","last_became_peered":"2024-09-22T03:55:50.852561+0000","last_unstale":"2024-09-22T03:58:14.989389+0000","last_undegraded":"2024-09-22T03:58:14.989389+0000","last_fullsized":"2024-09-22T03:58:14.989389+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1729,"log_dups_size":0,"ondisk_log_size":1729,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35717120,"num_objects":545,"num_object_clones":0,"num_object_copies":1635,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1729,"num_write_kb":72768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":148,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-22T03:58:02.775445+0000","last_change":"2024-09-22T03:49:17.029128+0000","last_active":"2024-09-22T03:58:02.775445+0000","last_peered":"2024-09-22T03:58:02.775445+0000","last_clean":"2024-09-22T03:58:02.775445+0000","last_became_active":"2024-09-22T03:49:15.113396+0000","last_became_peered":"2024-09-22T03:49:15.113396+0000","last_unstale":"2024-09-22T03:58:02.775445+0000","last_undegraded":"2024-09-22T03:58:02.775445+0000","last_fullsized":"2024-09-22T03:58:02.775445+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":552009752,"num_objects":8424,"num_object_clones":0,"num_object_copies":25272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":28360,"num_write_kb":1177025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":103604224,"data_stored":1657471048,"data_compressed":78705589,"data_compressed_allocated":103591936,"data_compressed_original":1657470976,"omap_allocated":0,"internal_metadata":0},"log_size":28360,"ondisk_log_size":28360,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949673503,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":115272,"kb_used_data":21816,"kb_used_omap":0,"kb_used_meta":93440,"kb_avail":94256568,"statfs":{"total":96636764160,"available":96518725632,"internally_reserved":0,"allocated":22339584,"data_stored":349097928,"data_compressed":16570335,"data_compressed_allocated":21811200,"data_compressed_original":348897280,"omap_allocated":0,"internal_metadata":95682560},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654706208,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":115296,"kb_used_data":25996,"kb_used_omap":0,"kb_used_meta":89280,"kb_avail":94256544,"statfs":{"total":96636764160,"available":96518701056,"internally_reserved":0,"allocated":26619904,"data_stored":417910208,"data_compressed":19835887,"data_compressed_allocated":26107904,"data_compressed_original":417726464,"omap_allocated":0,"internal_metadata":91422720},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706207,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":115548,"kb_used_data":26248,"kb_used_omap":0,"kb_used_meta":89280,"kb_avail":94256292,"statfs":{"total":96636764160,"available":96518443008,"internally_reserved":0,"allocated":26877952,"data_stored":421646304,"data_compressed":20015319,"data_compressed_allocated":26345472,"data_compressed_original":421445632,"omap_allocated":0,"internal_metadata":91422720},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706207,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":115864,"kb_used_data":30728,"kb_used_omap":0,"kb_used_meta":85120,"kb_avail":94255976,"statfs":{"total":96636764160,"available":96518119424,"internally_reserved":0,"allocated":31465472,"data_stored":495112141,"data_compressed":23503872,"data_compressed_allocated":30937088,"data_compressed_original":494911488,"omap_allocated":0,"internal_metadata":87162880},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":30281728,"data_stored":484442136,"data_compressed":23003904,"data_compressed_allocated":30277632,"data_compressed_original":484442112,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":21348352,"data_stored":341573632,"data_compressed":16219743,"data_compressed_allocated":21348352,"data_compressed_original":341573632,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":25899008,"data_stored":414318616,"data_compressed":19674063,"data_compressed_allocated":25894912,"data_compressed_original":414318592,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":26075136,"data_stored":417136664,"data_compressed":19807879,"data_compressed_allocated":26071040,"data_compressed_original":417136640,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:58:20.315 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:58:20.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:58:20.492+0000 7f29e94ec640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:58:20.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:58:20.509+0000 7f29e94ec640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:58:20.569 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:58:20.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:58:20.740+0000 7f57b3f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:58:20.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:58:20.753+0000 7f57b3f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:58:20.900 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:58:20.901 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-22T03:58:20.916 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":332,"stamp":"2024-09-22T03:58:19.742523+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":552600139,"num_objects":8428,"num_object_clones":0,"num_object_copies":25284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":28441,"num_write_kb":1178133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28415,"ondisk_log_size":28415,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":461980,"kb_used_data":104788,"kb_used_omap":0,"kb_used_meta":357120,"kb_avail":377025380,"statfs":{"total":386547056640,"available":386073989120,"internally_reserved":0,"allocated":107302912,"data_stored":1683766581,"data_compressed":79925413,"data_compressed_allocated":105201664,"data_compressed_original":1682980864,"omap_allocated":0,"internal_metadata":365690880},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-58851328,"num_objects":-898,"num_object_clones":0,"num_object_copies":-2694,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":898,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.664046"},"pg_stats":[{"pgid":"5.f","version":"60'1802","reported_seq":1838,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-22T03:58:15.837742+0000","last_change":"2024-09-22T03:55:50.938932+0000","last_active":"2024-09-22T03:58:15.837742+0000","last_peered":"2024-09-22T03:58:15.837742+0000","last_clean":"2024-09-22T03:58:15.837742+0000","last_became_active":"2024-09-22T03:55:50.929290+0000","last_became_peered":"2024-09-22T03:55:50.929290+0000","last_unstale":"2024-09-22T03:58:15.837742+0000","last_undegraded":"2024-09-22T03:58:15.837742+0000","last_fullsized":"2024-09-22T03:58:15.837742+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1802,"log_dups_size":0,"ondisk_log_size":1802,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33947648,"num_objects":518,"num_object_clones":0,"num_object_copies":1554,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1802,"num_write_kb":74240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"60'1757","reported_seq":1793,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-22T03:58:14.966863+0000","last_change":"2024-09-22T03:55:50.848180+0000","last_active":"2024-09-22T03:58:14.966863+0000","last_peered":"2024-09-22T03:58:14.966863+0000","last_clean":"2024-09-22T03:58:14.966863+0000","last_became_active":"2024-09-22T03:55:50.838302+0000","last_became_peered":"2024-09-22T03:55:50.838302+0000","last_unstale":"2024-09-22T03:58:14.966863+0000","last_undegraded":"2024-09-22T03:58:14.966863+0000","last_fullsized":"2024-09-22T03:58:14.966863+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1757,"log_dups_size":0,"ondisk_log_size":1757,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34406400,"num_objects":525,"num_object_clones":0,"num_object_copies":1575,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1757,"num_write_kb":73024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"60'1847","reported_seq":1884,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-22T03:58:15.069581+0000","last_change":"2024-09-22T03:55:50.872362+0000","last_active":"2024-09-22T03:58:15.069581+0000","last_peered":"2024-09-22T03:58:15.069581+0000","last_clean":"2024-09-22T03:58:15.069581+0000","last_became_active":"2024-09-22T03:55:50.867322+0000","last_became_peered":"2024-09-22T03:55:50.867322+0000","last_unstale":"2024-09-22T03:58:15.069581+0000","last_undegraded":"2024-09-22T03:58:15.069581+0000","last_fullsized":"2024-09-22T03:58:15.069581+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1847,"log_dups_size":0,"ondisk_log_size":1847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34865176,"num_objects":533,"num_object_clones":0,"num_object_copies":1599,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1847,"num_write_kb":76097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"60'1825","reported_seq":1861,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-22T03:58:16.127764+0000","last_change":"2024-09-22T03:55:50.942624+0000","last_active":"2024-09-22T03:58:16.127764+0000","last_peered":"2024-09-22T03:58:16.127764+0000","last_clean":"2024-09-22T03:58:16.127764+0000","last_became_active":"2024-09-22T03:55:50.922812+0000","last_became_peered":"2024-09-22T03:55:50.922812+0000","last_unstale":"2024-09-22T03:58:16.127764+0000","last_undegraded":"2024-09-22T03:58:16.127764+0000","last_fullsized":"2024-09-22T03:58:16.127764+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1825,"log_dups_size":0,"ondisk_log_size":1825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34406400,"num_objects":525,"num_object_clones":0,"num_object_copies":1575,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1825,"num_write_kb":75200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"60'1713","reported_seq":1749,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-22T03:58:14.785239+0000","last_change":"2024-09-22T03:55:50.890353+0000","last_active":"2024-09-22T03:58:14.785239+0000","last_peered":"2024-09-22T03:58:14.785239+0000","last_clean":"2024-09-22T03:58:14.785239+0000","last_became_active":"2024-09-22T03:55:50.882633+0000","last_became_peered":"2024-09-22T03:55:50.882633+0000","last_unstale":"2024-09-22T03:58:14.785239+0000","last_undegraded":"2024-09-22T03:58:14.785239+0000","last_fullsized":"2024-09-22T03:58:14.785239+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1713,"log_dups_size":0,"ondisk_log_size":1713,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33226752,"num_objects":507,"num_object_clones":0,"num_object_copies":1521,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1713,"num_write_kb":71040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.a","version":"60'1768","reported_seq":1804,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-22T03:58:15.052205+0000","last_change":"2024-09-22T03:55:50.891052+0000","last_active":"2024-09-22T03:58:15.052205+0000","last_peered":"2024-09-22T03:58:15.052205+0000","last_clean":"2024-09-22T03:58:15.052205+0000","last_became_active":"2024-09-22T03:55:50.880295+0000","last_became_peered":"2024-09-22T03:55:50.880295+0000","last_unstale":"2024-09-22T03:58:15.052205+0000","last_undegraded":"2024-09-22T03:58:15.052205+0000","last_fullsized":"2024-09-22T03:58:15.052205+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1768,"log_dups_size":0,"ondisk_log_size":1768,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35258368,"num_objects":538,"num_object_clones":0,"num_object_copies":1614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1768,"num_write_kb":73792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"60'1766","reported_seq":1802,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-22T03:58:14.781706+0000","last_change":"2024-09-22T03:55:50.906894+0000","last_active":"2024-09-22T03:58:14.781706+0000","last_peered":"2024-09-22T03:58:14.781706+0000","last_clean":"2024-09-22T03:58:14.781706+0000","last_became_active":"2024-09-22T03:55:50.896899+0000","last_became_peered":"2024-09-22T03:55:50.896899+0000","last_unstale":"2024-09-22T03:58:14.781706+0000","last_undegraded":"2024-09-22T03:58:14.781706+0000","last_fullsized":"2024-09-22T03:58:14.781706+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1766,"log_dups_size":0,"ondisk_log_size":1766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35913728,"num_objects":548,"num_object_clones":0,"num_object_copies":1644,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1766,"num_write_kb":74048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"60'1752","reported_seq":1788,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-22T03:58:15.035264+0000","last_change":"2024-09-22T03:55:50.859578+0000","last_active":"2024-09-22T03:58:15.035264+0000","last_peered":"2024-09-22T03:58:15.035264+0000","last_clean":"2024-09-22T03:58:15.035264+0000","last_became_active":"2024-09-22T03:55:50.843710+0000","last_became_peered":"2024-09-22T03:55:50.843710+0000","last_unstale":"2024-09-22T03:58:15.035264+0000","last_undegraded":"2024-09-22T03:58:15.035264+0000","last_fullsized":"2024-09-22T03:58:15.035264+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1752,"log_dups_size":0,"ondisk_log_size":1752,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34078720,"num_objects":520,"num_object_clones":0,"num_object_copies":1560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1752,"num_write_kb":72704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"60'1813","reported_seq":1849,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-22T03:58:14.837418+0000","last_change":"2024-09-22T03:55:50.968411+0000","last_active":"2024-09-22T03:58:14.837418+0000","last_peered":"2024-09-22T03:58:14.837418+0000","last_clean":"2024-09-22T03:58:14.837418+0000","last_became_active":"2024-09-22T03:55:50.961718+0000","last_became_peered":"2024-09-22T03:55:50.961718+0000","last_unstale":"2024-09-22T03:58:14.837418+0000","last_undegraded":"2024-09-22T03:58:14.837418+0000","last_fullsized":"2024-09-22T03:58:14.837418+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1813,"log_dups_size":0,"ondisk_log_size":1813,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35848192,"num_objects":547,"num_object_clones":0,"num_object_copies":1641,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1813,"num_write_kb":75520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":223,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-22T03:58:02.790507+0000","last_change":"2024-09-22T03:49:12.034704+0000","last_active":"2024-09-22T03:58:02.790507+0000","last_peered":"2024-09-22T03:58:02.790507+0000","last_clean":"2024-09-22T03:58:02.790507+0000","last_became_active":"2024-09-22T03:49:12.027470+0000","last_became_peered":"2024-09-22T03:49:12.027470+0000","last_unstale":"2024-09-22T03:58:02.790507+0000","last_undegraded":"2024-09-22T03:58:02.790507+0000","last_fullsized":"2024-09-22T03:58:02.790507+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_clean_scrub_stamp":"2024-09-22T03:49:10.979949+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":149,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-22T03:58:02.810805+0000","last_change":"2024-09-22T03:49:17.031458+0000","last_active":"2024-09-22T03:58:02.810805+0000","last_peered":"2024-09-22T03:58:02.810805+0000","last_clean":"2024-09-22T03:58:02.810805+0000","last_became_active":"2024-09-22T03:49:15.125490+0000","last_became_peered":"2024-09-22T03:49:15.125490+0000","last_unstale":"2024-09-22T03:58:02.810805+0000","last_undegraded":"2024-09-22T03:58:02.810805+0000","last_fullsized":"2024-09-22T03:58:02.810805+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.7","version":"60'1793","reported_seq":1829,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-22T03:58:14.976191+0000","last_change":"2024-09-22T03:55:50.910597+0000","last_active":"2024-09-22T03:58:14.976191+0000","last_peered":"2024-09-22T03:58:14.976191+0000","last_clean":"2024-09-22T03:58:14.976191+0000","last_became_active":"2024-09-22T03:55:50.901290+0000","last_became_peered":"2024-09-22T03:55:50.901290+0000","last_unstale":"2024-09-22T03:58:14.976191+0000","last_undegraded":"2024-09-22T03:58:14.976191+0000","last_fullsized":"2024-09-22T03:58:14.976191+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1793,"log_dups_size":0,"ondisk_log_size":1793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33751040,"num_objects":515,"num_object_clones":0,"num_object_copies":1545,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1793,"num_write_kb":73856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":148,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-22T03:58:02.775897+0000","last_change":"2024-09-22T03:49:17.029339+0000","last_active":"2024-09-22T03:58:02.775897+0000","last_peered":"2024-09-22T03:58:02.775897+0000","last_clean":"2024-09-22T03:58:02.775897+0000","last_became_active":"2024-09-22T03:49:15.097304+0000","last_became_peered":"2024-09-22T03:49:15.097304+0000","last_unstale":"2024-09-22T03:58:02.775897+0000","last_undegraded":"2024-09-22T03:58:02.775897+0000","last_fullsized":"2024-09-22T03:58:02.775897+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"60'1768","reported_seq":1804,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-22T03:58:16.173633+0000","last_change":"2024-09-22T03:55:50.918358+0000","last_active":"2024-09-22T03:58:16.173633+0000","last_peered":"2024-09-22T03:58:16.173633+0000","last_clean":"2024-09-22T03:58:16.173633+0000","last_became_active":"2024-09-22T03:55:50.889906+0000","last_became_peered":"2024-09-22T03:55:50.889906+0000","last_unstale":"2024-09-22T03:58:16.173633+0000","last_undegraded":"2024-09-22T03:58:16.173633+0000","last_fullsized":"2024-09-22T03:58:16.173633+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1768,"log_dups_size":0,"ondisk_log_size":1768,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32112640,"num_objects":490,"num_object_clones":0,"num_object_copies":1470,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1768,"num_write_kb":72256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":148,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-22T03:58:02.789992+0000","last_change":"2024-09-22T03:49:17.029349+0000","last_active":"2024-09-22T03:58:02.789992+0000","last_peered":"2024-09-22T03:58:02.789992+0000","last_clean":"2024-09-22T03:58:02.789992+0000","last_became_active":"2024-09-22T03:49:15.094890+0000","last_became_peered":"2024-09-22T03:49:15.094890+0000","last_unstale":"2024-09-22T03:58:02.789992+0000","last_undegraded":"2024-09-22T03:58:02.789992+0000","last_fullsized":"2024-09-22T03:58:02.789992+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"60'1775","reported_seq":1811,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-22T03:58:14.941935+0000","last_change":"2024-09-22T03:55:50.939050+0000","last_active":"2024-09-22T03:58:14.941935+0000","last_peered":"2024-09-22T03:58:14.941935+0000","last_clean":"2024-09-22T03:58:14.941935+0000","last_became_active":"2024-09-22T03:55:50.929831+0000","last_became_peered":"2024-09-22T03:55:50.929831+0000","last_unstale":"2024-09-22T03:58:14.941935+0000","last_undegraded":"2024-09-22T03:58:14.941935+0000","last_fullsized":"2024-09-22T03:58:14.941935+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1775,"log_dups_size":0,"ondisk_log_size":1775,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35192832,"num_objects":537,"num_object_clones":0,"num_object_copies":1611,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1775,"num_write_kb":73984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":150,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-22T03:58:02.782406+0000","last_change":"2024-09-22T03:49:17.031466+0000","last_active":"2024-09-22T03:58:02.782406+0000","last_peered":"2024-09-22T03:58:02.782406+0000","last_clean":"2024-09-22T03:58:02.782406+0000","last_became_active":"2024-09-22T03:49:15.098420+0000","last_became_peered":"2024-09-22T03:49:15.098420+0000","last_unstale":"2024-09-22T03:58:02.782406+0000","last_undegraded":"2024-09-22T03:58:02.782406+0000","last_fullsized":"2024-09-22T03:58:02.782406+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3","version":"60'1720","reported_seq":1756,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-22T03:58:15.131328+0000","last_change":"2024-09-22T03:55:50.862956+0000","last_active":"2024-09-22T03:58:15.131328+0000","last_peered":"2024-09-22T03:58:15.131328+0000","last_clean":"2024-09-22T03:58:15.131328+0000","last_became_active":"2024-09-22T03:55:50.854828+0000","last_became_peered":"2024-09-22T03:55:50.854828+0000","last_unstale":"2024-09-22T03:58:15.131328+0000","last_undegraded":"2024-09-22T03:58:15.131328+0000","last_fullsized":"2024-09-22T03:58:15.131328+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1720,"log_dups_size":0,"ondisk_log_size":1720,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33947648,"num_objects":518,"num_object_clones":0,"num_object_copies":1554,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1720,"num_write_kb":71616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":148,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-22T03:58:02.796475+0000","last_change":"2024-09-22T03:49:17.036954+0000","last_active":"2024-09-22T03:58:02.796475+0000","last_peered":"2024-09-22T03:58:02.796475+0000","last_clean":"2024-09-22T03:58:02.796475+0000","last_became_active":"2024-09-22T03:49:15.110506+0000","last_became_peered":"2024-09-22T03:49:15.110506+0000","last_unstale":"2024-09-22T03:58:02.796475+0000","last_undegraded":"2024-09-22T03:58:02.796475+0000","last_fullsized":"2024-09-22T03:58:02.796475+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"60'1743","reported_seq":1779,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-22T03:58:14.754080+0000","last_change":"2024-09-22T03:55:50.927264+0000","last_active":"2024-09-22T03:58:14.754080+0000","last_peered":"2024-09-22T03:58:14.754080+0000","last_clean":"2024-09-22T03:58:14.754080+0000","last_became_active":"2024-09-22T03:55:50.919600+0000","last_became_peered":"2024-09-22T03:55:50.919600+0000","last_unstale":"2024-09-22T03:58:14.754080+0000","last_undegraded":"2024-09-22T03:58:14.754080+0000","last_fullsized":"2024-09-22T03:58:14.754080+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1743,"log_dups_size":0,"ondisk_log_size":1743,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34275328,"num_objects":523,"num_object_clones":0,"num_object_copies":1569,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1743,"num_write_kb":72512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":148,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-22T03:58:02.786442+0000","last_change":"2024-09-22T03:49:17.032989+0000","last_active":"2024-09-22T03:58:02.786442+0000","last_peered":"2024-09-22T03:58:02.786442+0000","last_clean":"2024-09-22T03:58:02.786442+0000","last_became_active":"2024-09-22T03:49:15.079260+0000","last_became_peered":"2024-09-22T03:49:15.079260+0000","last_unstale":"2024-09-22T03:58:02.786442+0000","last_undegraded":"2024-09-22T03:58:02.786442+0000","last_fullsized":"2024-09-22T03:58:02.786442+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"60'1789","reported_seq":1825,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-22T03:58:15.937686+0000","last_change":"2024-09-22T03:55:50.862926+0000","last_active":"2024-09-22T03:58:15.937686+0000","last_peered":"2024-09-22T03:58:15.937686+0000","last_clean":"2024-09-22T03:58:15.937686+0000","last_became_active":"2024-09-22T03:55:50.851824+0000","last_became_peered":"2024-09-22T03:55:50.851824+0000","last_unstale":"2024-09-22T03:58:15.937686+0000","last_undegraded":"2024-09-22T03:58:15.937686+0000","last_fullsized":"2024-09-22T03:58:15.937686+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1789,"log_dups_size":0,"ondisk_log_size":1789,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35061760,"num_objects":535,"num_object_clones":0,"num_object_copies":1605,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1789,"num_write_kb":74368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":148,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-22T03:58:02.796671+0000","last_change":"2024-09-22T03:49:17.036402+0000","last_active":"2024-09-22T03:58:02.796671+0000","last_peered":"2024-09-22T03:58:02.796671+0000","last_clean":"2024-09-22T03:58:02.796671+0000","last_became_active":"2024-09-22T03:49:15.108430+0000","last_became_peered":"2024-09-22T03:49:15.108430+0000","last_unstale":"2024-09-22T03:58:02.796671+0000","last_undegraded":"2024-09-22T03:58:02.796671+0000","last_fullsized":"2024-09-22T03:58:02.796671+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"60'1729","reported_seq":1765,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-22T03:58:14.989389+0000","last_change":"2024-09-22T03:55:50.878789+0000","last_active":"2024-09-22T03:58:14.989389+0000","last_peered":"2024-09-22T03:58:14.989389+0000","last_clean":"2024-09-22T03:58:14.989389+0000","last_became_active":"2024-09-22T03:55:50.852561+0000","last_became_peered":"2024-09-22T03:55:50.852561+0000","last_unstale":"2024-09-22T03:58:14.989389+0000","last_undegraded":"2024-09-22T03:58:14.989389+0000","last_fullsized":"2024-09-22T03:58:14.989389+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1729,"log_dups_size":0,"ondisk_log_size":1729,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35717120,"num_objects":545,"num_object_clones":0,"num_object_copies":1635,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1729,"num_write_kb":72768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":148,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-22T03:58:02.775445+0000","last_change":"2024-09-22T03:49:17.029128+0000","last_active":"2024-09-22T03:58:02.775445+0000","last_peered":"2024-09-22T03:58:02.775445+0000","last_clean":"2024-09-22T03:58:02.775445+0000","last_became_active":"2024-09-22T03:49:15.113396+0000","last_became_peered":"2024-09-22T03:49:15.113396+0000","last_unstale":"2024-09-22T03:58:02.775445+0000","last_undegraded":"2024-09-22T03:58:02.775445+0000","last_fullsized":"2024-09-22T03:58:02.775445+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":552009752,"num_objects":8424,"num_object_clones":0,"num_object_copies":25272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":28360,"num_write_kb":1177025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":103604224,"data_stored":1657471048,"data_compressed":78705589,"data_compressed_allocated":103591936,"data_compressed_original":1657470976,"omap_allocated":0,"internal_metadata":0},"log_size":28360,"ondisk_log_size":28360,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949673503,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":115272,"kb_used_data":21816,"kb_used_omap":0,"kb_used_meta":93440,"kb_avail":94256568,"statfs":{"total":96636764160,"available":96518725632,"internally_reserved":0,"allocated":22339584,"data_stored":349097928,"data_compressed":16570335,"data_compressed_allocated":21811200,"data_compressed_original":348897280,"omap_allocated":0,"internal_metadata":95682560},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654706208,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":115296,"kb_used_data":25996,"kb_used_omap":0,"kb_used_meta":89280,"kb_avail":94256544,"statfs":{"total":96636764160,"available":96518701056,"internally_reserved":0,"allocated":26619904,"data_stored":417910208,"data_compressed":19835887,"data_compressed_allocated":26107904,"data_compressed_original":417726464,"omap_allocated":0,"internal_metadata":91422720},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706207,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":115548,"kb_used_data":26248,"kb_used_omap":0,"kb_used_meta":89280,"kb_avail":94256292,"statfs":{"total":96636764160,"available":96518443008,"internally_reserved":0,"allocated":26877952,"data_stored":421646304,"data_compressed":20015319,"data_compressed_allocated":26345472,"data_compressed_original":421445632,"omap_allocated":0,"internal_metadata":91422720},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706207,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":115864,"kb_used_data":30728,"kb_used_omap":0,"kb_used_meta":85120,"kb_avail":94255976,"statfs":{"total":96636764160,"available":96518119424,"internally_reserved":0,"allocated":31465472,"data_stored":495112141,"data_compressed":23503872,"data_compressed_allocated":30937088,"data_compressed_original":494911488,"omap_allocated":0,"internal_metadata":87162880},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":30281728,"data_stored":484442136,"data_compressed":23003904,"data_compressed_allocated":30277632,"data_compressed_original":484442112,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":21348352,"data_stored":341573632,"data_compressed":16219743,"data_compressed_allocated":21348352,"data_compressed_original":341573632,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":25899008,"data_stored":414318616,"data_compressed":19674063,"data_compressed_allocated":25894912,"data_compressed_original":414318592,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":26075136,"data_stored":417136664,"data_compressed":19807879,"data_compressed_allocated":26071040,"data_compressed_original":417136640,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:58:20.917 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-22T03:58:20.917 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:58:20.917 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:58:21.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:58:21.071+0000 7f2fd707d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:58:21.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:58:21.086+0000 7f2fd707d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:58:21.411 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:58:21.412 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-22T03:58:21.431 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":333,"stamp":"2024-09-22T03:58:21.079546+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":510984779,"num_objects":7793,"num_object_clones":0,"num_object_copies":23379,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":29076,"num_write_kb":1178133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29050,"ondisk_log_size":29050,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":462336,"kb_used_data":96828,"kb_used_omap":0,"kb_used_meta":365440,"kb_avail":377025024,"statfs":{"total":386547056640,"available":386073624576,"internally_reserved":0,"allocated":99151872,"data_stored":1552071951,"data_compressed":73670293,"data_compressed_allocated":96968704,"data_compressed_original":1551253504,"omap_allocated":0,"internal_metadata":374210560},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-41615360,"num_objects":-635,"num_object_clones":0,"num_object_copies":-1905,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":635,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.354427"},"pg_stats":[{"pgid":"5.f","version":"60'1802","reported_seq":1838,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-22T03:58:15.837742+0000","last_change":"2024-09-22T03:55:50.938932+0000","last_active":"2024-09-22T03:58:15.837742+0000","last_peered":"2024-09-22T03:58:15.837742+0000","last_clean":"2024-09-22T03:58:15.837742+0000","last_became_active":"2024-09-22T03:55:50.929290+0000","last_became_peered":"2024-09-22T03:55:50.929290+0000","last_unstale":"2024-09-22T03:58:15.837742+0000","last_undegraded":"2024-09-22T03:58:15.837742+0000","last_fullsized":"2024-09-22T03:58:15.837742+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1802,"log_dups_size":0,"ondisk_log_size":1802,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33947648,"num_objects":518,"num_object_clones":0,"num_object_copies":1554,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1802,"num_write_kb":74240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"64'1806","reported_seq":1854,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-22T03:58:20.047937+0000","last_change":"2024-09-22T03:55:50.848180+0000","last_active":"2024-09-22T03:58:20.047937+0000","last_peered":"2024-09-22T03:58:20.047937+0000","last_clean":"2024-09-22T03:58:20.047937+0000","last_became_active":"2024-09-22T03:55:50.838302+0000","last_became_peered":"2024-09-22T03:55:50.838302+0000","last_unstale":"2024-09-22T03:58:20.047937+0000","last_undegraded":"2024-09-22T03:58:20.047937+0000","last_fullsized":"2024-09-22T03:58:20.047937+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1806,"log_dups_size":0,"ondisk_log_size":1806,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31195136,"num_objects":476,"num_object_clones":0,"num_object_copies":1428,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1806,"num_write_kb":73024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"64'1900","reported_seq":1949,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-22T03:58:19.982102+0000","last_change":"2024-09-22T03:55:50.872362+0000","last_active":"2024-09-22T03:58:19.982102+0000","last_peered":"2024-09-22T03:58:19.982102+0000","last_clean":"2024-09-22T03:58:19.982102+0000","last_became_active":"2024-09-22T03:55:50.867322+0000","last_became_peered":"2024-09-22T03:55:50.867322+0000","last_unstale":"2024-09-22T03:58:19.982102+0000","last_undegraded":"2024-09-22T03:58:19.982102+0000","last_fullsized":"2024-09-22T03:58:19.982102+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1900,"log_dups_size":0,"ondisk_log_size":1900,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31391768,"num_objects":480,"num_object_clones":0,"num_object_copies":1440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1900,"num_write_kb":76097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"60'1825","reported_seq":1861,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-22T03:58:16.127764+0000","last_change":"2024-09-22T03:55:50.942624+0000","last_active":"2024-09-22T03:58:16.127764+0000","last_peered":"2024-09-22T03:58:16.127764+0000","last_clean":"2024-09-22T03:58:16.127764+0000","last_became_active":"2024-09-22T03:55:50.922812+0000","last_became_peered":"2024-09-22T03:55:50.922812+0000","last_unstale":"2024-09-22T03:58:16.127764+0000","last_undegraded":"2024-09-22T03:58:16.127764+0000","last_fullsized":"2024-09-22T03:58:16.127764+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1825,"log_dups_size":0,"ondisk_log_size":1825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34406400,"num_objects":525,"num_object_clones":0,"num_object_copies":1575,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1825,"num_write_kb":75200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"64'1774","reported_seq":1822,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-22T03:58:19.988194+0000","last_change":"2024-09-22T03:55:50.890353+0000","last_active":"2024-09-22T03:58:19.988194+0000","last_peered":"2024-09-22T03:58:19.988194+0000","last_clean":"2024-09-22T03:58:19.988194+0000","last_became_active":"2024-09-22T03:55:50.882633+0000","last_became_peered":"2024-09-22T03:55:50.882633+0000","last_unstale":"2024-09-22T03:58:19.988194+0000","last_undegraded":"2024-09-22T03:58:19.988194+0000","last_fullsized":"2024-09-22T03:58:19.988194+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1774,"log_dups_size":0,"ondisk_log_size":1774,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29229056,"num_objects":446,"num_object_clones":0,"num_object_copies":1338,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1774,"num_write_kb":71040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.a","version":"64'1827","reported_seq":1875,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-22T03:58:20.144739+0000","last_change":"2024-09-22T03:55:50.891052+0000","last_active":"2024-09-22T03:58:20.144739+0000","last_peered":"2024-09-22T03:58:20.144739+0000","last_clean":"2024-09-22T03:58:20.144739+0000","last_became_active":"2024-09-22T03:55:50.880295+0000","last_became_peered":"2024-09-22T03:55:50.880295+0000","last_unstale":"2024-09-22T03:58:20.144739+0000","last_undegraded":"2024-09-22T03:58:20.144739+0000","last_fullsized":"2024-09-22T03:58:20.144739+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1827,"log_dups_size":0,"ondisk_log_size":1827,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31391744,"num_objects":479,"num_object_clones":0,"num_object_copies":1437,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1827,"num_write_kb":73792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"64'1819","reported_seq":1867,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-22T03:58:20.038526+0000","last_change":"2024-09-22T03:55:50.906894+0000","last_active":"2024-09-22T03:58:20.038526+0000","last_peered":"2024-09-22T03:58:20.038526+0000","last_clean":"2024-09-22T03:58:20.038526+0000","last_became_active":"2024-09-22T03:55:50.896899+0000","last_became_peered":"2024-09-22T03:55:50.896899+0000","last_unstale":"2024-09-22T03:58:20.038526+0000","last_undegraded":"2024-09-22T03:58:20.038526+0000","last_fullsized":"2024-09-22T03:58:20.038526+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1819,"log_dups_size":0,"ondisk_log_size":1819,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32440320,"num_objects":495,"num_object_clones":0,"num_object_copies":1485,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1819,"num_write_kb":74048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"64'1797","reported_seq":1845,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-22T03:58:19.813869+0000","last_change":"2024-09-22T03:55:50.859578+0000","last_active":"2024-09-22T03:58:19.813869+0000","last_peered":"2024-09-22T03:58:19.813869+0000","last_clean":"2024-09-22T03:58:19.813869+0000","last_became_active":"2024-09-22T03:55:50.843710+0000","last_became_peered":"2024-09-22T03:55:50.843710+0000","last_unstale":"2024-09-22T03:58:19.813869+0000","last_undegraded":"2024-09-22T03:58:19.813869+0000","last_fullsized":"2024-09-22T03:58:19.813869+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1797,"log_dups_size":0,"ondisk_log_size":1797,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31129600,"num_objects":475,"num_object_clones":0,"num_object_copies":1425,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1797,"num_write_kb":72704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"64'1872","reported_seq":1920,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-22T03:58:20.179734+0000","last_change":"2024-09-22T03:55:50.968411+0000","last_active":"2024-09-22T03:58:20.179734+0000","last_peered":"2024-09-22T03:58:20.179734+0000","last_clean":"2024-09-22T03:58:20.179734+0000","last_became_active":"2024-09-22T03:55:50.961718+0000","last_became_peered":"2024-09-22T03:55:50.961718+0000","last_unstale":"2024-09-22T03:58:20.179734+0000","last_undegraded":"2024-09-22T03:58:20.179734+0000","last_fullsized":"2024-09-22T03:58:20.179734+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1872,"log_dups_size":0,"ondisk_log_size":1872,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31981568,"num_objects":488,"num_object_clones":0,"num_object_copies":1464,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1872,"num_write_kb":75520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":223,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-22T03:58:02.790507+0000","last_change":"2024-09-22T03:49:12.034704+0000","last_active":"2024-09-22T03:58:02.790507+0000","last_peered":"2024-09-22T03:58:02.790507+0000","last_clean":"2024-09-22T03:58:02.790507+0000","last_became_active":"2024-09-22T03:49:12.027470+0000","last_became_peered":"2024-09-22T03:49:12.027470+0000","last_unstale":"2024-09-22T03:58:02.790507+0000","last_undegraded":"2024-09-22T03:58:02.790507+0000","last_fullsized":"2024-09-22T03:58:02.790507+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_clean_scrub_stamp":"2024-09-22T03:49:10.979949+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":161,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-22T03:58:19.814052+0000","last_change":"2024-09-22T03:49:17.031458+0000","last_active":"2024-09-22T03:58:19.814052+0000","last_peered":"2024-09-22T03:58:19.814052+0000","last_clean":"2024-09-22T03:58:19.814052+0000","last_became_active":"2024-09-22T03:49:15.125490+0000","last_became_peered":"2024-09-22T03:49:15.125490+0000","last_unstale":"2024-09-22T03:58:19.814052+0000","last_undegraded":"2024-09-22T03:58:19.814052+0000","last_fullsized":"2024-09-22T03:58:19.814052+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.7","version":"63'1847","reported_seq":1895,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-22T03:58:19.809848+0000","last_change":"2024-09-22T03:55:50.910597+0000","last_active":"2024-09-22T03:58:19.809848+0000","last_peered":"2024-09-22T03:58:19.809848+0000","last_clean":"2024-09-22T03:58:19.809848+0000","last_became_active":"2024-09-22T03:55:50.901290+0000","last_became_peered":"2024-09-22T03:55:50.901290+0000","last_unstale":"2024-09-22T03:58:19.809848+0000","last_undegraded":"2024-09-22T03:58:19.809848+0000","last_fullsized":"2024-09-22T03:58:19.809848+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1847,"log_dups_size":0,"ondisk_log_size":1847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30212096,"num_objects":461,"num_object_clones":0,"num_object_copies":1383,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1847,"num_write_kb":73856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":160,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-22T03:58:19.790211+0000","last_change":"2024-09-22T03:49:17.029339+0000","last_active":"2024-09-22T03:58:19.790211+0000","last_peered":"2024-09-22T03:58:19.790211+0000","last_clean":"2024-09-22T03:58:19.790211+0000","last_became_active":"2024-09-22T03:49:15.097304+0000","last_became_peered":"2024-09-22T03:49:15.097304+0000","last_unstale":"2024-09-22T03:58:19.790211+0000","last_undegraded":"2024-09-22T03:58:19.790211+0000","last_fullsized":"2024-09-22T03:58:19.790211+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"60'1768","reported_seq":1804,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-22T03:58:16.173633+0000","last_change":"2024-09-22T03:55:50.918358+0000","last_active":"2024-09-22T03:58:16.173633+0000","last_peered":"2024-09-22T03:58:16.173633+0000","last_clean":"2024-09-22T03:58:16.173633+0000","last_became_active":"2024-09-22T03:55:50.889906+0000","last_became_peered":"2024-09-22T03:55:50.889906+0000","last_unstale":"2024-09-22T03:58:16.173633+0000","last_undegraded":"2024-09-22T03:58:16.173633+0000","last_fullsized":"2024-09-22T03:58:16.173633+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1768,"log_dups_size":0,"ondisk_log_size":1768,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32112640,"num_objects":490,"num_object_clones":0,"num_object_copies":1470,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1768,"num_write_kb":72256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":160,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-22T03:58:19.763070+0000","last_change":"2024-09-22T03:49:17.029349+0000","last_active":"2024-09-22T03:58:19.763070+0000","last_peered":"2024-09-22T03:58:19.763070+0000","last_clean":"2024-09-22T03:58:19.763070+0000","last_became_active":"2024-09-22T03:49:15.094890+0000","last_became_peered":"2024-09-22T03:49:15.094890+0000","last_unstale":"2024-09-22T03:58:19.763070+0000","last_undegraded":"2024-09-22T03:58:19.763070+0000","last_fullsized":"2024-09-22T03:58:19.763070+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"64'1818","reported_seq":1866,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-22T03:58:20.080999+0000","last_change":"2024-09-22T03:55:50.939050+0000","last_active":"2024-09-22T03:58:20.080999+0000","last_peered":"2024-09-22T03:58:20.080999+0000","last_clean":"2024-09-22T03:58:20.080999+0000","last_became_active":"2024-09-22T03:55:50.929831+0000","last_became_peered":"2024-09-22T03:55:50.929831+0000","last_unstale":"2024-09-22T03:58:20.080999+0000","last_undegraded":"2024-09-22T03:58:20.080999+0000","last_fullsized":"2024-09-22T03:58:20.080999+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1818,"log_dups_size":0,"ondisk_log_size":1818,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32374784,"num_objects":494,"num_object_clones":0,"num_object_copies":1482,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1818,"num_write_kb":73984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":162,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-22T03:58:19.795492+0000","last_change":"2024-09-22T03:49:17.031466+0000","last_active":"2024-09-22T03:58:19.795492+0000","last_peered":"2024-09-22T03:58:19.795492+0000","last_clean":"2024-09-22T03:58:19.795492+0000","last_became_active":"2024-09-22T03:49:15.098420+0000","last_became_peered":"2024-09-22T03:49:15.098420+0000","last_unstale":"2024-09-22T03:58:19.795492+0000","last_undegraded":"2024-09-22T03:58:19.795492+0000","last_fullsized":"2024-09-22T03:58:19.795492+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3","version":"64'1764","reported_seq":1812,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-22T03:58:19.796404+0000","last_change":"2024-09-22T03:55:50.862956+0000","last_active":"2024-09-22T03:58:19.796404+0000","last_peered":"2024-09-22T03:58:19.796404+0000","last_clean":"2024-09-22T03:58:19.796404+0000","last_became_active":"2024-09-22T03:55:50.854828+0000","last_became_peered":"2024-09-22T03:55:50.854828+0000","last_unstale":"2024-09-22T03:58:19.796404+0000","last_undegraded":"2024-09-22T03:58:19.796404+0000","last_fullsized":"2024-09-22T03:58:19.796404+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1764,"log_dups_size":0,"ondisk_log_size":1764,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31064064,"num_objects":474,"num_object_clones":0,"num_object_copies":1422,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1764,"num_write_kb":71616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":148,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-22T03:58:02.796475+0000","last_change":"2024-09-22T03:49:17.036954+0000","last_active":"2024-09-22T03:58:02.796475+0000","last_peered":"2024-09-22T03:58:02.796475+0000","last_clean":"2024-09-22T03:58:02.796475+0000","last_became_active":"2024-09-22T03:49:15.110506+0000","last_became_peered":"2024-09-22T03:49:15.110506+0000","last_unstale":"2024-09-22T03:58:02.796475+0000","last_undegraded":"2024-09-22T03:58:02.796475+0000","last_fullsized":"2024-09-22T03:58:02.796475+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"64'1797","reported_seq":1845,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-22T03:58:20.005484+0000","last_change":"2024-09-22T03:55:50.927264+0000","last_active":"2024-09-22T03:58:20.005484+0000","last_peered":"2024-09-22T03:58:20.005484+0000","last_clean":"2024-09-22T03:58:20.005484+0000","last_became_active":"2024-09-22T03:55:50.919600+0000","last_became_peered":"2024-09-22T03:55:50.919600+0000","last_unstale":"2024-09-22T03:58:20.005484+0000","last_undegraded":"2024-09-22T03:58:20.005484+0000","last_fullsized":"2024-09-22T03:58:20.005484+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1797,"log_dups_size":0,"ondisk_log_size":1797,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30736384,"num_objects":469,"num_object_clones":0,"num_object_copies":1407,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1797,"num_write_kb":72512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":148,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-22T03:58:02.786442+0000","last_change":"2024-09-22T03:49:17.032989+0000","last_active":"2024-09-22T03:58:02.786442+0000","last_peered":"2024-09-22T03:58:02.786442+0000","last_clean":"2024-09-22T03:58:02.786442+0000","last_became_active":"2024-09-22T03:49:15.079260+0000","last_became_peered":"2024-09-22T03:49:15.079260+0000","last_unstale":"2024-09-22T03:58:02.786442+0000","last_undegraded":"2024-09-22T03:58:02.786442+0000","last_fullsized":"2024-09-22T03:58:02.786442+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"60'1789","reported_seq":1825,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-22T03:58:15.937686+0000","last_change":"2024-09-22T03:55:50.862926+0000","last_active":"2024-09-22T03:58:15.937686+0000","last_peered":"2024-09-22T03:58:15.937686+0000","last_clean":"2024-09-22T03:58:15.937686+0000","last_became_active":"2024-09-22T03:55:50.851824+0000","last_became_peered":"2024-09-22T03:55:50.851824+0000","last_unstale":"2024-09-22T03:58:15.937686+0000","last_undegraded":"2024-09-22T03:58:15.937686+0000","last_fullsized":"2024-09-22T03:58:15.937686+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1789,"log_dups_size":0,"ondisk_log_size":1789,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35061760,"num_objects":535,"num_object_clones":0,"num_object_copies":1605,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1789,"num_write_kb":74368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":148,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-22T03:58:02.796671+0000","last_change":"2024-09-22T03:49:17.036402+0000","last_active":"2024-09-22T03:58:02.796671+0000","last_peered":"2024-09-22T03:58:02.796671+0000","last_clean":"2024-09-22T03:58:02.796671+0000","last_became_active":"2024-09-22T03:49:15.108430+0000","last_became_peered":"2024-09-22T03:49:15.108430+0000","last_unstale":"2024-09-22T03:58:02.796671+0000","last_undegraded":"2024-09-22T03:58:02.796671+0000","last_fullsized":"2024-09-22T03:58:02.796671+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"64'1790","reported_seq":1838,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-22T03:58:20.040819+0000","last_change":"2024-09-22T03:55:50.878789+0000","last_active":"2024-09-22T03:58:20.040819+0000","last_peered":"2024-09-22T03:58:20.040819+0000","last_clean":"2024-09-22T03:58:20.040819+0000","last_became_active":"2024-09-22T03:55:50.852561+0000","last_became_peered":"2024-09-22T03:55:50.852561+0000","last_unstale":"2024-09-22T03:58:20.040819+0000","last_undegraded":"2024-09-22T03:58:20.040819+0000","last_fullsized":"2024-09-22T03:58:20.040819+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1790,"log_dups_size":0,"ondisk_log_size":1790,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31719424,"num_objects":484,"num_object_clones":0,"num_object_copies":1452,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1790,"num_write_kb":72768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":160,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-22T03:58:19.789165+0000","last_change":"2024-09-22T03:49:17.029128+0000","last_active":"2024-09-22T03:58:19.789165+0000","last_peered":"2024-09-22T03:58:19.789165+0000","last_clean":"2024-09-22T03:58:19.789165+0000","last_became_active":"2024-09-22T03:49:15.113396+0000","last_became_peered":"2024-09-22T03:49:15.113396+0000","last_unstale":"2024-09-22T03:58:19.789165+0000","last_undegraded":"2024-09-22T03:58:19.789165+0000","last_fullsized":"2024-09-22T03:58:19.789165+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":510394392,"num_objects":7789,"num_object_clones":0,"num_object_copies":23367,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":28995,"num_write_kb":1177025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":95383552,"data_stored":1525940296,"data_compressed":72459805,"data_compressed_allocated":95371264,"data_compressed_original":1525940224,"omap_allocated":0,"internal_metadata":0},"log_size":28995,"ondisk_log_size":28995,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949673503,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":115272,"kb_used_data":21816,"kb_used_omap":0,"kb_used_meta":93440,"kb_avail":94256568,"statfs":{"total":96636764160,"available":96518725632,"internally_reserved":0,"allocated":22339584,"data_stored":349097928,"data_compressed":16570335,"data_compressed_allocated":21811200,"data_compressed_original":348897280,"omap_allocated":0,"internal_metadata":95682560},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654706213,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":116920,"kb_used_data":23460,"kb_used_omap":0,"kb_used_meta":93440,"kb_avail":94254920,"statfs":{"total":96636764160,"available":96517038080,"internally_reserved":0,"allocated":24023040,"data_stored":375849188,"data_compressed":17837983,"data_compressed_allocated":23478272,"data_compressed_original":375652352,"omap_allocated":0,"internal_metadata":95682560},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706212,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":117212,"kb_used_data":23756,"kb_used_omap":0,"kb_used_meta":93440,"kb_avail":94254628,"statfs":{"total":96636764160,"available":96516739072,"internally_reserved":0,"allocated":24326144,"data_stored":380433979,"data_compressed":18057871,"data_compressed_allocated":23769088,"data_compressed_original":380223488,"omap_allocated":0,"internal_metadata":95682560},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706212,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":112932,"kb_used_data":27796,"kb_used_omap":0,"kb_used_meta":85120,"kb_avail":94258908,"statfs":{"total":96636764160,"available":96521121792,"internally_reserved":0,"allocated":28463104,"data_stored":446690856,"data_compressed":21204104,"data_compressed_allocated":27910144,"data_compressed_original":446480384,"omap_allocated":0,"internal_metadata":87162880},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":27246592,"data_stored":435879960,"data_compressed":20697912,"data_compressed_allocated":27242496,"data_compressed_original":435879936,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":21348352,"data_stored":341573632,"data_compressed":16219743,"data_compressed_allocated":21348352,"data_compressed_original":341573632,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":23347200,"data_stored":373489688,"data_compressed":17735287,"data_compressed_allocated":23343104,"data_compressed_original":373489664,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":23441408,"data_stored":374997016,"data_compressed":17806863,"data_compressed_allocated":23437312,"data_compressed_original":374996992,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:58:23.178 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:58:23.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:58:23.351+0000 7fe034511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:58:23.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:58:23.361+0000 7fe034511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:58:25.723 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:58:25.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:58:25.882+0000 7f27d4d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:58:25.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:58:25.892+0000 7f27d4d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:58:26.434 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:58:26.434 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:58:26.434 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:58:26.434 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:58:26.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:58:26.602+0000 7fb8f0791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:58:26.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:58:26.618+0000 7fb8f0791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:58:26.681 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:58:26.681 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:58:26.681 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:58:26.681 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:58:26.681 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:58:26.681 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:58:26.681 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:58:26.681 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:58:26.681 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:58:26.681 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:58:26.682 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:58:26.682 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:58:26.686 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:58:26.686 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:58:26.686 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:58:26.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:58:26.834+0000 7f89828bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:58:26.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:58:26.853+0000 7f89828bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:58:27.060 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:58:27.060 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:58:27.060 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:58:27.060 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:58:27.060 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:58:27.060 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:58:27.060 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:58:27.061 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:58:27.061 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:58:27.061 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:58:27.061 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:58:27.061 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:58:27.063 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:58:27.064 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:58:27.064 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:58:27.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:58:27.218+0000 7f6cedc6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:58:27.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:58:27.233+0000 7f6cedc6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:58:27.309 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:58:27.309 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:58:27.309 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:58:27.309 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:58:27.309 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:58:27.309 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:58:27.309 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:58:27.309 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:58:27.309 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:58:27.309 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:58:27.309 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:58:27.310 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:58:27.313 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:58:27.313 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:58:27.314 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:58:27.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:58:27.486+0000 7f23cc911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:58:27.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:58:27.503+0000 7f23cc911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:58:27.561 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:58:27.562 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:58:27.562 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:58:27.562 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:58:27.562 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:58:27.562 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:58:27.562 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:58:27.562 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:58:27.562 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:58:27.562 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:58:27.562 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:58:27.562 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:58:27.566 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:58:27.566 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:58:28.305 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:58:28.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:58:28.463+0000 7f22ff6d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:58:28.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:58:28.472+0000 7f22ff6d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:58:31.000 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:58:31.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:58:31.185+0000 7f30d8191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:58:31.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:58:31.195+0000 7f30d8191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:58:32.567 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:58:32.568 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:58:32.568 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:58:32.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:58:32.720+0000 7f3c15297640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:58:32.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:58:32.737+0000 7f3c0ffff640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:58:33.135 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:58:33.136 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-22T03:58:33.150 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":339,"stamp":"2024-09-22T03:58:33.082084+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":384041547,"num_objects":5856,"num_object_clones":0,"num_object_copies":17568,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":31013,"num_write_kb":1178133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30987,"ondisk_log_size":30987,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":428488,"kb_used_data":74048,"kb_used_omap":0,"kb_used_meta":354368,"kb_avail":377058872,"statfs":{"total":386547056640,"available":386108284928,"internally_reserved":0,"allocated":75825152,"data_stored":1178077637,"data_compressed":55910112,"data_compressed_allocated":73592832,"data_compressed_original":1177239552,"omap_allocated":0,"internal_metadata":362872832},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-126943232,"num_objects":-1937,"num_object_clones":0,"num_object_copies":-5811,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1937,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002538"},"pg_stats":[{"pgid":"5.f","version":"64'1970","reported_seq":2018,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-22T03:58:30.955430+0000","last_change":"2024-09-22T03:55:50.938932+0000","last_active":"2024-09-22T03:58:30.955430+0000","last_peered":"2024-09-22T03:58:30.955430+0000","last_clean":"2024-09-22T03:58:30.955430+0000","last_became_active":"2024-09-22T03:55:50.929290+0000","last_became_peered":"2024-09-22T03:55:50.929290+0000","last_unstale":"2024-09-22T03:58:30.955430+0000","last_undegraded":"2024-09-22T03:58:30.955430+0000","last_fullsized":"2024-09-22T03:58:30.955430+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1970,"log_dups_size":0,"ondisk_log_size":1970,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22937600,"num_objects":350,"num_object_clones":0,"num_object_copies":1050,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1970,"num_write_kb":74240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"64'1915","reported_seq":1963,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-22T03:58:29.859325+0000","last_change":"2024-09-22T03:55:50.848180+0000","last_active":"2024-09-22T03:58:29.859325+0000","last_peered":"2024-09-22T03:58:29.859325+0000","last_clean":"2024-09-22T03:58:29.859325+0000","last_became_active":"2024-09-22T03:55:50.838302+0000","last_became_peered":"2024-09-22T03:55:50.838302+0000","last_unstale":"2024-09-22T03:58:29.859325+0000","last_undegraded":"2024-09-22T03:58:29.859325+0000","last_fullsized":"2024-09-22T03:58:29.859325+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1915,"log_dups_size":0,"ondisk_log_size":1915,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24051712,"num_objects":367,"num_object_clones":0,"num_object_copies":1101,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1915,"num_write_kb":73024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"64'2002","reported_seq":2051,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-22T03:58:29.858789+0000","last_change":"2024-09-22T03:55:50.872362+0000","last_active":"2024-09-22T03:58:29.858789+0000","last_peered":"2024-09-22T03:58:29.858789+0000","last_clean":"2024-09-22T03:58:29.858789+0000","last_became_active":"2024-09-22T03:55:50.867322+0000","last_became_peered":"2024-09-22T03:55:50.867322+0000","last_unstale":"2024-09-22T03:58:29.858789+0000","last_undegraded":"2024-09-22T03:58:29.858789+0000","last_fullsized":"2024-09-22T03:58:29.858789+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":2002,"log_dups_size":0,"ondisk_log_size":2002,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24707096,"num_objects":378,"num_object_clones":0,"num_object_copies":1134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2002,"num_write_kb":76097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"64'1973","reported_seq":2021,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-22T03:58:31.017044+0000","last_change":"2024-09-22T03:55:50.942624+0000","last_active":"2024-09-22T03:58:31.017044+0000","last_peered":"2024-09-22T03:58:31.017044+0000","last_clean":"2024-09-22T03:58:31.017044+0000","last_became_active":"2024-09-22T03:55:50.922812+0000","last_became_peered":"2024-09-22T03:55:50.922812+0000","last_unstale":"2024-09-22T03:58:31.017044+0000","last_undegraded":"2024-09-22T03:58:31.017044+0000","last_fullsized":"2024-09-22T03:58:31.017044+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1973,"log_dups_size":0,"ondisk_log_size":1973,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24707072,"num_objects":377,"num_object_clones":0,"num_object_copies":1131,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1973,"num_write_kb":75200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"64'1885","reported_seq":1933,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-22T03:58:30.039313+0000","last_change":"2024-09-22T03:55:50.890353+0000","last_active":"2024-09-22T03:58:30.039313+0000","last_peered":"2024-09-22T03:58:30.039313+0000","last_clean":"2024-09-22T03:58:30.039313+0000","last_became_active":"2024-09-22T03:55:50.882633+0000","last_became_peered":"2024-09-22T03:55:50.882633+0000","last_unstale":"2024-09-22T03:58:30.039313+0000","last_undegraded":"2024-09-22T03:58:30.039313+0000","last_fullsized":"2024-09-22T03:58:30.039313+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1885,"log_dups_size":0,"ondisk_log_size":1885,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21954560,"num_objects":335,"num_object_clones":0,"num_object_copies":1005,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1885,"num_write_kb":71040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.a","version":"64'1938","reported_seq":1986,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-22T03:58:29.882494+0000","last_change":"2024-09-22T03:55:50.891052+0000","last_active":"2024-09-22T03:58:29.882494+0000","last_peered":"2024-09-22T03:58:29.882494+0000","last_clean":"2024-09-22T03:58:29.882494+0000","last_became_active":"2024-09-22T03:55:50.880295+0000","last_became_peered":"2024-09-22T03:55:50.880295+0000","last_unstale":"2024-09-22T03:58:29.882494+0000","last_undegraded":"2024-09-22T03:58:29.882494+0000","last_fullsized":"2024-09-22T03:58:29.882494+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1938,"log_dups_size":0,"ondisk_log_size":1938,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24117248,"num_objects":368,"num_object_clones":0,"num_object_copies":1104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1938,"num_write_kb":73792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"64'1948","reported_seq":1996,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-22T03:58:29.988822+0000","last_change":"2024-09-22T03:55:50.906894+0000","last_active":"2024-09-22T03:58:29.988822+0000","last_peered":"2024-09-22T03:58:29.988822+0000","last_clean":"2024-09-22T03:58:29.988822+0000","last_became_active":"2024-09-22T03:55:50.896899+0000","last_became_peered":"2024-09-22T03:55:50.896899+0000","last_unstale":"2024-09-22T03:58:29.988822+0000","last_undegraded":"2024-09-22T03:58:29.988822+0000","last_fullsized":"2024-09-22T03:58:29.988822+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1948,"log_dups_size":0,"ondisk_log_size":1948,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23986176,"num_objects":366,"num_object_clones":0,"num_object_copies":1098,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1948,"num_write_kb":74048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"64'1899","reported_seq":1947,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-22T03:58:29.908758+0000","last_change":"2024-09-22T03:55:50.859578+0000","last_active":"2024-09-22T03:58:29.908758+0000","last_peered":"2024-09-22T03:58:29.908758+0000","last_clean":"2024-09-22T03:58:29.908758+0000","last_became_active":"2024-09-22T03:55:50.843710+0000","last_became_peered":"2024-09-22T03:55:50.843710+0000","last_unstale":"2024-09-22T03:58:29.908758+0000","last_undegraded":"2024-09-22T03:58:29.908758+0000","last_fullsized":"2024-09-22T03:58:29.908758+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1899,"log_dups_size":0,"ondisk_log_size":1899,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24444928,"num_objects":373,"num_object_clones":0,"num_object_copies":1119,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1899,"num_write_kb":72704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"64'1993","reported_seq":2041,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-22T03:58:30.121657+0000","last_change":"2024-09-22T03:55:50.968411+0000","last_active":"2024-09-22T03:58:30.121657+0000","last_peered":"2024-09-22T03:58:30.121657+0000","last_clean":"2024-09-22T03:58:30.121657+0000","last_became_active":"2024-09-22T03:55:50.961718+0000","last_became_peered":"2024-09-22T03:55:50.961718+0000","last_unstale":"2024-09-22T03:58:30.121657+0000","last_undegraded":"2024-09-22T03:58:30.121657+0000","last_fullsized":"2024-09-22T03:58:30.121657+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1993,"log_dups_size":0,"ondisk_log_size":1993,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24051712,"num_objects":367,"num_object_clones":0,"num_object_copies":1101,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1993,"num_write_kb":75520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":235,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-22T03:58:19.798795+0000","last_change":"2024-09-22T03:49:12.034704+0000","last_active":"2024-09-22T03:58:19.798795+0000","last_peered":"2024-09-22T03:58:19.798795+0000","last_clean":"2024-09-22T03:58:19.798795+0000","last_became_active":"2024-09-22T03:49:12.027470+0000","last_became_peered":"2024-09-22T03:49:12.027470+0000","last_unstale":"2024-09-22T03:58:19.798795+0000","last_undegraded":"2024-09-22T03:58:19.798795+0000","last_fullsized":"2024-09-22T03:58:19.798795+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_clean_scrub_stamp":"2024-09-22T03:49:10.979949+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":161,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-22T03:58:19.814052+0000","last_change":"2024-09-22T03:49:17.031458+0000","last_active":"2024-09-22T03:58:19.814052+0000","last_peered":"2024-09-22T03:58:19.814052+0000","last_clean":"2024-09-22T03:58:19.814052+0000","last_became_active":"2024-09-22T03:49:15.125490+0000","last_became_peered":"2024-09-22T03:49:15.125490+0000","last_unstale":"2024-09-22T03:58:19.814052+0000","last_undegraded":"2024-09-22T03:58:19.814052+0000","last_fullsized":"2024-09-22T03:58:19.814052+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.7","version":"64'1957","reported_seq":2005,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-22T03:58:29.828695+0000","last_change":"2024-09-22T03:55:50.910597+0000","last_active":"2024-09-22T03:58:29.828695+0000","last_peered":"2024-09-22T03:58:29.828695+0000","last_clean":"2024-09-22T03:58:29.828695+0000","last_became_active":"2024-09-22T03:55:50.901290+0000","last_became_peered":"2024-09-22T03:55:50.901290+0000","last_unstale":"2024-09-22T03:58:29.828695+0000","last_undegraded":"2024-09-22T03:58:29.828695+0000","last_fullsized":"2024-09-22T03:58:29.828695+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1957,"log_dups_size":0,"ondisk_log_size":1957,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23003136,"num_objects":351,"num_object_clones":0,"num_object_copies":1053,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1957,"num_write_kb":73856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":160,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-22T03:58:19.790211+0000","last_change":"2024-09-22T03:49:17.029339+0000","last_active":"2024-09-22T03:58:19.790211+0000","last_peered":"2024-09-22T03:58:19.790211+0000","last_clean":"2024-09-22T03:58:19.790211+0000","last_became_active":"2024-09-22T03:49:15.097304+0000","last_became_peered":"2024-09-22T03:49:15.097304+0000","last_unstale":"2024-09-22T03:58:19.790211+0000","last_undegraded":"2024-09-22T03:58:19.790211+0000","last_fullsized":"2024-09-22T03:58:19.790211+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"64'1909","reported_seq":1957,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-22T03:58:31.168559+0000","last_change":"2024-09-22T03:55:50.918358+0000","last_active":"2024-09-22T03:58:31.168559+0000","last_peered":"2024-09-22T03:58:31.168559+0000","last_clean":"2024-09-22T03:58:31.168559+0000","last_became_active":"2024-09-22T03:55:50.889906+0000","last_became_peered":"2024-09-22T03:55:50.889906+0000","last_unstale":"2024-09-22T03:58:31.168559+0000","last_undegraded":"2024-09-22T03:58:31.168559+0000","last_fullsized":"2024-09-22T03:58:31.168559+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1909,"log_dups_size":0,"ondisk_log_size":1909,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22872064,"num_objects":349,"num_object_clones":0,"num_object_copies":1047,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1909,"num_write_kb":72256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":160,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-22T03:58:19.763070+0000","last_change":"2024-09-22T03:49:17.029349+0000","last_active":"2024-09-22T03:58:19.763070+0000","last_peered":"2024-09-22T03:58:19.763070+0000","last_clean":"2024-09-22T03:58:19.763070+0000","last_became_active":"2024-09-22T03:49:15.094890+0000","last_became_peered":"2024-09-22T03:49:15.094890+0000","last_unstale":"2024-09-22T03:58:19.763070+0000","last_undegraded":"2024-09-22T03:58:19.763070+0000","last_fullsized":"2024-09-22T03:58:19.763070+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"64'1936","reported_seq":1984,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-22T03:58:30.058403+0000","last_change":"2024-09-22T03:55:50.939050+0000","last_active":"2024-09-22T03:58:30.058403+0000","last_peered":"2024-09-22T03:58:30.058403+0000","last_clean":"2024-09-22T03:58:30.058403+0000","last_became_active":"2024-09-22T03:55:50.929831+0000","last_became_peered":"2024-09-22T03:55:50.929831+0000","last_unstale":"2024-09-22T03:58:30.058403+0000","last_undegraded":"2024-09-22T03:58:30.058403+0000","last_fullsized":"2024-09-22T03:58:30.058403+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1936,"log_dups_size":0,"ondisk_log_size":1936,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24641536,"num_objects":376,"num_object_clones":0,"num_object_copies":1128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1936,"num_write_kb":73984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":162,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-22T03:58:19.795492+0000","last_change":"2024-09-22T03:49:17.031466+0000","last_active":"2024-09-22T03:58:19.795492+0000","last_peered":"2024-09-22T03:58:19.795492+0000","last_clean":"2024-09-22T03:58:19.795492+0000","last_became_active":"2024-09-22T03:49:15.098420+0000","last_became_peered":"2024-09-22T03:49:15.098420+0000","last_unstale":"2024-09-22T03:58:19.795492+0000","last_undegraded":"2024-09-22T03:58:19.795492+0000","last_fullsized":"2024-09-22T03:58:19.795492+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3","version":"64'1867","reported_seq":1915,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-22T03:58:29.825245+0000","last_change":"2024-09-22T03:55:50.862956+0000","last_active":"2024-09-22T03:58:29.825245+0000","last_peered":"2024-09-22T03:58:29.825245+0000","last_clean":"2024-09-22T03:58:29.825245+0000","last_became_active":"2024-09-22T03:55:50.854828+0000","last_became_peered":"2024-09-22T03:55:50.854828+0000","last_unstale":"2024-09-22T03:58:29.825245+0000","last_undegraded":"2024-09-22T03:58:29.825245+0000","last_fullsized":"2024-09-22T03:58:29.825245+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1867,"log_dups_size":0,"ondisk_log_size":1867,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24313856,"num_objects":371,"num_object_clones":0,"num_object_copies":1113,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1867,"num_write_kb":71616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":160,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-22T03:58:19.803205+0000","last_change":"2024-09-22T03:49:17.036954+0000","last_active":"2024-09-22T03:58:19.803205+0000","last_peered":"2024-09-22T03:58:19.803205+0000","last_clean":"2024-09-22T03:58:19.803205+0000","last_became_active":"2024-09-22T03:49:15.110506+0000","last_became_peered":"2024-09-22T03:49:15.110506+0000","last_unstale":"2024-09-22T03:58:19.803205+0000","last_undegraded":"2024-09-22T03:58:19.803205+0000","last_fullsized":"2024-09-22T03:58:19.803205+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"64'1888","reported_seq":1936,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-22T03:58:30.028172+0000","last_change":"2024-09-22T03:55:50.927264+0000","last_active":"2024-09-22T03:58:30.028172+0000","last_peered":"2024-09-22T03:58:30.028172+0000","last_clean":"2024-09-22T03:58:30.028172+0000","last_became_active":"2024-09-22T03:55:50.919600+0000","last_became_peered":"2024-09-22T03:55:50.919600+0000","last_unstale":"2024-09-22T03:58:30.028172+0000","last_undegraded":"2024-09-22T03:58:30.028172+0000","last_fullsized":"2024-09-22T03:58:30.028172+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1888,"log_dups_size":0,"ondisk_log_size":1888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24772608,"num_objects":378,"num_object_clones":0,"num_object_copies":1134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1888,"num_write_kb":72512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":160,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-22T03:58:19.790480+0000","last_change":"2024-09-22T03:49:17.032989+0000","last_active":"2024-09-22T03:58:19.790480+0000","last_peered":"2024-09-22T03:58:19.790480+0000","last_clean":"2024-09-22T03:58:19.790480+0000","last_became_active":"2024-09-22T03:49:15.079260+0000","last_became_peered":"2024-09-22T03:49:15.079260+0000","last_unstale":"2024-09-22T03:58:19.790480+0000","last_undegraded":"2024-09-22T03:58:19.790480+0000","last_fullsized":"2024-09-22T03:58:19.790480+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"64'1949","reported_seq":1997,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-22T03:58:31.163613+0000","last_change":"2024-09-22T03:55:50.862926+0000","last_active":"2024-09-22T03:58:31.163613+0000","last_peered":"2024-09-22T03:58:31.163613+0000","last_clean":"2024-09-22T03:58:31.163613+0000","last_became_active":"2024-09-22T03:55:50.851824+0000","last_became_peered":"2024-09-22T03:55:50.851824+0000","last_unstale":"2024-09-22T03:58:31.163613+0000","last_undegraded":"2024-09-22T03:58:31.163613+0000","last_fullsized":"2024-09-22T03:58:31.163613+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1949,"log_dups_size":0,"ondisk_log_size":1949,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24576000,"num_objects":375,"num_object_clones":0,"num_object_copies":1125,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1949,"num_write_kb":74368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":160,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-22T03:58:19.801282+0000","last_change":"2024-09-22T03:49:17.036402+0000","last_active":"2024-09-22T03:58:19.801282+0000","last_peered":"2024-09-22T03:58:19.801282+0000","last_clean":"2024-09-22T03:58:19.801282+0000","last_became_active":"2024-09-22T03:49:15.108430+0000","last_became_peered":"2024-09-22T03:49:15.108430+0000","last_unstale":"2024-09-22T03:58:19.801282+0000","last_undegraded":"2024-09-22T03:58:19.801282+0000","last_fullsized":"2024-09-22T03:58:19.801282+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"64'1903","reported_seq":1951,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-22T03:58:29.963444+0000","last_change":"2024-09-22T03:55:50.878789+0000","last_active":"2024-09-22T03:58:29.963444+0000","last_peered":"2024-09-22T03:58:29.963444+0000","last_clean":"2024-09-22T03:58:29.963444+0000","last_became_active":"2024-09-22T03:55:50.852561+0000","last_became_peered":"2024-09-22T03:55:50.852561+0000","last_unstale":"2024-09-22T03:58:29.963444+0000","last_undegraded":"2024-09-22T03:58:29.963444+0000","last_fullsized":"2024-09-22T03:58:29.963444+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:55:49.719929+0000","last_clean_scrub_stamp":"2024-09-22T03:55:49.719929+0000","objects_scrubbed":0,"log_size":1903,"log_dups_size":0,"ondisk_log_size":1903,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24313856,"num_objects":371,"num_object_clones":0,"num_object_copies":1113,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1903,"num_write_kb":72768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":160,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-22T03:58:19.789165+0000","last_change":"2024-09-22T03:49:17.029128+0000","last_active":"2024-09-22T03:58:19.789165+0000","last_peered":"2024-09-22T03:58:19.789165+0000","last_clean":"2024-09-22T03:58:19.789165+0000","last_became_active":"2024-09-22T03:49:15.113396+0000","last_became_peered":"2024-09-22T03:49:15.113396+0000","last_unstale":"2024-09-22T03:58:19.789165+0000","last_undegraded":"2024-09-22T03:58:19.789165+0000","last_fullsized":"2024-09-22T03:58:19.789165+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":383451160,"num_objects":5852,"num_object_clones":0,"num_object_copies":17556,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":30932,"num_write_kb":1177025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":72015872,"data_stored":1152057416,"data_compressed":54705848,"data_compressed_allocated":72003584,"data_compressed_original":1152057344,"omap_allocated":0,"internal_metadata":0},"log_size":30932,"ondisk_log_size":30932,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949673518,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":96396,"kb_used_data":15420,"kb_used_omap":0,"kb_used_meta":80960,"kb_avail":94275444,"statfs":{"total":96636764160,"available":96538054656,"internally_reserved":0,"allocated":15790080,"data_stored":243794668,"data_compressed":11569352,"data_compressed_allocated":15228928,"data_compressed_original":243580928,"omap_allocated":0,"internal_metadata":82903040},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654706223,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":117244,"kb_used_data":18216,"kb_used_omap":0,"kb_used_meta":99008,"kb_avail":94254596,"statfs":{"total":96636764160,"available":96516706304,"internally_reserved":0,"allocated":18653184,"data_stored":289931492,"data_compressed":13758152,"data_compressed_allocated":18108416,"data_compressed_original":289734656,"omap_allocated":0,"internal_metadata":101384192},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706222,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":99596,"kb_used_data":18616,"kb_used_omap":0,"kb_used_meta":80960,"kb_avail":94272244,"statfs":{"total":96636764160,"available":96534777856,"internally_reserved":0,"allocated":19062784,"data_stored":296092420,"data_compressed":14052728,"data_compressed_allocated":18497536,"data_compressed_original":295878656,"omap_allocated":0,"internal_metadata":82903040},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706222,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":115252,"kb_used_data":21796,"kb_used_omap":0,"kb_used_meta":93440,"kb_avail":94256588,"statfs":{"total":96636764160,"available":96518746112,"internally_reserved":0,"allocated":22319104,"data_stored":348259057,"data_compressed":16529880,"data_compressed_allocated":21757952,"data_compressed_original":348045312,"omap_allocated":0,"internal_metadata":95682560},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":21114880,"data_stored":337772568,"data_compressed":16039248,"data_compressed_allocated":21110784,"data_compressed_original":337772544,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":14757888,"data_stored":236126208,"data_compressed":11212536,"data_compressed_allocated":14757888,"data_compressed_original":236126208,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":18055168,"data_stored":288817176,"data_compressed":13714584,"data_compressed_allocated":18051072,"data_compressed_original":288817152,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":18087936,"data_stored":289341464,"data_compressed":13739480,"data_compressed_allocated":18083840,"data_compressed_original":289341440,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:58:33.519 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:58:33.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:58:33.673+0000 7f7516711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:58:33.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:58:33.684+0000 7f7516711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:58:36.135 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:58:36.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:58:36.296+0000 7fa348191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:58:36.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:58:36.308+0000 7fa348191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:58:38.152 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:58:38.152 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:58:38.152 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:58:38.152 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:58:38.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:58:38.300+0000 7f03a9c46640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:58:38.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:58:38.313+0000 7f03a9c46640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:58:38.366 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:58:38.366 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:58:38.366 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:58:38.366 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:58:38.366 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:58:38.366 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:58:38.366 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:58:38.366 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:58:38.366 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:58:38.366 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:58:38.366 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:58:38.367 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:58:38.370 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:58:38.371 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:58:38.371 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:58:38.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:58:38.519+0000 7fe7cbf91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:58:38.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:58:38.534+0000 7fe7cbf91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:58:38.647 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:58:38.648 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:58:38.648 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:58:38.648 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:58:38.648 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:58:38.648 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:58:38.648 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:58:38.648 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:58:38.648 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:58:38.648 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:58:38.648 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:58:38.648 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:58:38.652 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:58:38.652 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:58:38.652 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:58:38.809 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:58:38.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:58:38.802+0000 7f3e92f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:58:38.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:58:38.822+0000 7f3e92f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:58:38.938 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:58:38.939 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:58:38.939 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:58:38.939 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:58:38.939 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:58:38.939 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:58:38.939 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:58:38.939 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:58:38.939 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:58:38.939 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:58:38.939 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:58:38.940 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:58:38.944 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:58:38.944 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:58:38.944 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:58:38.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:58:38.971+0000 7fbcca991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:58:38.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:58:38.982+0000 7fbcca991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:58:39.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:58:39.141+0000 7fd045311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:58:39.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:58:39.156+0000 7fd045311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:58:39.216 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:58:39.216 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:58:39.216 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:58:39.217 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:58:39.217 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:58:39.217 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:58:39.217 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:58:39.217 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:58:39.217 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:58:39.217 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:58:39.217 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:58:39.218 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:58:39.221 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:58:39.222 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:58:41.552 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:58:41.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:58:41.705+0000 7fe869b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:58:41.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:58:41.716+0000 7fe869b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:58:44.223 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:58:44.303 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:58:44.304 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:58:44.304 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:58:44.304 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:58:44.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:58:44.457+0000 7f41e0391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:58:44.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:58:44.473+0000 7f41e0391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:58:44.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:58:44.490+0000 7f5f5d2d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:58:44.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:58:44.502+0000 7f5f57fff640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:58:44.738 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:58:44.738 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:58:44.739 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:58:44.739 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:58:44.739 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:58:44.739 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:58:44.739 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:58:44.739 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:58:44.739 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:58:44.739 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:58:44.739 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:58:44.739 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:58:44.743 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:58:44.744 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:58:44.744 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:58:44.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:58:44.889+0000 7f2b51c6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:58:44.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:58:44.906+0000 7f2b51c6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:58:44.993 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:58:44.993 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:58:44.993 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:58:44.993 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:58:44.994 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:58:44.994 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:58:44.994 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:58:44.994 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:58:44.994 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:58:44.994 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:58:44.994 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:58:44.994 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:58:44.998 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:58:44.998 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:58:44.998 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:58:45.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:58:45.182+0000 7f1e81023640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:58:45.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:58:45.202+0000 7f1e81023640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:58:45.240 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:58:45.240 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:58:45.240 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:58:45.240 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:58:45.240 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:58:45.240 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:58:45.240 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:58:45.240 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:58:45.240 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:58:45.240 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:58:45.240 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:58:45.241 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:58:45.244 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:58:45.245 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:58:45.245 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:58:45.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:58:45.384+0000 7ff9c6488640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:58:45.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:58:45.404+0000 7ff9c6488640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:58:45.493 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:58:45.493 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:58:45.493 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:58:45.493 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:58:45.493 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:58:45.493 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:58:45.493 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:58:45.493 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:58:45.493 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:58:45.493 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:58:45.493 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:58:45.494 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:58:45.498 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:58:45.498 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:58:46.971 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:58:47.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:58:47.130+0000 7f83d52bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:58:47.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:58:47.138+0000 7f83d52bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:58:49.683 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:58:49.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:58:49.845+0000 7fc41d311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:58:49.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:58:49.852+0000 7fc41d311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:58:50.499 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:58:50.499 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:58:50.499 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:58:50.500 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:58:50.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:58:50.647+0000 7f8546b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:58:50.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:58:50.660+0000 7f8546b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:58:50.911 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:58:50.912 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:58:50.912 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:58:50.912 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:58:50.912 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:58:50.912 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:58:50.912 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:58:50.912 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:58:50.912 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:58:50.912 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:58:50.912 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:58:50.912 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:58:50.916 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:58:50.916 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:58:50.916 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:58:51.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:58:51.077+0000 7f5963991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:58:51.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:58:51.095+0000 7f5963991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:58:51.272 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:58:51.272 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:58:51.273 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:58:51.273 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:58:51.273 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:58:51.273 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:58:51.273 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:58:51.273 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:58:51.273 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:58:51.273 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:58:51.273 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:58:51.273 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:58:51.276 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:58:51.277 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:58:51.277 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:58:51.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:58:51.450+0000 7ffbaf151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:58:51.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:58:51.471+0000 7ffbaf151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:58:51.504 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:58:51.504 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:58:51.505 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:58:51.505 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:58:51.505 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:58:51.505 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:58:51.505 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:58:51.505 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:58:51.505 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:58:51.505 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:58:51.505 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:58:51.506 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:58:51.509 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:58:51.509 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:58:51.510 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:58:51.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:58:51.669+0000 7fc456991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:58:51.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:58:51.683+0000 7fc456991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:58:51.744 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:58:51.744 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:58:51.744 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:58:51.744 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:58:51.744 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:58:51.744 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:58:51.744 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:58:51.744 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:58:51.744 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:58:51.744 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:58:51.744 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:58:51.744 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:58:51.748 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:58:51.748 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:58:52.251 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:58:52.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:58:52.422+0000 7f703d991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:58:52.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:58:52.430+0000 7f703d991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:58:55.108 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:58:55.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:58:55.269+0000 7f8936d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:58:55.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:58:55.277+0000 7f8936d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:58:56.749 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:58:56.749 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:58:56.749 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:58:56.749 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:58:56.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:58:56.911+0000 7feac2111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:58:56.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:58:56.923+0000 7feac2111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:58:56.967 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:58:56.967 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:58:56.967 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:58:56.967 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:58:56.967 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:58:56.967 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:58:56.967 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:58:56.967 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:58:56.968 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:58:56.968 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:58:56.968 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:58:56.968 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:58:56.971 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:58:56.971 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:58:56.972 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:58:57.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:58:57.135+0000 7f3cd3e46640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:58:57.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:58:57.149+0000 7f3cd3e46640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:58:57.387 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:58:57.387 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:58:57.387 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:58:57.387 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:58:57.387 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:58:57.387 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:58:57.387 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:58:57.387 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:58:57.388 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:58:57.388 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:58:57.388 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:58:57.388 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:58:57.391 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:58:57.391 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:58:57.392 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:58:57.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:58:57.548+0000 7f8aa1391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:58:57.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:58:57.569+0000 7f8aa1391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:58:57.618 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:58:57.618 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:58:57.618 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:58:57.618 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:58:57.618 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:58:57.619 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:58:57.619 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:58:57.619 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:58:57.619 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:58:57.619 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:58:57.619 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:58:57.619 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:58:57.622 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:58:57.622 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:58:57.623 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:58:57.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:58:57.777+0000 7fdeddcd1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:58:57.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:58:57.795+0000 7fdeddcd1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:58:57.838 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:58:57.838 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:58:57.838 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:58:57.838 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:58:57.838 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:58:57.838 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:58:57.838 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:58:57.838 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:58:57.839 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:58:57.839 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:58:57.839 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:58:57.839 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:58:57.846 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:58:57.846 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:58:57.916 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:58:58.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:58:58.084+0000 7f289a046640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:58:58.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:58:58.095+0000 7f289a046640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:59:00.808 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:59:00.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:59:00.959+0000 7f823b751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:59:00.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:59:00.969+0000 7f823b751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:59:02.847 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:59:02.847 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:59:02.847 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:59:02.847 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:59:03.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:59:03.007+0000 7f3c3c591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:59:03.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:59:03.020+0000 7f3c3c591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:59:03.116 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:59:03.116 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:59:03.116 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:59:03.116 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:59:03.116 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:59:03.116 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:59:03.117 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:59:03.117 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:59:03.117 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:59:03.117 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:59:03.117 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:59:03.117 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:59:03.120 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:59:03.120 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:59:03.120 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:59:03.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:59:03.284+0000 7f260cb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:59:03.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:59:03.298+0000 7f260cb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:59:03.300 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:59:03.360 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:59:03.361 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:59:03.361 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:59:03.361 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:59:03.361 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:59:03.361 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:59:03.361 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:59:03.361 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:59:03.361 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:59:03.361 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:59:03.361 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:59:03.361 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:59:03.365 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:59:03.365 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:59:03.366 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:59:03.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:59:03.469+0000 7f070ff91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:59:03.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:59:03.481+0000 7f070ff91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:59:03.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:59:03.526+0000 7f617c991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:59:03.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:59:03.545+0000 7f617c991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:59:03.568 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:59:03.568 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:59:03.568 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:59:03.568 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:59:03.568 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:59:03.568 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:59:03.568 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:59:03.569 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:59:03.569 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:59:03.569 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:59:03.569 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:59:03.569 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:59:03.572 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:59:03.573 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:59:03.573 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:59:03.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:59:03.737+0000 7fa8af2d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:59:03.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:59:03.753+0000 7fa8af2d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:59:03.819 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:59:03.819 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:59:03.819 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:59:03.819 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:59:03.819 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:59:03.819 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:59:03.819 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:59:03.819 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:59:03.819 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:59:03.820 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:59:03.820 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:59:03.820 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:59:03.823 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:59:03.823 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:59:06.327 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:59:06.427 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Removed 18391 objects 2024-09-22T03:59:06.427 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Clean up completed and total clean up time :103.566 2024-09-22T03:59:06.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:59:06.468+0000 7f2217551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:59:06.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:59:06.475+0000 7f2217551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:59:07.002 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_2 2024-09-22T03:59:07.002 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_2 unique_pool_2 --yes-i-really-really-mean-it 2024-09-22T03:59:07.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:59:07.117+0000 7f82f8a88640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:59:07.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:59:07.131+0000 7f82f8a88640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:59:08.151 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'unique_pool_2' removed 2024-09-22T03:59:08.172 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2024-09-22T03:59:08.172 INFO:tasks.radosbench:Beginning radosbench... 2024-09-22T03:59:08.172 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_3 2024-09-22T03:59:08.172 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_3 16 2024-09-22T03:59:08.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:59:08.323+0000 7f90d3246640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:59:08.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:59:08.337+0000 7f90d3246640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:59:08.575 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:59:08.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:59:08.701+0000 7f7431d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:59:08.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:59:08.709+0000 7f7431d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:59:08.824 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:59:08.824 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:59:08.824 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:59:08.825 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:59:08.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:59:08.954+0000 7f5e3c046640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:59:08.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:59:08.968+0000 7f5e3c046640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:59:08.995 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:59:08.995 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:59:08.996 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:59:08.996 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:59:08.996 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:59:08.996 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:59:08.996 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:59:08.996 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:59:08.996 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:59:08.996 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:59:08.996 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:59:08.996 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:59:08.999 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:59:09.000 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:59:09.000 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:59:09.155 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'unique_pool_3' created 2024-09-22T03:59:09.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:59:09.151+0000 7f52f6151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:59:09.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:59:09.165+0000 7f52f6151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:59:09.175 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_3 rados --yes-i-really-mean-it || true 2024-09-22T03:59:09.229 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:59:09.229 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:59:09.229 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:59:09.229 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:59:09.229 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:59:09.229 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:59:09.229 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:59:09.229 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:59:09.229 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:59:09.230 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:59:09.230 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:59:09.230 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:59:09.233 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:59:09.233 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:59:09.233 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:59:09.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:59:09.323+0000 7f59f1b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:59:09.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:59:09.344+0000 7f59f1b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:59:09.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:59:09.367+0000 7f6a37e5c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:59:09.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:59:09.378+0000 7f6a37e5c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:59:09.395 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:59:09.395 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:59:09.395 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:59:09.395 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:59:09.395 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:59:09.395 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:59:09.395 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:59:09.395 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:59:09.395 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:59:09.395 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:59:09.396 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:59:09.396 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:59:09.398 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:59:09.398 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:59:09.398 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:59:09.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:59:09.506+0000 7f1b1d951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:59:09.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:59:09.516+0000 7f1b1d951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:59:09.535 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:59:09.535 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:59:09.535 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:59:09.535 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:59:09.535 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:59:09.536 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:59:09.536 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:59:09.536 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:59:09.536 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:59:09.536 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:59:09.536 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:59:09.536 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:59:09.539 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:59:09.539 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:59:10.156 INFO:teuthology.orchestra.run.smithi037.stderr:enabled application 'rados' on pool 'unique_pool_3' 2024-09-22T03:59:11.029 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:59:11.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:59:11.148+0000 7f088ad11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:59:11.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:59:11.154+0000 7f088ad11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:59:11.182 DEBUG:teuthology.orchestra.run.smithi037:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -b 65536 --object-size 65536 -p unique_pool_3 bench 90 write' 2024-09-22T03:59:11.184 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2024-09-22T03:59:11.185 INFO:teuthology.orchestra.run:waiting for 3000 2024-09-22T03:59:11.256 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:hints = 1 2024-09-22T03:59:11.257 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Maintaining 16 concurrent writes of 65536 bytes to objects of size 65536 for up to 90 seconds or 0 objects 2024-09-22T03:59:11.257 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Object prefix: benchmark_data_smithi037_54851 2024-09-22T03:59:11.257 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-22T03:59:11.257 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 0 0 0 0 0 0 - 0 2024-09-22T03:59:12.257 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 1 16 224 208 12.9988 13 0.0741343 0.0736668 2024-09-22T03:59:13.257 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 2 16 429 413 12.905 12.8125 0.0701334 0.0755963 2024-09-22T03:59:13.279 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:59:13.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:59:13.435+0000 7f1ba4ec8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:59:13.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:59:13.447+0000 7f1ba4ec8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:59:14.257 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 3 16 631 615 12.8113 12.625 0.0841578 0.0770957 2024-09-22T03:59:14.540 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:59:14.540 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:59:14.540 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:59:14.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:59:14.698+0000 7f3d9b87d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:59:14.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:59:14.714+0000 7f3d9b87d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:59:15.119 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:59:15.119 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-22T03:59:15.140 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":365,"stamp":"2024-09-22T03:59:15.090356+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":380416,"kb_used_data":2368,"kb_used_omap":0,"kb_used_meta":377984,"kb_avail":377106944,"statfs":{"total":386547056640,"available":386157510656,"internally_reserved":0,"allocated":2424832,"data_stored":2585826,"data_compressed":90168,"data_compressed_allocated":122880,"data_compressed_original":1720320,"omap_allocated":0,"internal_metadata":387055616},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.934398"},"pg_stats":[{"pgid":"6.f","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-22T03:59:11.193604+0000","last_change":"2024-09-22T03:59:10.330036+0000","last_active":"2024-09-22T03:59:11.193604+0000","last_peered":"2024-09-22T03:59:11.193604+0000","last_clean":"2024-09-22T03:59:11.193604+0000","last_became_active":"2024-09-22T03:59:10.319097+0000","last_became_peered":"2024-09-22T03:59:10.319097+0000","last_unstale":"2024-09-22T03:59:11.193604+0000","last_undegraded":"2024-09-22T03:59:11.193604+0000","last_fullsized":"2024-09-22T03:59:11.193604+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-22T03:59:09.201995+0000","last_change":"2024-09-22T03:59:09.201995+0000","last_active":"2024-09-22T03:59:09.150746+0000","last_peered":"2024-09-22T03:59:09.150746+0000","last_clean":"2024-09-22T03:59:09.150746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:59:09.201995+0000","last_undegraded":"2024-09-22T03:59:09.201995+0000","last_fullsized":"2024-09-22T03:59:09.201995+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-22T03:59:09.188908+0000","last_change":"2024-09-22T03:59:09.188908+0000","last_active":"2024-09-22T03:59:09.150746+0000","last_peered":"2024-09-22T03:59:09.150746+0000","last_clean":"2024-09-22T03:59:09.150746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:59:09.188908+0000","last_undegraded":"2024-09-22T03:59:09.188908+0000","last_fullsized":"2024-09-22T03:59:09.188908+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-22T03:59:11.193599+0000","last_change":"2024-09-22T03:59:10.365539+0000","last_active":"2024-09-22T03:59:11.193599+0000","last_peered":"2024-09-22T03:59:11.193599+0000","last_clean":"2024-09-22T03:59:11.193599+0000","last_became_active":"2024-09-22T03:59:10.339689+0000","last_became_peered":"2024-09-22T03:59:10.339689+0000","last_unstale":"2024-09-22T03:59:11.193599+0000","last_undegraded":"2024-09-22T03:59:11.193599+0000","last_fullsized":"2024-09-22T03:59:11.193599+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-22T03:59:09.234413+0000","last_change":"2024-09-22T03:59:09.234413+0000","last_active":"2024-09-22T03:59:09.150746+0000","last_peered":"2024-09-22T03:59:09.150746+0000","last_clean":"2024-09-22T03:59:09.150746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:59:09.234413+0000","last_undegraded":"2024-09-22T03:59:09.234413+0000","last_fullsized":"2024-09-22T03:59:09.234413+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":3,"reported_epoch":67,"state":"creating+activating","last_fresh":"2024-09-22T03:59:10.184436+0000","last_change":"2024-09-22T03:59:10.187669+0000","last_active":"2024-09-22T03:59:09.150746+0000","last_peered":"2024-09-22T03:59:09.150746+0000","last_clean":"2024-09-22T03:59:09.150746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:59:10.184436+0000","last_undegraded":"2024-09-22T03:59:10.184436+0000","last_fullsized":"2024-09-22T03:59:10.184436+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":["0","2","3"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":3,"reported_epoch":67,"state":"creating+activating","last_fresh":"2024-09-22T03:59:10.183124+0000","last_change":"2024-09-22T03:59:10.185045+0000","last_active":"2024-09-22T03:59:09.150746+0000","last_peered":"2024-09-22T03:59:09.150746+0000","last_clean":"2024-09-22T03:59:09.150746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:59:10.183124+0000","last_undegraded":"2024-09-22T03:59:10.183124+0000","last_fullsized":"2024-09-22T03:59:10.183124+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":["0","1","3"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-22T03:59:09.201221+0000","last_change":"2024-09-22T03:59:09.201221+0000","last_active":"2024-09-22T03:59:09.150746+0000","last_peered":"2024-09-22T03:59:09.150746+0000","last_clean":"2024-09-22T03:59:09.150746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:59:09.201221+0000","last_undegraded":"2024-09-22T03:59:09.201221+0000","last_fullsized":"2024-09-22T03:59:09.201221+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-22T03:59:09.186869+0000","last_change":"2024-09-22T03:59:09.186869+0000","last_active":"2024-09-22T03:59:09.150746+0000","last_peered":"2024-09-22T03:59:09.150746+0000","last_clean":"2024-09-22T03:59:09.150746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:59:09.186869+0000","last_undegraded":"2024-09-22T03:59:09.186869+0000","last_fullsized":"2024-09-22T03:59:09.186869+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":247,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-22T03:59:11.186222+0000","last_change":"2024-09-22T03:49:12.034704+0000","last_active":"2024-09-22T03:59:11.186222+0000","last_peered":"2024-09-22T03:59:11.186222+0000","last_clean":"2024-09-22T03:59:11.186222+0000","last_became_active":"2024-09-22T03:49:12.027470+0000","last_became_peered":"2024-09-22T03:49:12.027470+0000","last_unstale":"2024-09-22T03:59:11.186222+0000","last_undegraded":"2024-09-22T03:59:11.186222+0000","last_fullsized":"2024-09-22T03:59:11.186222+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_clean_scrub_stamp":"2024-09-22T03:49:10.979949+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":167,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-22T03:59:09.167241+0000","last_change":"2024-09-22T03:49:17.031458+0000","last_active":"2024-09-22T03:59:09.167241+0000","last_peered":"2024-09-22T03:59:09.167241+0000","last_clean":"2024-09-22T03:59:09.167241+0000","last_became_active":"2024-09-22T03:49:15.125490+0000","last_became_peered":"2024-09-22T03:49:15.125490+0000","last_unstale":"2024-09-22T03:59:09.167241+0000","last_undegraded":"2024-09-22T03:59:09.167241+0000","last_fullsized":"2024-09-22T03:59:09.167241+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-22T03:59:11.194393+0000","last_change":"2024-09-22T03:59:10.355702+0000","last_active":"2024-09-22T03:59:11.194393+0000","last_peered":"2024-09-22T03:59:11.194393+0000","last_clean":"2024-09-22T03:59:11.194393+0000","last_became_active":"2024-09-22T03:59:10.330418+0000","last_became_peered":"2024-09-22T03:59:10.330418+0000","last_unstale":"2024-09-22T03:59:11.194393+0000","last_undegraded":"2024-09-22T03:59:11.194393+0000","last_fullsized":"2024-09-22T03:59:11.194393+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":166,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-22T03:59:09.165221+0000","last_change":"2024-09-22T03:49:17.029339+0000","last_active":"2024-09-22T03:59:09.165221+0000","last_peered":"2024-09-22T03:59:09.165221+0000","last_clean":"2024-09-22T03:59:09.165221+0000","last_became_active":"2024-09-22T03:49:15.097304+0000","last_became_peered":"2024-09-22T03:49:15.097304+0000","last_unstale":"2024-09-22T03:59:09.165221+0000","last_undegraded":"2024-09-22T03:59:09.165221+0000","last_fullsized":"2024-09-22T03:59:09.165221+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":3,"reported_epoch":67,"state":"creating+activating","last_fresh":"2024-09-22T03:59:10.172969+0000","last_change":"2024-09-22T03:59:10.175141+0000","last_active":"2024-09-22T03:59:09.150746+0000","last_peered":"2024-09-22T03:59:09.150746+0000","last_clean":"2024-09-22T03:59:09.150746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:59:10.172969+0000","last_undegraded":"2024-09-22T03:59:10.172969+0000","last_fullsized":"2024-09-22T03:59:10.172969+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":["0","1","3"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":166,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-22T03:59:09.167393+0000","last_change":"2024-09-22T03:49:17.029349+0000","last_active":"2024-09-22T03:59:09.167393+0000","last_peered":"2024-09-22T03:59:09.167393+0000","last_clean":"2024-09-22T03:59:09.167393+0000","last_became_active":"2024-09-22T03:49:15.094890+0000","last_became_peered":"2024-09-22T03:49:15.094890+0000","last_unstale":"2024-09-22T03:59:09.167393+0000","last_undegraded":"2024-09-22T03:59:09.167393+0000","last_fullsized":"2024-09-22T03:59:09.167393+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-22T03:59:11.185757+0000","last_change":"2024-09-22T03:59:10.359896+0000","last_active":"2024-09-22T03:59:11.185757+0000","last_peered":"2024-09-22T03:59:11.185757+0000","last_clean":"2024-09-22T03:59:11.185757+0000","last_became_active":"2024-09-22T03:59:10.342929+0000","last_became_peered":"2024-09-22T03:59:10.342929+0000","last_unstale":"2024-09-22T03:59:11.185757+0000","last_undegraded":"2024-09-22T03:59:11.185757+0000","last_fullsized":"2024-09-22T03:59:11.185757+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":168,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-22T03:59:09.166906+0000","last_change":"2024-09-22T03:49:17.031466+0000","last_active":"2024-09-22T03:59:09.166906+0000","last_peered":"2024-09-22T03:59:09.166906+0000","last_clean":"2024-09-22T03:59:09.166906+0000","last_became_active":"2024-09-22T03:49:15.098420+0000","last_became_peered":"2024-09-22T03:49:15.098420+0000","last_unstale":"2024-09-22T03:59:09.166906+0000","last_undegraded":"2024-09-22T03:59:09.166906+0000","last_fullsized":"2024-09-22T03:59:09.166906+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":3,"reported_epoch":67,"state":"creating+activating","last_fresh":"2024-09-22T03:59:10.176634+0000","last_change":"2024-09-22T03:59:10.178630+0000","last_active":"2024-09-22T03:59:09.150746+0000","last_peered":"2024-09-22T03:59:09.150746+0000","last_clean":"2024-09-22T03:59:09.150746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:59:10.176634+0000","last_undegraded":"2024-09-22T03:59:10.176634+0000","last_fullsized":"2024-09-22T03:59:10.176634+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":["0","1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":172,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-22T03:59:11.198336+0000","last_change":"2024-09-22T03:49:17.036954+0000","last_active":"2024-09-22T03:59:11.198336+0000","last_peered":"2024-09-22T03:59:11.198336+0000","last_clean":"2024-09-22T03:59:11.198336+0000","last_became_active":"2024-09-22T03:49:15.110506+0000","last_became_peered":"2024-09-22T03:49:15.110506+0000","last_unstale":"2024-09-22T03:59:11.198336+0000","last_undegraded":"2024-09-22T03:59:11.198336+0000","last_fullsized":"2024-09-22T03:59:11.198336+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-22T03:59:11.197241+0000","last_change":"2024-09-22T03:59:10.361108+0000","last_active":"2024-09-22T03:59:11.197241+0000","last_peered":"2024-09-22T03:59:11.197241+0000","last_clean":"2024-09-22T03:59:11.197241+0000","last_became_active":"2024-09-22T03:59:10.347213+0000","last_became_peered":"2024-09-22T03:59:10.347213+0000","last_unstale":"2024-09-22T03:59:11.197241+0000","last_undegraded":"2024-09-22T03:59:11.197241+0000","last_fullsized":"2024-09-22T03:59:11.197241+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":172,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-22T03:59:11.187144+0000","last_change":"2024-09-22T03:49:17.032989+0000","last_active":"2024-09-22T03:59:11.187144+0000","last_peered":"2024-09-22T03:59:11.187144+0000","last_clean":"2024-09-22T03:59:11.187144+0000","last_became_active":"2024-09-22T03:49:15.079260+0000","last_became_peered":"2024-09-22T03:49:15.079260+0000","last_unstale":"2024-09-22T03:59:11.187144+0000","last_undegraded":"2024-09-22T03:59:11.187144+0000","last_fullsized":"2024-09-22T03:59:11.187144+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-22T03:59:09.174047+0000","last_change":"2024-09-22T03:59:09.174047+0000","last_active":"2024-09-22T03:59:09.150746+0000","last_peered":"2024-09-22T03:59:09.150746+0000","last_clean":"2024-09-22T03:59:09.150746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:59:09.174047+0000","last_undegraded":"2024-09-22T03:59:09.174047+0000","last_fullsized":"2024-09-22T03:59:09.174047+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":172,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-22T03:59:11.190872+0000","last_change":"2024-09-22T03:49:17.036402+0000","last_active":"2024-09-22T03:59:11.190872+0000","last_peered":"2024-09-22T03:59:11.190872+0000","last_clean":"2024-09-22T03:59:11.190872+0000","last_became_active":"2024-09-22T03:49:15.108430+0000","last_became_peered":"2024-09-22T03:49:15.108430+0000","last_unstale":"2024-09-22T03:59:11.190872+0000","last_undegraded":"2024-09-22T03:59:11.190872+0000","last_fullsized":"2024-09-22T03:59:11.190872+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-22T03:59:09.175020+0000","last_change":"2024-09-22T03:59:09.175020+0000","last_active":"2024-09-22T03:59:09.150746+0000","last_peered":"2024-09-22T03:59:09.150746+0000","last_clean":"2024-09-22T03:59:09.150746+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:59:09.175020+0000","last_undegraded":"2024-09-22T03:59:09.175020+0000","last_fullsized":"2024-09-22T03:59:09.175020+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":166,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-22T03:59:09.164379+0000","last_change":"2024-09-22T03:49:17.029128+0000","last_active":"2024-09-22T03:59:09.164379+0000","last_peered":"2024-09-22T03:59:09.164379+0000","last_clean":"2024-09-22T03:59:09.164379+0000","last_became_active":"2024-09-22T03:49:15.113396+0000","last_became_peered":"2024-09-22T03:49:15.113396+0000","last_unstale":"2024-09-22T03:59:09.164379+0000","last_undegraded":"2024-09-22T03:59:09.164379+0000","last_fullsized":"2024-09-22T03:59:09.164379+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949673558,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":81592,"kb_used_data":616,"kb_used_omap":0,"kb_used_meta":80960,"kb_avail":94290248,"statfs":{"total":96636764160,"available":96553213952,"internally_reserved":0,"allocated":630784,"data_stored":797682,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":82903040},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654706262,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":99564,"kb_used_data":540,"kb_used_omap":0,"kb_used_meta":99008,"kb_avail":94272276,"statfs":{"total":96636764160,"available":96534810624,"internally_reserved":0,"allocated":552960,"data_stored":200073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":101384192},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706262,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":99632,"kb_used_data":608,"kb_used_omap":0,"kb_used_meta":99008,"kb_avail":94272208,"statfs":{"total":96636764160,"available":96534740992,"internally_reserved":0,"allocated":622592,"data_stored":794045,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":101384192},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706262,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":99628,"kb_used_data":604,"kb_used_omap":0,"kb_used_meta":99008,"kb_avail":94272212,"statfs":{"total":96636764160,"available":96534745088,"internally_reserved":0,"allocated":618496,"data_stored":794026,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":101384192},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:59:15.257 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 4 16 836 820 12.8113 12.8125 0.0811039 0.0772925 2024-09-22T03:59:15.950 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:59:16.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:59:16.095+0000 7f12bc591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:59:16.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:59:16.105+0000 7f12bc591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:59:16.257 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 5 16 1023 1007 12.5863 11.6875 0.0826638 0.0787253 2024-09-22T03:59:17.258 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 6 16 1230 1214 12.6447 12.9375 0.0470965 0.078584 2024-09-22T03:59:18.258 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 7 16 1440 1424 12.7131 13.125 0.074663 0.0781804 2024-09-22T03:59:18.521 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:59:18.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:59:18.662+0000 7fd0daebd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:59:18.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:59:18.671+0000 7fd0daebd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:59:19.258 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 8 16 1628 1612 12.5926 11.75 0.0799939 0.0789919 2024-09-22T03:59:20.142 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:59:20.142 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:59:20.143 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:59:20.143 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:59:20.258 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 9 16 1833 1817 12.6169 12.8125 0.138381 0.078602 2024-09-22T03:59:20.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:59:20.312+0000 7f1a61151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:59:20.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:59:20.328+0000 7f1a61151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:59:20.375 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:59:20.375 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:59:20.375 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:59:20.375 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:59:20.375 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:59:20.375 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:59:20.375 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:59:20.375 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:59:20.375 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:59:20.375 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:59:20.375 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:59:20.376 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:59:20.381 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:59:20.381 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:59:20.382 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:59:20.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:59:20.528+0000 7fd379151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:59:20.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:59:20.545+0000 7fd379151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:59:20.666 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:59:20.666 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:59:20.666 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:59:20.666 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:59:20.666 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:59:20.666 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:59:20.667 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:59:20.667 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:59:20.667 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:59:20.667 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:59:20.667 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:59:20.667 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:59:20.670 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:59:20.671 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:59:20.671 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:59:20.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:59:20.842+0000 7fe50166c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:59:20.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:59:20.857+0000 7fe50166c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:59:20.906 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:59:20.906 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:59:20.907 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:59:20.907 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:59:20.907 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:59:20.907 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:59:20.907 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:59:20.907 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:59:20.907 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:59:20.907 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:59:20.907 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:59:20.907 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:59:20.913 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:59:20.913 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:59:20.913 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:59:21.060 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:59:21.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:59:21.075+0000 7fc2ad751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:59:21.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:59:21.095+0000 7fc2ad751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:59:21.197 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:59:21.197 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:59:21.198 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:59:21.198 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:59:21.198 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:59:21.198 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:59:21.198 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:59:21.198 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:59:21.198 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:59:21.198 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:59:21.198 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:59:21.198 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:59:21.202 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:59:21.203 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:59:21.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:59:21.218+0000 7f2abf591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:59:21.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:59:21.226+0000 7f2abf591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:59:21.258 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 10 16 2037 2021 12.6301 12.75 0.0507324 0.0788622 2024-09-22T03:59:22.258 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 11 16 2247 2231 12.675 13.125 0.101438 0.0785435 2024-09-22T03:59:23.258 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 12 16 2443 2427 12.6395 12.25 0.0512772 0.0788436 2024-09-22T03:59:23.759 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:59:23.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:59:23.932+0000 7f182b191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:59:23.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:59:23.942+0000 7f182b191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:59:24.258 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 13 16 2641 2625 12.619 12.375 0.0329789 0.0790426 2024-09-22T03:59:25.258 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 14 16 2853 2837 12.664 13.25 0.0821047 0.0787664 2024-09-22T03:59:26.204 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:59:26.204 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:59:26.204 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:59:26.258 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 15 16 3052 3036 12.6488 12.4375 0.12153 0.0787704 2024-09-22T03:59:26.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:59:26.352+0000 7f7a54391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:59:26.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:59:26.369+0000 7f7a54391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:59:26.489 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:59:26.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:59:26.654+0000 7fcfb0191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:59:26.668 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:59:26.669 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-22T03:59:26.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:59:26.666+0000 7fcfb0191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:59:26.690 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":372,"stamp":"2024-09-22T03:59:25.092372+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":124387891,"num_objects":1893,"num_object_clones":0,"num_object_copies":5679,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":1970,"num_write_kb":122004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1944,"ondisk_log_size":1944,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":421732,"kb_used_data":22880,"kb_used_omap":0,"kb_used_meta":398784,"kb_avail":377065628,"statfs":{"total":386547056640,"available":386115203072,"internally_reserved":0,"allocated":23429120,"data_stored":336612337,"data_compressed":15945590,"data_compressed_allocated":20996096,"data_compressed_original":335691776,"omap_allocated":0,"internal_metadata":408354816},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":66453504,"num_objects":1014,"num_object_clones":0,"num_object_copies":3042,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1014,"num_write_kb":64896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001632"},"pg_stats":[{"pgid":"6.f","version":"70'125","reported_seq":143,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-22T03:59:21.076713+0000","last_change":"2024-09-22T03:59:10.330036+0000","last_active":"2024-09-22T03:59:21.076713+0000","last_peered":"2024-09-22T03:59:21.076713+0000","last_clean":"2024-09-22T03:59:21.076713+0000","last_became_active":"2024-09-22T03:59:10.319097+0000","last_became_peered":"2024-09-22T03:59:10.319097+0000","last_unstale":"2024-09-22T03:59:21.076713+0000","last_undegraded":"2024-09-22T03:59:21.076713+0000","last_fullsized":"2024-09-22T03:59:21.076713+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8192000,"num_objects":125,"num_object_clones":0,"num_object_copies":375,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":8000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"70'107","reported_seq":125,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-22T03:59:19.993767+0000","last_change":"2024-09-22T03:59:10.321450+0000","last_active":"2024-09-22T03:59:19.993767+0000","last_peered":"2024-09-22T03:59:19.993767+0000","last_clean":"2024-09-22T03:59:19.993767+0000","last_became_active":"2024-09-22T03:59:10.311447+0000","last_became_peered":"2024-09-22T03:59:10.311447+0000","last_unstale":"2024-09-22T03:59:19.993767+0000","last_undegraded":"2024-09-22T03:59:19.993767+0000","last_fullsized":"2024-09-22T03:59:19.993767+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7012352,"num_objects":107,"num_object_clones":0,"num_object_copies":321,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":107,"num_write_kb":6848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"70'106","reported_seq":124,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-22T03:59:20.079161+0000","last_change":"2024-09-22T03:59:10.349259+0000","last_active":"2024-09-22T03:59:20.079161+0000","last_peered":"2024-09-22T03:59:20.079161+0000","last_clean":"2024-09-22T03:59:20.079161+0000","last_became_active":"2024-09-22T03:59:10.341464+0000","last_became_peered":"2024-09-22T03:59:10.341464+0000","last_unstale":"2024-09-22T03:59:20.079161+0000","last_undegraded":"2024-09-22T03:59:20.079161+0000","last_fullsized":"2024-09-22T03:59:20.079161+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6946816,"num_objects":106,"num_object_clones":0,"num_object_copies":318,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":106,"num_write_kb":6784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"70'127","reported_seq":145,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-22T03:59:20.889968+0000","last_change":"2024-09-22T03:59:10.365539+0000","last_active":"2024-09-22T03:59:20.889968+0000","last_peered":"2024-09-22T03:59:20.889968+0000","last_clean":"2024-09-22T03:59:20.889968+0000","last_became_active":"2024-09-22T03:59:10.339689+0000","last_became_peered":"2024-09-22T03:59:10.339689+0000","last_unstale":"2024-09-22T03:59:20.889968+0000","last_undegraded":"2024-09-22T03:59:20.889968+0000","last_fullsized":"2024-09-22T03:59:20.889968+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8323072,"num_objects":127,"num_object_clones":0,"num_object_copies":381,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127,"num_write_kb":8128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"70'95","reported_seq":113,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-22T03:59:20.073801+0000","last_change":"2024-09-22T03:59:10.331496+0000","last_active":"2024-09-22T03:59:20.073801+0000","last_peered":"2024-09-22T03:59:20.073801+0000","last_clean":"2024-09-22T03:59:20.073801+0000","last_became_active":"2024-09-22T03:59:10.322922+0000","last_became_peered":"2024-09-22T03:59:10.322922+0000","last_unstale":"2024-09-22T03:59:20.073801+0000","last_undegraded":"2024-09-22T03:59:20.073801+0000","last_fullsized":"2024-09-22T03:59:20.073801+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6225920,"num_objects":95,"num_object_clones":0,"num_object_copies":285,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":95,"num_write_kb":6080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.a","version":"70'103","reported_seq":121,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-22T03:59:19.907915+0000","last_change":"2024-09-22T03:59:10.268812+0000","last_active":"2024-09-22T03:59:19.907915+0000","last_peered":"2024-09-22T03:59:19.907915+0000","last_clean":"2024-09-22T03:59:19.907915+0000","last_became_active":"2024-09-22T03:59:10.261529+0000","last_became_peered":"2024-09-22T03:59:10.261529+0000","last_unstale":"2024-09-22T03:59:19.907915+0000","last_undegraded":"2024-09-22T03:59:19.907915+0000","last_fullsized":"2024-09-22T03:59:19.907915+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6750208,"num_objects":103,"num_object_clones":0,"num_object_copies":309,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103,"num_write_kb":6592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"70'111","reported_seq":129,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-22T03:59:20.051234+0000","last_change":"2024-09-22T03:59:10.357775+0000","last_active":"2024-09-22T03:59:20.051234+0000","last_peered":"2024-09-22T03:59:20.051234+0000","last_clean":"2024-09-22T03:59:20.051234+0000","last_became_active":"2024-09-22T03:59:10.350219+0000","last_became_peered":"2024-09-22T03:59:10.350219+0000","last_unstale":"2024-09-22T03:59:20.051234+0000","last_undegraded":"2024-09-22T03:59:20.051234+0000","last_fullsized":"2024-09-22T03:59:20.051234+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7274496,"num_objects":111,"num_object_clones":0,"num_object_copies":333,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":7104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"70'105","reported_seq":123,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-22T03:59:19.936294+0000","last_change":"2024-09-22T03:59:10.302834+0000","last_active":"2024-09-22T03:59:19.936294+0000","last_peered":"2024-09-22T03:59:19.936294+0000","last_clean":"2024-09-22T03:59:19.936294+0000","last_became_active":"2024-09-22T03:59:10.294403+0000","last_became_peered":"2024-09-22T03:59:10.294403+0000","last_unstale":"2024-09-22T03:59:19.936294+0000","last_undegraded":"2024-09-22T03:59:19.936294+0000","last_fullsized":"2024-09-22T03:59:19.936294+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6881280,"num_objects":105,"num_object_clones":0,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":105,"num_write_kb":6720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"70'129","reported_seq":147,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-22T03:59:20.002426+0000","last_change":"2024-09-22T03:59:10.311620+0000","last_active":"2024-09-22T03:59:20.002426+0000","last_peered":"2024-09-22T03:59:20.002426+0000","last_clean":"2024-09-22T03:59:20.002426+0000","last_became_active":"2024-09-22T03:59:10.304722+0000","last_became_peered":"2024-09-22T03:59:10.304722+0000","last_unstale":"2024-09-22T03:59:20.002426+0000","last_undegraded":"2024-09-22T03:59:20.002426+0000","last_fullsized":"2024-09-22T03:59:20.002426+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8454144,"num_objects":129,"num_object_clones":0,"num_object_copies":387,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":8256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":253,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-22T03:59:17.764313+0000","last_change":"2024-09-22T03:49:12.034704+0000","last_active":"2024-09-22T03:59:17.764313+0000","last_peered":"2024-09-22T03:59:17.764313+0000","last_clean":"2024-09-22T03:59:17.764313+0000","last_became_active":"2024-09-22T03:49:12.027470+0000","last_became_peered":"2024-09-22T03:49:12.027470+0000","last_unstale":"2024-09-22T03:59:17.764313+0000","last_undegraded":"2024-09-22T03:59:17.764313+0000","last_fullsized":"2024-09-22T03:59:17.764313+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_clean_scrub_stamp":"2024-09-22T03:49:10.979949+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":179,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-22T03:59:17.761029+0000","last_change":"2024-09-22T03:49:17.031458+0000","last_active":"2024-09-22T03:59:17.761029+0000","last_peered":"2024-09-22T03:59:17.761029+0000","last_clean":"2024-09-22T03:59:17.761029+0000","last_became_active":"2024-09-22T03:49:15.125490+0000","last_became_peered":"2024-09-22T03:49:15.125490+0000","last_unstale":"2024-09-22T03:59:17.761029+0000","last_undegraded":"2024-09-22T03:59:17.761029+0000","last_fullsized":"2024-09-22T03:59:17.761029+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"70'137","reported_seq":155,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-22T03:59:21.114535+0000","last_change":"2024-09-22T03:59:10.355702+0000","last_active":"2024-09-22T03:59:21.114535+0000","last_peered":"2024-09-22T03:59:21.114535+0000","last_clean":"2024-09-22T03:59:21.114535+0000","last_became_active":"2024-09-22T03:59:10.330418+0000","last_became_peered":"2024-09-22T03:59:10.330418+0000","last_unstale":"2024-09-22T03:59:21.114535+0000","last_undegraded":"2024-09-22T03:59:21.114535+0000","last_fullsized":"2024-09-22T03:59:21.114535+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8978432,"num_objects":137,"num_object_clones":0,"num_object_copies":411,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":8768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":178,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-22T03:59:17.754051+0000","last_change":"2024-09-22T03:49:17.029339+0000","last_active":"2024-09-22T03:59:17.754051+0000","last_peered":"2024-09-22T03:59:17.754051+0000","last_clean":"2024-09-22T03:59:17.754051+0000","last_became_active":"2024-09-22T03:49:15.097304+0000","last_became_peered":"2024-09-22T03:49:15.097304+0000","last_unstale":"2024-09-22T03:59:17.754051+0000","last_undegraded":"2024-09-22T03:59:17.754051+0000","last_fullsized":"2024-09-22T03:59:17.754051+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.5","version":"70'130","reported_seq":148,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-22T03:59:20.010664+0000","last_change":"2024-09-22T03:59:10.300610+0000","last_active":"2024-09-22T03:59:20.010664+0000","last_peered":"2024-09-22T03:59:20.010664+0000","last_clean":"2024-09-22T03:59:20.010664+0000","last_became_active":"2024-09-22T03:59:10.293587+0000","last_became_peered":"2024-09-22T03:59:10.293587+0000","last_unstale":"2024-09-22T03:59:20.010664+0000","last_undegraded":"2024-09-22T03:59:20.010664+0000","last_fullsized":"2024-09-22T03:59:20.010664+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8519680,"num_objects":130,"num_object_clones":0,"num_object_copies":390,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":130,"num_write_kb":8320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":178,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-22T03:59:17.747840+0000","last_change":"2024-09-22T03:49:17.029349+0000","last_active":"2024-09-22T03:59:17.747840+0000","last_peered":"2024-09-22T03:59:17.747840+0000","last_clean":"2024-09-22T03:59:17.747840+0000","last_became_active":"2024-09-22T03:49:15.094890+0000","last_became_peered":"2024-09-22T03:49:15.094890+0000","last_unstale":"2024-09-22T03:59:17.747840+0000","last_undegraded":"2024-09-22T03:59:17.747840+0000","last_fullsized":"2024-09-22T03:59:17.747840+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"70'131","reported_seq":149,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-22T03:59:21.109757+0000","last_change":"2024-09-22T03:59:10.359896+0000","last_active":"2024-09-22T03:59:21.109757+0000","last_peered":"2024-09-22T03:59:21.109757+0000","last_clean":"2024-09-22T03:59:21.109757+0000","last_became_active":"2024-09-22T03:59:10.342929+0000","last_became_peered":"2024-09-22T03:59:10.342929+0000","last_unstale":"2024-09-22T03:59:21.109757+0000","last_undegraded":"2024-09-22T03:59:21.109757+0000","last_fullsized":"2024-09-22T03:59:21.109757+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8585216,"num_objects":131,"num_object_clones":0,"num_object_copies":393,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":8384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":180,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-22T03:59:17.758484+0000","last_change":"2024-09-22T03:49:17.031466+0000","last_active":"2024-09-22T03:59:17.758484+0000","last_peered":"2024-09-22T03:59:17.758484+0000","last_clean":"2024-09-22T03:59:17.758484+0000","last_became_active":"2024-09-22T03:49:15.098420+0000","last_became_peered":"2024-09-22T03:49:15.098420+0000","last_unstale":"2024-09-22T03:59:17.758484+0000","last_undegraded":"2024-09-22T03:59:17.758484+0000","last_fullsized":"2024-09-22T03:59:17.758484+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.0","version":"70'119","reported_seq":137,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-22T03:59:20.155217+0000","last_change":"2024-09-22T03:59:10.339795+0000","last_active":"2024-09-22T03:59:20.155217+0000","last_peered":"2024-09-22T03:59:20.155217+0000","last_clean":"2024-09-22T03:59:20.155217+0000","last_became_active":"2024-09-22T03:59:10.325306+0000","last_became_peered":"2024-09-22T03:59:10.325306+0000","last_unstale":"2024-09-22T03:59:20.155217+0000","last_undegraded":"2024-09-22T03:59:20.155217+0000","last_fullsized":"2024-09-22T03:59:20.155217+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7798784,"num_objects":119,"num_object_clones":0,"num_object_copies":357,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":119,"num_write_kb":7616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":178,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-22T03:59:17.780886+0000","last_change":"2024-09-22T03:49:17.036954+0000","last_active":"2024-09-22T03:59:17.780886+0000","last_peered":"2024-09-22T03:59:17.780886+0000","last_clean":"2024-09-22T03:59:17.780886+0000","last_became_active":"2024-09-22T03:49:15.110506+0000","last_became_peered":"2024-09-22T03:49:15.110506+0000","last_unstale":"2024-09-22T03:59:17.780886+0000","last_undegraded":"2024-09-22T03:59:17.780886+0000","last_fullsized":"2024-09-22T03:59:17.780886+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"70'132","reported_seq":150,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-22T03:59:21.187542+0000","last_change":"2024-09-22T03:59:10.361108+0000","last_active":"2024-09-22T03:59:21.187542+0000","last_peered":"2024-09-22T03:59:21.187542+0000","last_clean":"2024-09-22T03:59:21.187542+0000","last_became_active":"2024-09-22T03:59:10.347213+0000","last_became_peered":"2024-09-22T03:59:10.347213+0000","last_unstale":"2024-09-22T03:59:21.187542+0000","last_undegraded":"2024-09-22T03:59:21.187542+0000","last_fullsized":"2024-09-22T03:59:21.187542+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8650752,"num_objects":132,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":8448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":178,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-22T03:59:17.761960+0000","last_change":"2024-09-22T03:49:17.032989+0000","last_active":"2024-09-22T03:59:17.761960+0000","last_peered":"2024-09-22T03:59:17.761960+0000","last_clean":"2024-09-22T03:59:17.761960+0000","last_became_active":"2024-09-22T03:49:15.079260+0000","last_became_peered":"2024-09-22T03:49:15.079260+0000","last_unstale":"2024-09-22T03:59:17.761960+0000","last_undegraded":"2024-09-22T03:59:17.761960+0000","last_fullsized":"2024-09-22T03:59:17.761960+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2","version":"70'105","reported_seq":123,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-22T03:59:19.799493+0000","last_change":"2024-09-22T03:59:10.318033+0000","last_active":"2024-09-22T03:59:19.799493+0000","last_peered":"2024-09-22T03:59:19.799493+0000","last_clean":"2024-09-22T03:59:19.799493+0000","last_became_active":"2024-09-22T03:59:10.308707+0000","last_became_peered":"2024-09-22T03:59:10.308707+0000","last_unstale":"2024-09-22T03:59:19.799493+0000","last_undegraded":"2024-09-22T03:59:19.799493+0000","last_fullsized":"2024-09-22T03:59:19.799493+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6881280,"num_objects":105,"num_object_clones":0,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":105,"num_write_kb":6720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":178,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-22T03:59:17.765909+0000","last_change":"2024-09-22T03:49:17.036402+0000","last_active":"2024-09-22T03:59:17.765909+0000","last_peered":"2024-09-22T03:59:17.765909+0000","last_clean":"2024-09-22T03:59:17.765909+0000","last_became_active":"2024-09-22T03:49:15.108430+0000","last_became_peered":"2024-09-22T03:49:15.108430+0000","last_unstale":"2024-09-22T03:59:17.765909+0000","last_undegraded":"2024-09-22T03:59:17.765909+0000","last_fullsized":"2024-09-22T03:59:17.765909+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"70'127","reported_seq":145,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-22T03:59:20.106350+0000","last_change":"2024-09-22T03:59:10.277817+0000","last_active":"2024-09-22T03:59:20.106350+0000","last_peered":"2024-09-22T03:59:20.106350+0000","last_clean":"2024-09-22T03:59:20.106350+0000","last_became_active":"2024-09-22T03:59:10.263119+0000","last_became_peered":"2024-09-22T03:59:10.263119+0000","last_unstale":"2024-09-22T03:59:20.106350+0000","last_undegraded":"2024-09-22T03:59:20.106350+0000","last_fullsized":"2024-09-22T03:59:20.106350+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8323072,"num_objects":127,"num_object_clones":0,"num_object_copies":381,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127,"num_write_kb":8128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":178,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-22T03:59:17.753456+0000","last_change":"2024-09-22T03:49:17.029128+0000","last_active":"2024-09-22T03:59:17.753456+0000","last_peered":"2024-09-22T03:59:17.753456+0000","last_clean":"2024-09-22T03:59:17.753456+0000","last_became_active":"2024-09-22T03:49:15.113396+0000","last_became_peered":"2024-09-22T03:49:15.113396+0000","last_unstale":"2024-09-22T03:59:17.753456+0000","last_undegraded":"2024-09-22T03:59:17.753456+0000","last_fullsized":"2024-09-22T03:59:17.753456+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":123797504,"num_objects":1889,"num_object_clones":0,"num_object_copies":5667,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1889,"num_write_kb":120896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":22900736,"data_stored":366411776,"data_compressed":17395862,"data_compressed_allocated":22900736,"data_compressed_original":366411776,"omap_allocated":0,"internal_metadata":0},"log_size":1889,"ondisk_log_size":1889,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949673568,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":91372,"kb_used_data":6236,"kb_used_omap":0,"kb_used_meta":85120,"kb_avail":94280468,"statfs":{"total":96636764160,"available":96543199232,"internally_reserved":0,"allocated":6385664,"data_stored":92492681,"data_compressed":4382914,"data_compressed_allocated":5771264,"data_compressed_original":92258304,"omap_allocated":0,"internal_metadata":87162880},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654706272,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":108608,"kb_used_data":5424,"kb_used_omap":0,"kb_used_meta":103168,"kb_avail":94263232,"statfs":{"total":96636764160,"available":96525549568,"internally_reserved":0,"allocated":5554176,"data_stored":79581545,"data_compressed":3767784,"data_compressed_allocated":4960256,"data_compressed_original":79364096,"omap_allocated":0,"internal_metadata":105644032},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706272,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":113336,"kb_used_data":5992,"kb_used_omap":0,"kb_used_meta":107328,"kb_avail":94258504,"statfs":{"total":96636764160,"available":96520708096,"internally_reserved":0,"allocated":6135808,"data_stored":88494985,"data_compressed":4193026,"data_compressed_allocated":5521408,"data_compressed_original":88260608,"omap_allocated":0,"internal_metadata":109903872},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706272,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":108416,"kb_used_data":5228,"kb_used_omap":0,"kb_used_meta":103168,"kb_avail":94263424,"statfs":{"total":96636764160,"available":96525746176,"internally_reserved":0,"allocated":5353472,"data_stored":76043126,"data_compressed":3601866,"data_compressed_allocated":4743168,"data_compressed_original":75808768,"omap_allocated":0,"internal_metadata":105644032},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5152768,"data_stored":82444288,"data_compressed":3914130,"data_compressed_allocated":5152768,"data_compressed_original":82444288,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":6250496,"data_stored":100007936,"data_compressed":4748082,"data_compressed_allocated":6250496,"data_compressed_original":100007936,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5935104,"data_stored":94961664,"data_compressed":4508402,"data_compressed_allocated":5935104,"data_compressed_original":94961664,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":5562368,"data_stored":88997888,"data_compressed":4225248,"data_compressed_allocated":5562368,"data_compressed_original":88997888,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:59:27.258 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 16 16 3238 3222 12.5848 11.625 0.0556371 0.0792755 2024-09-22T03:59:28.259 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 17 16 3447 3431 12.6128 13.0625 0.0582594 0.0790229 2024-09-22T03:59:29.155 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:59:29.259 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 18 16 3654 3638 12.6308 12.9375 0.127193 0.0789513 2024-09-22T03:59:29.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:59:29.315+0000 7fc9d0693640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:59:29.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:59:29.327+0000 7fc9d0693640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:59:30.259 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 19 16 3856 3840 12.6304 12.625 0.0412237 0.0789704 2024-09-22T03:59:31.259 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:2024-09-22T03:59:31.258922+0000 min lat: 0.0161128 max lat: 0.197522 avg lat: 0.0789293 2024-09-22T03:59:31.259 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-22T03:59:31.259 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 20 16 4062 4046 12.6426 12.875 0.0595416 0.0789293 2024-09-22T03:59:31.692 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:59:31.692 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:59:31.692 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:59:31.692 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:59:31.724 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:59:31.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:59:31.845+0000 7f6a12391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:59:31.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:59:31.861+0000 7f6a12391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:59:31.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:59:31.890+0000 7f4eee191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:59:31.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:59:31.901+0000 7f4eee191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:59:31.948 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:59:31.949 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:59:31.949 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:59:31.949 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:59:31.949 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:59:31.949 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:59:31.949 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:59:31.949 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:59:31.949 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:59:31.949 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:59:31.949 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:59:31.949 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:59:31.953 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:59:31.953 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:59:31.953 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:59:32.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:59:32.130+0000 7ff5658bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:59:32.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:59:32.149+0000 7ff5658bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:59:32.259 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 21 16 4253 4237 12.609 11.9375 0.0730076 0.0790616 2024-09-22T03:59:32.293 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:59:32.294 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:59:32.294 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:59:32.294 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:59:32.294 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:59:32.294 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:59:32.294 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:59:32.294 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:59:32.294 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:59:32.294 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:59:32.294 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:59:32.294 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:59:32.297 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:59:32.298 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:59:32.298 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:59:32.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:59:32.459+0000 7fed44f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:59:32.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:59:32.474+0000 7fed44f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:59:32.531 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:59:32.532 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:59:32.532 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:59:32.532 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:59:32.532 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:59:32.532 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:59:32.532 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:59:32.532 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:59:32.532 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:59:32.532 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:59:32.532 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:59:32.532 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:59:32.537 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:59:32.537 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:59:32.537 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:59:32.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:59:32.695+0000 7fac7aa88640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:59:32.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:59:32.709+0000 7fac7aa88640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:59:32.782 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:59:32.782 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:59:32.782 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:59:32.782 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:59:32.782 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:59:32.782 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:59:32.782 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:59:32.782 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:59:32.783 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:59:32.783 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:59:32.783 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:59:32.783 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:59:32.786 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:59:32.786 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:59:33.259 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 22 16 4451 4435 12.5983 12.375 0.162789 0.0791307 2024-09-22T03:59:34.259 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 23 16 4669 4653 12.6428 13.625 0.0625986 0.0789413 2024-09-22T03:59:34.359 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:59:34.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:59:34.501+0000 7f71f909c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:59:34.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:59:34.510+0000 7f71f909c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:59:35.259 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 24 16 4855 4839 12.6004 11.625 0.0505251 0.0791626 2024-09-22T03:59:36.259 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 25 16 5065 5049 12.6213 13.125 0.119987 0.0790462 2024-09-22T03:59:37.085 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:59:37.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:59:37.235+0000 7fb36bd51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:59:37.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:59:37.245+0000 7fb36bd51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:59:37.259 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 26 16 5270 5254 12.6286 12.8125 0.103077 0.0790497 2024-09-22T03:59:37.787 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:59:37.787 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:59:37.787 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:59:37.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:59:37.932+0000 7fb33d05c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:59:37.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:59:37.947+0000 7fb33d05c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:59:38.259 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 27 16 5457 5441 12.5937 11.6875 0.0632807 0.0792732 2024-09-22T03:59:38.271 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:59:38.271 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-22T03:59:38.296 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":379,"stamp":"2024-09-22T03:59:37.094773+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":321585715,"num_objects":4902,"num_object_clones":0,"num_object_copies":14706,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":4979,"num_write_kb":314580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4953,"ondisk_log_size":4953,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":497104,"kb_used_data":59408,"kb_used_omap":0,"kb_used_meta":437632,"kb_avail":376990256,"statfs":{"total":386547056640,"available":386038022144,"internally_reserved":0,"allocated":60833792,"data_stored":934064633,"data_compressed":44314582,"data_compressed_allocated":58335232,"data_compressed_original":933117952,"omap_allocated":0,"internal_metadata":448135168},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":131399680,"num_objects":2005,"num_object_clones":0,"num_object_copies":6015,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2005,"num_write_kb":128320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.001984"},"pg_stats":[{"pgid":"6.f","version":"72'322","reported_seq":346,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:59:35.996056+0000","last_change":"2024-09-22T03:59:10.330036+0000","last_active":"2024-09-22T03:59:35.996056+0000","last_peered":"2024-09-22T03:59:35.996056+0000","last_clean":"2024-09-22T03:59:35.996056+0000","last_became_active":"2024-09-22T03:59:10.319097+0000","last_became_peered":"2024-09-22T03:59:10.319097+0000","last_unstale":"2024-09-22T03:59:35.996056+0000","last_undegraded":"2024-09-22T03:59:35.996056+0000","last_fullsized":"2024-09-22T03:59:35.996056+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":322,"log_dups_size":0,"ondisk_log_size":322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21102592,"num_objects":322,"num_object_clones":0,"num_object_copies":966,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":322,"num_write_kb":20608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"72'307","reported_seq":331,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:59:35.065617+0000","last_change":"2024-09-22T03:59:10.321450+0000","last_active":"2024-09-22T03:59:35.065617+0000","last_peered":"2024-09-22T03:59:35.065617+0000","last_clean":"2024-09-22T03:59:35.065617+0000","last_became_active":"2024-09-22T03:59:10.311447+0000","last_became_peered":"2024-09-22T03:59:10.311447+0000","last_unstale":"2024-09-22T03:59:35.065617+0000","last_undegraded":"2024-09-22T03:59:35.065617+0000","last_fullsized":"2024-09-22T03:59:35.065617+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":307,"log_dups_size":0,"ondisk_log_size":307,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20119552,"num_objects":307,"num_object_clones":0,"num_object_copies":921,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":307,"num_write_kb":19648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"72'288","reported_seq":312,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:59:35.088876+0000","last_change":"2024-09-22T03:59:10.349259+0000","last_active":"2024-09-22T03:59:35.088876+0000","last_peered":"2024-09-22T03:59:35.088876+0000","last_clean":"2024-09-22T03:59:35.088876+0000","last_became_active":"2024-09-22T03:59:10.341464+0000","last_became_peered":"2024-09-22T03:59:10.341464+0000","last_unstale":"2024-09-22T03:59:35.088876+0000","last_undegraded":"2024-09-22T03:59:35.088876+0000","last_fullsized":"2024-09-22T03:59:35.088876+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":288,"log_dups_size":0,"ondisk_log_size":288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":288,"num_object_clones":0,"num_object_copies":864,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":288,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"72'287","reported_seq":311,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:59:36.149438+0000","last_change":"2024-09-22T03:59:10.365539+0000","last_active":"2024-09-22T03:59:36.149438+0000","last_peered":"2024-09-22T03:59:36.149438+0000","last_clean":"2024-09-22T03:59:36.149438+0000","last_became_active":"2024-09-22T03:59:10.339689+0000","last_became_peered":"2024-09-22T03:59:10.339689+0000","last_unstale":"2024-09-22T03:59:36.149438+0000","last_undegraded":"2024-09-22T03:59:36.149438+0000","last_fullsized":"2024-09-22T03:59:36.149438+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":287,"log_dups_size":0,"ondisk_log_size":287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18808832,"num_objects":287,"num_object_clones":0,"num_object_copies":861,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":287,"num_write_kb":18368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"72'273","reported_seq":297,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:59:34.841510+0000","last_change":"2024-09-22T03:59:10.331496+0000","last_active":"2024-09-22T03:59:34.841510+0000","last_peered":"2024-09-22T03:59:34.841510+0000","last_clean":"2024-09-22T03:59:34.841510+0000","last_became_active":"2024-09-22T03:59:10.322922+0000","last_became_peered":"2024-09-22T03:59:10.322922+0000","last_unstale":"2024-09-22T03:59:34.841510+0000","last_undegraded":"2024-09-22T03:59:34.841510+0000","last_fullsized":"2024-09-22T03:59:34.841510+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17891328,"num_objects":273,"num_object_clones":0,"num_object_copies":819,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":273,"num_write_kb":17472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.a","version":"72'273","reported_seq":297,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:59:34.995572+0000","last_change":"2024-09-22T03:59:10.268812+0000","last_active":"2024-09-22T03:59:34.995572+0000","last_peered":"2024-09-22T03:59:34.995572+0000","last_clean":"2024-09-22T03:59:34.995572+0000","last_became_active":"2024-09-22T03:59:10.261529+0000","last_became_peered":"2024-09-22T03:59:10.261529+0000","last_unstale":"2024-09-22T03:59:34.995572+0000","last_undegraded":"2024-09-22T03:59:34.995572+0000","last_fullsized":"2024-09-22T03:59:34.995572+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17891328,"num_objects":273,"num_object_clones":0,"num_object_copies":819,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":273,"num_write_kb":17472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"72'301","reported_seq":325,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:59:34.839767+0000","last_change":"2024-09-22T03:59:10.357775+0000","last_active":"2024-09-22T03:59:34.839767+0000","last_peered":"2024-09-22T03:59:34.839767+0000","last_clean":"2024-09-22T03:59:34.839767+0000","last_became_active":"2024-09-22T03:59:10.350219+0000","last_became_peered":"2024-09-22T03:59:10.350219+0000","last_unstale":"2024-09-22T03:59:34.839767+0000","last_undegraded":"2024-09-22T03:59:34.839767+0000","last_fullsized":"2024-09-22T03:59:34.839767+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":301,"log_dups_size":0,"ondisk_log_size":301,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19726336,"num_objects":301,"num_object_clones":0,"num_object_copies":903,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":301,"num_write_kb":19264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"72'279","reported_seq":303,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:59:35.056591+0000","last_change":"2024-09-22T03:59:10.302834+0000","last_active":"2024-09-22T03:59:35.056591+0000","last_peered":"2024-09-22T03:59:35.056591+0000","last_clean":"2024-09-22T03:59:35.056591+0000","last_became_active":"2024-09-22T03:59:10.294403+0000","last_became_peered":"2024-09-22T03:59:10.294403+0000","last_unstale":"2024-09-22T03:59:35.056591+0000","last_undegraded":"2024-09-22T03:59:35.056591+0000","last_fullsized":"2024-09-22T03:59:35.056591+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":279,"log_dups_size":0,"ondisk_log_size":279,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18284544,"num_objects":279,"num_object_clones":0,"num_object_copies":837,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":279,"num_write_kb":17856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"72'310","reported_seq":334,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:59:34.757518+0000","last_change":"2024-09-22T03:59:10.311620+0000","last_active":"2024-09-22T03:59:34.757518+0000","last_peered":"2024-09-22T03:59:34.757518+0000","last_clean":"2024-09-22T03:59:34.757518+0000","last_became_active":"2024-09-22T03:59:10.304722+0000","last_became_peered":"2024-09-22T03:59:10.304722+0000","last_unstale":"2024-09-22T03:59:34.757518+0000","last_undegraded":"2024-09-22T03:59:34.757518+0000","last_fullsized":"2024-09-22T03:59:34.757518+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":310,"log_dups_size":0,"ondisk_log_size":310,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20316160,"num_objects":310,"num_object_clones":0,"num_object_copies":930,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":310,"num_write_kb":19840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":259,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:59:27.749571+0000","last_change":"2024-09-22T03:49:12.034704+0000","last_active":"2024-09-22T03:59:27.749571+0000","last_peered":"2024-09-22T03:59:27.749571+0000","last_clean":"2024-09-22T03:59:27.749571+0000","last_became_active":"2024-09-22T03:49:12.027470+0000","last_became_peered":"2024-09-22T03:49:12.027470+0000","last_unstale":"2024-09-22T03:59:27.749571+0000","last_undegraded":"2024-09-22T03:59:27.749571+0000","last_fullsized":"2024-09-22T03:59:27.749571+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_clean_scrub_stamp":"2024-09-22T03:49:10.979949+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":185,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:59:27.767983+0000","last_change":"2024-09-22T03:49:17.031458+0000","last_active":"2024-09-22T03:59:27.767983+0000","last_peered":"2024-09-22T03:59:27.767983+0000","last_clean":"2024-09-22T03:59:27.767983+0000","last_became_active":"2024-09-22T03:49:15.125490+0000","last_became_peered":"2024-09-22T03:49:15.125490+0000","last_unstale":"2024-09-22T03:59:27.767983+0000","last_undegraded":"2024-09-22T03:59:27.767983+0000","last_fullsized":"2024-09-22T03:59:27.767983+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"72'335","reported_seq":359,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:59:36.034408+0000","last_change":"2024-09-22T03:59:10.355702+0000","last_active":"2024-09-22T03:59:36.034408+0000","last_peered":"2024-09-22T03:59:36.034408+0000","last_clean":"2024-09-22T03:59:36.034408+0000","last_became_active":"2024-09-22T03:59:10.330418+0000","last_became_peered":"2024-09-22T03:59:10.330418+0000","last_unstale":"2024-09-22T03:59:36.034408+0000","last_undegraded":"2024-09-22T03:59:36.034408+0000","last_fullsized":"2024-09-22T03:59:36.034408+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":335,"log_dups_size":0,"ondisk_log_size":335,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21954560,"num_objects":335,"num_object_clones":0,"num_object_copies":1005,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":335,"num_write_kb":21440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":184,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:59:27.768540+0000","last_change":"2024-09-22T03:49:17.029339+0000","last_active":"2024-09-22T03:59:27.768540+0000","last_peered":"2024-09-22T03:59:27.768540+0000","last_clean":"2024-09-22T03:59:27.768540+0000","last_became_active":"2024-09-22T03:49:15.097304+0000","last_became_peered":"2024-09-22T03:49:15.097304+0000","last_unstale":"2024-09-22T03:59:27.768540+0000","last_undegraded":"2024-09-22T03:59:27.768540+0000","last_fullsized":"2024-09-22T03:59:27.768540+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.5","version":"72'341","reported_seq":365,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:59:35.071969+0000","last_change":"2024-09-22T03:59:10.300610+0000","last_active":"2024-09-22T03:59:35.071969+0000","last_peered":"2024-09-22T03:59:35.071969+0000","last_clean":"2024-09-22T03:59:35.071969+0000","last_became_active":"2024-09-22T03:59:10.293587+0000","last_became_peered":"2024-09-22T03:59:10.293587+0000","last_unstale":"2024-09-22T03:59:35.071969+0000","last_undegraded":"2024-09-22T03:59:35.071969+0000","last_fullsized":"2024-09-22T03:59:35.071969+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":341,"log_dups_size":0,"ondisk_log_size":341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22347776,"num_objects":341,"num_object_clones":0,"num_object_copies":1023,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":341,"num_write_kb":21824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":184,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:59:27.767507+0000","last_change":"2024-09-22T03:49:17.029349+0000","last_active":"2024-09-22T03:59:27.767507+0000","last_peered":"2024-09-22T03:59:27.767507+0000","last_clean":"2024-09-22T03:59:27.767507+0000","last_became_active":"2024-09-22T03:49:15.094890+0000","last_became_peered":"2024-09-22T03:49:15.094890+0000","last_unstale":"2024-09-22T03:59:27.767507+0000","last_undegraded":"2024-09-22T03:59:27.767507+0000","last_fullsized":"2024-09-22T03:59:27.767507+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"72'339","reported_seq":363,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:59:36.132939+0000","last_change":"2024-09-22T03:59:10.359896+0000","last_active":"2024-09-22T03:59:36.132939+0000","last_peered":"2024-09-22T03:59:36.132939+0000","last_clean":"2024-09-22T03:59:36.132939+0000","last_became_active":"2024-09-22T03:59:10.342929+0000","last_became_peered":"2024-09-22T03:59:10.342929+0000","last_unstale":"2024-09-22T03:59:36.132939+0000","last_undegraded":"2024-09-22T03:59:36.132939+0000","last_fullsized":"2024-09-22T03:59:36.132939+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":339,"log_dups_size":0,"ondisk_log_size":339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22216704,"num_objects":339,"num_object_clones":0,"num_object_copies":1017,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":339,"num_write_kb":21696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":186,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:59:27.773632+0000","last_change":"2024-09-22T03:49:17.031466+0000","last_active":"2024-09-22T03:59:27.773632+0000","last_peered":"2024-09-22T03:59:27.773632+0000","last_clean":"2024-09-22T03:59:27.773632+0000","last_became_active":"2024-09-22T03:49:15.098420+0000","last_became_peered":"2024-09-22T03:49:15.098420+0000","last_unstale":"2024-09-22T03:59:27.773632+0000","last_undegraded":"2024-09-22T03:59:27.773632+0000","last_fullsized":"2024-09-22T03:59:27.773632+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.0","version":"72'309","reported_seq":333,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:59:34.977661+0000","last_change":"2024-09-22T03:59:10.339795+0000","last_active":"2024-09-22T03:59:34.977661+0000","last_peered":"2024-09-22T03:59:34.977661+0000","last_clean":"2024-09-22T03:59:34.977661+0000","last_became_active":"2024-09-22T03:59:10.325306+0000","last_became_peered":"2024-09-22T03:59:10.325306+0000","last_unstale":"2024-09-22T03:59:34.977661+0000","last_undegraded":"2024-09-22T03:59:34.977661+0000","last_fullsized":"2024-09-22T03:59:34.977661+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":309,"log_dups_size":0,"ondisk_log_size":309,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20250624,"num_objects":309,"num_object_clones":0,"num_object_copies":927,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":309,"num_write_kb":19776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":184,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:59:27.761988+0000","last_change":"2024-09-22T03:49:17.036954+0000","last_active":"2024-09-22T03:59:27.761988+0000","last_peered":"2024-09-22T03:59:27.761988+0000","last_clean":"2024-09-22T03:59:27.761988+0000","last_became_active":"2024-09-22T03:49:15.110506+0000","last_became_peered":"2024-09-22T03:49:15.110506+0000","last_unstale":"2024-09-22T03:59:27.761988+0000","last_undegraded":"2024-09-22T03:59:27.761988+0000","last_fullsized":"2024-09-22T03:59:27.761988+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"72'307","reported_seq":331,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:59:35.693296+0000","last_change":"2024-09-22T03:59:10.361108+0000","last_active":"2024-09-22T03:59:35.693296+0000","last_peered":"2024-09-22T03:59:35.693296+0000","last_clean":"2024-09-22T03:59:35.693296+0000","last_became_active":"2024-09-22T03:59:10.347213+0000","last_became_peered":"2024-09-22T03:59:10.347213+0000","last_unstale":"2024-09-22T03:59:35.693296+0000","last_undegraded":"2024-09-22T03:59:35.693296+0000","last_fullsized":"2024-09-22T03:59:35.693296+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":307,"log_dups_size":0,"ondisk_log_size":307,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20119552,"num_objects":307,"num_object_clones":0,"num_object_copies":921,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":307,"num_write_kb":19648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":184,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:59:27.752229+0000","last_change":"2024-09-22T03:49:17.032989+0000","last_active":"2024-09-22T03:59:27.752229+0000","last_peered":"2024-09-22T03:59:27.752229+0000","last_clean":"2024-09-22T03:59:27.752229+0000","last_became_active":"2024-09-22T03:49:15.079260+0000","last_became_peered":"2024-09-22T03:49:15.079260+0000","last_unstale":"2024-09-22T03:59:27.752229+0000","last_undegraded":"2024-09-22T03:59:27.752229+0000","last_fullsized":"2024-09-22T03:59:27.752229+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2","version":"72'287","reported_seq":311,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:59:34.980735+0000","last_change":"2024-09-22T03:59:10.318033+0000","last_active":"2024-09-22T03:59:34.980735+0000","last_peered":"2024-09-22T03:59:34.980735+0000","last_clean":"2024-09-22T03:59:34.980735+0000","last_became_active":"2024-09-22T03:59:10.308707+0000","last_became_peered":"2024-09-22T03:59:10.308707+0000","last_unstale":"2024-09-22T03:59:34.980735+0000","last_undegraded":"2024-09-22T03:59:34.980735+0000","last_fullsized":"2024-09-22T03:59:34.980735+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":287,"log_dups_size":0,"ondisk_log_size":287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18808832,"num_objects":287,"num_object_clones":0,"num_object_copies":861,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":287,"num_write_kb":18368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":184,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:59:27.758487+0000","last_change":"2024-09-22T03:49:17.036402+0000","last_active":"2024-09-22T03:59:27.758487+0000","last_peered":"2024-09-22T03:59:27.758487+0000","last_clean":"2024-09-22T03:59:27.758487+0000","last_became_active":"2024-09-22T03:49:15.108430+0000","last_became_peered":"2024-09-22T03:49:15.108430+0000","last_unstale":"2024-09-22T03:59:27.758487+0000","last_undegraded":"2024-09-22T03:59:27.758487+0000","last_fullsized":"2024-09-22T03:59:27.758487+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"72'340","reported_seq":364,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:59:34.937029+0000","last_change":"2024-09-22T03:59:10.277817+0000","last_active":"2024-09-22T03:59:34.937029+0000","last_peered":"2024-09-22T03:59:34.937029+0000","last_clean":"2024-09-22T03:59:34.937029+0000","last_became_active":"2024-09-22T03:59:10.263119+0000","last_became_peered":"2024-09-22T03:59:10.263119+0000","last_unstale":"2024-09-22T03:59:34.937029+0000","last_undegraded":"2024-09-22T03:59:34.937029+0000","last_fullsized":"2024-09-22T03:59:34.937029+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":340,"log_dups_size":0,"ondisk_log_size":340,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22282240,"num_objects":340,"num_object_clones":0,"num_object_copies":1020,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":340,"num_write_kb":21760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":184,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:59:27.767421+0000","last_change":"2024-09-22T03:49:17.029128+0000","last_active":"2024-09-22T03:59:27.767421+0000","last_peered":"2024-09-22T03:59:27.767421+0000","last_clean":"2024-09-22T03:59:27.767421+0000","last_became_active":"2024-09-22T03:49:15.113396+0000","last_became_peered":"2024-09-22T03:49:15.113396+0000","last_unstale":"2024-09-22T03:59:27.767421+0000","last_undegraded":"2024-09-22T03:59:27.767421+0000","last_fullsized":"2024-09-22T03:59:27.767421+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":320995328,"num_objects":4898,"num_object_clones":0,"num_object_copies":14694,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4898,"num_write_kb":313472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":60051456,"data_stored":960823296,"data_compressed":45621702,"data_compressed_allocated":60051456,"data_compressed_original":960823296,"omap_allocated":0,"internal_metadata":0},"log_size":4898,"ondisk_log_size":4898,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949673583,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":126952,"kb_used_data":15448,"kb_used_omap":0,"kb_used_meta":111488,"kb_avail":94244888,"statfs":{"total":96636764160,"available":96506765312,"internally_reserved":0,"allocated":15818752,"data_stored":243166475,"data_compressed":11537402,"data_compressed_allocated":15187968,"data_compressed_original":242925568,"omap_allocated":0,"internal_metadata":114163712},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654706287,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":130340,"kb_used_data":14676,"kb_used_omap":0,"kb_used_meta":115648,"kb_avail":94241500,"statfs":{"total":96636764160,"available":96503296000,"internally_reserved":0,"allocated":15028224,"data_stored":230910699,"data_compressed":10953392,"data_compressed_allocated":14417920,"data_compressed_original":230686720,"omap_allocated":0,"internal_metadata":118423552},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706287,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":114760,"kb_used_data":15736,"kb_used_omap":0,"kb_used_meta":99008,"kb_avail":94257080,"statfs":{"total":96636764160,"available":96519249920,"internally_reserved":0,"allocated":16113664,"data_stored":247885067,"data_compressed":11761410,"data_compressed_allocated":15482880,"data_compressed_original":247644160,"omap_allocated":0,"internal_metadata":101384192},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706287,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":125052,"kb_used_data":13548,"kb_used_omap":0,"kb_used_meta":111488,"kb_avail":94246788,"statfs":{"total":96636764160,"available":96508710912,"internally_reserved":0,"allocated":13873152,"data_stored":212102392,"data_compressed":10062378,"data_compressed_allocated":13246464,"data_compressed_original":211861504,"omap_allocated":0,"internal_metadata":114163712},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":13631488,"data_stored":218103808,"data_compressed":10355970,"data_compressed_allocated":13631488,"data_compressed_original":218103808,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":15642624,"data_stored":250281984,"data_compressed":11883898,"data_compressed_allocated":15642624,"data_compressed_original":250281984,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":15826944,"data_stored":253231104,"data_compressed":12023882,"data_compressed_allocated":15826944,"data_compressed_original":253231104,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":14950400,"data_stored":239206400,"data_compressed":11357952,"data_compressed_allocated":14950400,"data_compressed_original":239206400,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:59:39.260 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 28 16 5663 5647 12.6037 12.875 0.110382 0.0792119 2024-09-22T03:59:39.677 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:59:39.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:59:39.828+0000 7f6abf191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:59:39.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:59:39.836+0000 7f6abdf2f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:59:40.260 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 29 16 5852 5836 12.5764 11.8125 0.113524 0.0793455 2024-09-22T03:59:41.260 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 30 16 6052 6036 12.5739 12.5 0.0626253 0.0794013 2024-09-22T03:59:42.260 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 31 16 6257 6241 12.5815 12.8125 0.0602781 0.0793503 2024-09-22T03:59:42.346 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:59:42.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:59:42.498+0000 7ff45d391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:59:42.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:59:42.508+0000 7ff45d391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:59:43.260 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 32 16 6439 6423 12.5438 11.375 0.0356944 0.079553 2024-09-22T03:59:43.297 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:59:43.297 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:59:43.298 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:59:43.298 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:59:43.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:59:43.462+0000 7f2204191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:59:43.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:59:43.481+0000 7f2204191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:59:43.684 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:59:43.684 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:59:43.685 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:59:43.685 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:59:43.685 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:59:43.685 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:59:43.685 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:59:43.685 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:59:43.685 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:59:43.685 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:59:43.685 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:59:43.685 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:59:43.689 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:59:43.689 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:59:43.689 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:59:43.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:59:43.853+0000 7f04ce8d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:59:43.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:59:43.869+0000 7f04ce8d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:59:44.051 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:59:44.051 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:59:44.051 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:59:44.051 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:59:44.051 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:59:44.051 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:59:44.051 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:59:44.052 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:59:44.052 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:59:44.052 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:59:44.052 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:59:44.052 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:59:44.054 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:59:44.054 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:59:44.055 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:59:44.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:59:44.217+0000 7f4473b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:59:44.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:59:44.230+0000 7f4473b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:59:44.258 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:59:44.258 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:59:44.258 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:59:44.258 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:59:44.258 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:59:44.258 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:59:44.258 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:59:44.258 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:59:44.258 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:59:44.258 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:59:44.258 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:59:44.258 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:59:44.260 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 33 16 6620 6604 12.5064 11.3125 0.143674 0.0797604 2024-09-22T03:59:44.262 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:59:44.263 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:59:44.263 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:59:44.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:59:44.420+0000 7f676b86c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:59:44.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:59:44.435+0000 7f676b86c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:59:44.463 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T03:59:44.463 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T03:59:44.463 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T03:59:44.463 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T03:59:44.463 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T03:59:44.463 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T03:59:44.464 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T03:59:44.464 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T03:59:44.464 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T03:59:44.464 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T03:59:44.464 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T03:59:44.464 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T03:59:44.468 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:59:44.468 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:59:45.031 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:59:45.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:59:45.184+0000 7f11436bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:59:45.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:59:45.199+0000 7f11436bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:59:45.260 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 34 16 6811 6795 12.4897 11.9375 0.033575 0.0799438 2024-09-22T03:59:46.260 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 35 16 7005 6989 12.4792 12.125 0.0841216 0.0800455 2024-09-22T03:59:47.260 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 36 16 7206 7190 12.4815 12.5625 0.0819618 0.0800474 2024-09-22T03:59:47.863 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:59:48.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:59:48.017+0000 7eff23d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:59:48.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:59:48.028+0000 7eff23d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:59:48.260 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 37 16 7395 7379 12.4634 11.8125 0.108904 0.080091 2024-09-22T03:59:49.260 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 38 16 7602 7586 12.4759 12.9375 0.102994 0.0800655 2024-09-22T03:59:49.469 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:59:49.469 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:59:49.469 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:59:49.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:59:49.613+0000 7efe70791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:59:49.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:59:49.629+0000 7efe70791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:59:49.960 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:59:49.961 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-22T03:59:49.979 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":385,"stamp":"2024-09-22T03:59:49.097361+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":450691635,"num_objects":6872,"num_object_clones":0,"num_object_copies":20616,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":6949,"num_write_kb":440660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6923,"ondisk_log_size":6923,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":491500,"kb_used_data":82920,"kb_used_omap":0,"kb_used_meta":408512,"kb_avail":376995860,"statfs":{"total":386547056640,"available":386043760640,"internally_reserved":0,"allocated":84910080,"data_stored":1319285241,"data_compressed":62606918,"data_compressed_allocated":82411520,"data_compressed_original":1318338560,"omap_allocated":0,"internal_metadata":418316288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":129105920,"num_objects":1970,"num_object_clones":0,"num_object_copies":5910,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1970,"num_write_kb":126080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002588"},"pg_stats":[{"pgid":"6.f","version":"72'458","reported_seq":482,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:59:46.068126+0000","last_change":"2024-09-22T03:59:10.330036+0000","last_active":"2024-09-22T03:59:46.068126+0000","last_peered":"2024-09-22T03:59:46.068126+0000","last_clean":"2024-09-22T03:59:46.068126+0000","last_became_active":"2024-09-22T03:59:10.319097+0000","last_became_peered":"2024-09-22T03:59:10.319097+0000","last_unstale":"2024-09-22T03:59:46.068126+0000","last_undegraded":"2024-09-22T03:59:46.068126+0000","last_fullsized":"2024-09-22T03:59:46.068126+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30015488,"num_objects":458,"num_object_clones":0,"num_object_copies":1374,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":458,"num_write_kb":29312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"72'433","reported_seq":457,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:59:45.020258+0000","last_change":"2024-09-22T03:59:10.321450+0000","last_active":"2024-09-22T03:59:45.020258+0000","last_peered":"2024-09-22T03:59:45.020258+0000","last_clean":"2024-09-22T03:59:45.020258+0000","last_became_active":"2024-09-22T03:59:10.311447+0000","last_became_peered":"2024-09-22T03:59:10.311447+0000","last_unstale":"2024-09-22T03:59:45.020258+0000","last_undegraded":"2024-09-22T03:59:45.020258+0000","last_fullsized":"2024-09-22T03:59:45.020258+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28377088,"num_objects":433,"num_object_clones":0,"num_object_copies":1299,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":433,"num_write_kb":27712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"72'408","reported_seq":432,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:59:44.789697+0000","last_change":"2024-09-22T03:59:10.349259+0000","last_active":"2024-09-22T03:59:44.789697+0000","last_peered":"2024-09-22T03:59:44.789697+0000","last_clean":"2024-09-22T03:59:44.789697+0000","last_became_active":"2024-09-22T03:59:10.341464+0000","last_became_peered":"2024-09-22T03:59:10.341464+0000","last_unstale":"2024-09-22T03:59:44.789697+0000","last_undegraded":"2024-09-22T03:59:44.789697+0000","last_fullsized":"2024-09-22T03:59:44.789697+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26738688,"num_objects":408,"num_object_clones":0,"num_object_copies":1224,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":408,"num_write_kb":26112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"72'409","reported_seq":433,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:59:46.148966+0000","last_change":"2024-09-22T03:59:10.365539+0000","last_active":"2024-09-22T03:59:46.148966+0000","last_peered":"2024-09-22T03:59:46.148966+0000","last_clean":"2024-09-22T03:59:46.148966+0000","last_became_active":"2024-09-22T03:59:10.339689+0000","last_became_peered":"2024-09-22T03:59:10.339689+0000","last_unstale":"2024-09-22T03:59:46.148966+0000","last_undegraded":"2024-09-22T03:59:46.148966+0000","last_fullsized":"2024-09-22T03:59:46.148966+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26804224,"num_objects":409,"num_object_clones":0,"num_object_copies":1227,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":409,"num_write_kb":26176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"72'397","reported_seq":421,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:59:45.010670+0000","last_change":"2024-09-22T03:59:10.331496+0000","last_active":"2024-09-22T03:59:45.010670+0000","last_peered":"2024-09-22T03:59:45.010670+0000","last_clean":"2024-09-22T03:59:45.010670+0000","last_became_active":"2024-09-22T03:59:10.322922+0000","last_became_peered":"2024-09-22T03:59:10.322922+0000","last_unstale":"2024-09-22T03:59:45.010670+0000","last_undegraded":"2024-09-22T03:59:45.010670+0000","last_fullsized":"2024-09-22T03:59:45.010670+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26017792,"num_objects":397,"num_object_clones":0,"num_object_copies":1191,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":397,"num_write_kb":25408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.a","version":"72'379","reported_seq":403,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:59:45.107405+0000","last_change":"2024-09-22T03:59:10.268812+0000","last_active":"2024-09-22T03:59:45.107405+0000","last_peered":"2024-09-22T03:59:45.107405+0000","last_clean":"2024-09-22T03:59:45.107405+0000","last_became_active":"2024-09-22T03:59:10.261529+0000","last_became_peered":"2024-09-22T03:59:10.261529+0000","last_unstale":"2024-09-22T03:59:45.107405+0000","last_undegraded":"2024-09-22T03:59:45.107405+0000","last_fullsized":"2024-09-22T03:59:45.107405+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24838144,"num_objects":379,"num_object_clones":0,"num_object_copies":1137,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":379,"num_write_kb":24256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"72'441","reported_seq":465,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:59:45.163877+0000","last_change":"2024-09-22T03:59:10.357775+0000","last_active":"2024-09-22T03:59:45.163877+0000","last_peered":"2024-09-22T03:59:45.163877+0000","last_clean":"2024-09-22T03:59:45.163877+0000","last_became_active":"2024-09-22T03:59:10.350219+0000","last_became_peered":"2024-09-22T03:59:10.350219+0000","last_unstale":"2024-09-22T03:59:45.163877+0000","last_undegraded":"2024-09-22T03:59:45.163877+0000","last_fullsized":"2024-09-22T03:59:45.163877+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28901376,"num_objects":441,"num_object_clones":0,"num_object_copies":1323,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":441,"num_write_kb":28224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"72'401","reported_seq":425,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:59:44.933879+0000","last_change":"2024-09-22T03:59:10.302834+0000","last_active":"2024-09-22T03:59:44.933879+0000","last_peered":"2024-09-22T03:59:44.933879+0000","last_clean":"2024-09-22T03:59:44.933879+0000","last_became_active":"2024-09-22T03:59:10.294403+0000","last_became_peered":"2024-09-22T03:59:10.294403+0000","last_unstale":"2024-09-22T03:59:44.933879+0000","last_undegraded":"2024-09-22T03:59:44.933879+0000","last_fullsized":"2024-09-22T03:59:44.933879+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26279936,"num_objects":401,"num_object_clones":0,"num_object_copies":1203,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":401,"num_write_kb":25664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"72'443","reported_seq":467,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:59:45.023986+0000","last_change":"2024-09-22T03:59:10.311620+0000","last_active":"2024-09-22T03:59:45.023986+0000","last_peered":"2024-09-22T03:59:45.023986+0000","last_clean":"2024-09-22T03:59:45.023986+0000","last_became_active":"2024-09-22T03:59:10.304722+0000","last_became_peered":"2024-09-22T03:59:10.304722+0000","last_unstale":"2024-09-22T03:59:45.023986+0000","last_undegraded":"2024-09-22T03:59:45.023986+0000","last_fullsized":"2024-09-22T03:59:45.023986+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29032448,"num_objects":443,"num_object_clones":0,"num_object_copies":1329,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":443,"num_write_kb":28352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":259,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:59:27.749571+0000","last_change":"2024-09-22T03:49:12.034704+0000","last_active":"2024-09-22T03:59:27.749571+0000","last_peered":"2024-09-22T03:59:27.749571+0000","last_clean":"2024-09-22T03:59:27.749571+0000","last_became_active":"2024-09-22T03:49:12.027470+0000","last_became_peered":"2024-09-22T03:49:12.027470+0000","last_unstale":"2024-09-22T03:59:27.749571+0000","last_undegraded":"2024-09-22T03:59:27.749571+0000","last_fullsized":"2024-09-22T03:59:27.749571+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_clean_scrub_stamp":"2024-09-22T03:49:10.979949+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":185,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:59:27.767983+0000","last_change":"2024-09-22T03:49:17.031458+0000","last_active":"2024-09-22T03:59:27.767983+0000","last_peered":"2024-09-22T03:59:27.767983+0000","last_clean":"2024-09-22T03:59:27.767983+0000","last_became_active":"2024-09-22T03:49:15.125490+0000","last_became_peered":"2024-09-22T03:49:15.125490+0000","last_unstale":"2024-09-22T03:59:27.767983+0000","last_undegraded":"2024-09-22T03:59:27.767983+0000","last_fullsized":"2024-09-22T03:59:27.767983+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"72'471","reported_seq":495,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:59:46.093852+0000","last_change":"2024-09-22T03:59:10.355702+0000","last_active":"2024-09-22T03:59:46.093852+0000","last_peered":"2024-09-22T03:59:46.093852+0000","last_clean":"2024-09-22T03:59:46.093852+0000","last_became_active":"2024-09-22T03:59:10.330418+0000","last_became_peered":"2024-09-22T03:59:10.330418+0000","last_unstale":"2024-09-22T03:59:46.093852+0000","last_undegraded":"2024-09-22T03:59:46.093852+0000","last_fullsized":"2024-09-22T03:59:46.093852+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30867456,"num_objects":471,"num_object_clones":0,"num_object_copies":1413,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":471,"num_write_kb":30144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":184,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:59:27.768540+0000","last_change":"2024-09-22T03:49:17.029339+0000","last_active":"2024-09-22T03:59:27.768540+0000","last_peered":"2024-09-22T03:59:27.768540+0000","last_clean":"2024-09-22T03:59:27.768540+0000","last_became_active":"2024-09-22T03:49:15.097304+0000","last_became_peered":"2024-09-22T03:49:15.097304+0000","last_unstale":"2024-09-22T03:59:27.768540+0000","last_undegraded":"2024-09-22T03:59:27.768540+0000","last_fullsized":"2024-09-22T03:59:27.768540+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.5","version":"72'458","reported_seq":482,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:59:45.097990+0000","last_change":"2024-09-22T03:59:10.300610+0000","last_active":"2024-09-22T03:59:45.097990+0000","last_peered":"2024-09-22T03:59:45.097990+0000","last_clean":"2024-09-22T03:59:45.097990+0000","last_became_active":"2024-09-22T03:59:10.293587+0000","last_became_peered":"2024-09-22T03:59:10.293587+0000","last_unstale":"2024-09-22T03:59:45.097990+0000","last_undegraded":"2024-09-22T03:59:45.097990+0000","last_fullsized":"2024-09-22T03:59:45.097990+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30015488,"num_objects":458,"num_object_clones":0,"num_object_copies":1374,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":458,"num_write_kb":29312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":184,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:59:27.767507+0000","last_change":"2024-09-22T03:49:17.029349+0000","last_active":"2024-09-22T03:59:27.767507+0000","last_peered":"2024-09-22T03:59:27.767507+0000","last_clean":"2024-09-22T03:59:27.767507+0000","last_became_active":"2024-09-22T03:49:15.094890+0000","last_became_peered":"2024-09-22T03:49:15.094890+0000","last_unstale":"2024-09-22T03:59:27.767507+0000","last_undegraded":"2024-09-22T03:59:27.767507+0000","last_fullsized":"2024-09-22T03:59:27.767507+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"72'447","reported_seq":471,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:59:46.132050+0000","last_change":"2024-09-22T03:59:10.359896+0000","last_active":"2024-09-22T03:59:46.132050+0000","last_peered":"2024-09-22T03:59:46.132050+0000","last_clean":"2024-09-22T03:59:46.132050+0000","last_became_active":"2024-09-22T03:59:10.342929+0000","last_became_peered":"2024-09-22T03:59:10.342929+0000","last_unstale":"2024-09-22T03:59:46.132050+0000","last_undegraded":"2024-09-22T03:59:46.132050+0000","last_fullsized":"2024-09-22T03:59:46.132050+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29294592,"num_objects":447,"num_object_clones":0,"num_object_copies":1341,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":447,"num_write_kb":28608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":186,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:59:27.773632+0000","last_change":"2024-09-22T03:49:17.031466+0000","last_active":"2024-09-22T03:59:27.773632+0000","last_peered":"2024-09-22T03:59:27.773632+0000","last_clean":"2024-09-22T03:59:27.773632+0000","last_became_active":"2024-09-22T03:49:15.098420+0000","last_became_peered":"2024-09-22T03:49:15.098420+0000","last_unstale":"2024-09-22T03:59:27.773632+0000","last_undegraded":"2024-09-22T03:59:27.773632+0000","last_fullsized":"2024-09-22T03:59:27.773632+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.0","version":"72'441","reported_seq":465,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:59:44.930474+0000","last_change":"2024-09-22T03:59:10.339795+0000","last_active":"2024-09-22T03:59:44.930474+0000","last_peered":"2024-09-22T03:59:44.930474+0000","last_clean":"2024-09-22T03:59:44.930474+0000","last_became_active":"2024-09-22T03:59:10.325306+0000","last_became_peered":"2024-09-22T03:59:10.325306+0000","last_unstale":"2024-09-22T03:59:44.930474+0000","last_undegraded":"2024-09-22T03:59:44.930474+0000","last_fullsized":"2024-09-22T03:59:44.930474+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28901376,"num_objects":441,"num_object_clones":0,"num_object_copies":1323,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":441,"num_write_kb":28224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":184,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:59:27.761988+0000","last_change":"2024-09-22T03:49:17.036954+0000","last_active":"2024-09-22T03:59:27.761988+0000","last_peered":"2024-09-22T03:59:27.761988+0000","last_clean":"2024-09-22T03:59:27.761988+0000","last_became_active":"2024-09-22T03:49:15.110506+0000","last_became_peered":"2024-09-22T03:49:15.110506+0000","last_unstale":"2024-09-22T03:59:27.761988+0000","last_undegraded":"2024-09-22T03:59:27.761988+0000","last_fullsized":"2024-09-22T03:59:27.761988+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"72'426","reported_seq":450,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:59:46.113542+0000","last_change":"2024-09-22T03:59:10.361108+0000","last_active":"2024-09-22T03:59:46.113542+0000","last_peered":"2024-09-22T03:59:46.113542+0000","last_clean":"2024-09-22T03:59:46.113542+0000","last_became_active":"2024-09-22T03:59:10.347213+0000","last_became_peered":"2024-09-22T03:59:10.347213+0000","last_unstale":"2024-09-22T03:59:46.113542+0000","last_undegraded":"2024-09-22T03:59:46.113542+0000","last_fullsized":"2024-09-22T03:59:46.113542+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27918336,"num_objects":426,"num_object_clones":0,"num_object_copies":1278,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":426,"num_write_kb":27264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":184,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:59:27.752229+0000","last_change":"2024-09-22T03:49:17.032989+0000","last_active":"2024-09-22T03:59:27.752229+0000","last_peered":"2024-09-22T03:59:27.752229+0000","last_clean":"2024-09-22T03:59:27.752229+0000","last_became_active":"2024-09-22T03:49:15.079260+0000","last_became_peered":"2024-09-22T03:49:15.079260+0000","last_unstale":"2024-09-22T03:59:27.752229+0000","last_undegraded":"2024-09-22T03:59:27.752229+0000","last_fullsized":"2024-09-22T03:59:27.752229+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2","version":"72'408","reported_seq":432,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:59:45.010954+0000","last_change":"2024-09-22T03:59:10.318033+0000","last_active":"2024-09-22T03:59:45.010954+0000","last_peered":"2024-09-22T03:59:45.010954+0000","last_clean":"2024-09-22T03:59:45.010954+0000","last_became_active":"2024-09-22T03:59:10.308707+0000","last_became_peered":"2024-09-22T03:59:10.308707+0000","last_unstale":"2024-09-22T03:59:45.010954+0000","last_undegraded":"2024-09-22T03:59:45.010954+0000","last_fullsized":"2024-09-22T03:59:45.010954+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26738688,"num_objects":408,"num_object_clones":0,"num_object_copies":1224,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":408,"num_write_kb":26112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":184,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:59:27.758487+0000","last_change":"2024-09-22T03:49:17.036402+0000","last_active":"2024-09-22T03:59:27.758487+0000","last_peered":"2024-09-22T03:59:27.758487+0000","last_clean":"2024-09-22T03:59:27.758487+0000","last_became_active":"2024-09-22T03:49:15.108430+0000","last_became_peered":"2024-09-22T03:49:15.108430+0000","last_unstale":"2024-09-22T03:59:27.758487+0000","last_undegraded":"2024-09-22T03:59:27.758487+0000","last_fullsized":"2024-09-22T03:59:27.758487+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"72'448","reported_seq":472,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:59:45.078702+0000","last_change":"2024-09-22T03:59:10.277817+0000","last_active":"2024-09-22T03:59:45.078702+0000","last_peered":"2024-09-22T03:59:45.078702+0000","last_clean":"2024-09-22T03:59:45.078702+0000","last_became_active":"2024-09-22T03:59:10.263119+0000","last_became_peered":"2024-09-22T03:59:10.263119+0000","last_unstale":"2024-09-22T03:59:45.078702+0000","last_undegraded":"2024-09-22T03:59:45.078702+0000","last_fullsized":"2024-09-22T03:59:45.078702+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":448,"num_object_clones":0,"num_object_copies":1344,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":448,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":184,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:59:27.767421+0000","last_change":"2024-09-22T03:49:17.029128+0000","last_active":"2024-09-22T03:59:27.767421+0000","last_peered":"2024-09-22T03:59:27.767421+0000","last_clean":"2024-09-22T03:59:27.767421+0000","last_became_active":"2024-09-22T03:49:15.113396+0000","last_became_peered":"2024-09-22T03:49:15.113396+0000","last_unstale":"2024-09-22T03:59:27.767421+0000","last_undegraded":"2024-09-22T03:59:27.767421+0000","last_fullsized":"2024-09-22T03:59:27.767421+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":450101248,"num_objects":6868,"num_object_clones":0,"num_object_copies":20604,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6868,"num_write_kb":439552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":84074496,"data_stored":1345191936,"data_compressed":63873582,"data_compressed_allocated":84074496,"data_compressed_original":1345191936,"omap_allocated":0,"internal_metadata":0},"log_size":6868,"ondisk_log_size":6868,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949673593,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":124632,"kb_used_data":21448,"kb_used_omap":0,"kb_used_meta":103168,"kb_avail":94247208,"statfs":{"total":96636764160,"available":96509140992,"internally_reserved":0,"allocated":21962752,"data_stored":341470475,"data_compressed":16205402,"data_compressed_allocated":21331968,"data_compressed_original":341229568,"omap_allocated":0,"internal_metadata":105644032},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654706297,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":123656,"kb_used_data":20472,"kb_used_omap":0,"kb_used_meta":103168,"kb_avail":94248184,"statfs":{"total":96636764160,"available":96510140416,"internally_reserved":0,"allocated":20963328,"data_stored":325872363,"data_compressed":15462680,"data_compressed_allocated":20353024,"data_compressed_original":325648384,"omap_allocated":0,"internal_metadata":105644032},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706297,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":125280,"kb_used_data":22092,"kb_used_omap":0,"kb_used_meta":103168,"kb_avail":94246560,"statfs":{"total":96636764160,"available":96508477440,"internally_reserved":0,"allocated":22622208,"data_stored":352021771,"data_compressed":16706378,"data_compressed_allocated":21991424,"data_compressed_original":351780864,"omap_allocated":0,"internal_metadata":105644032},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706297,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":117932,"kb_used_data":18908,"kb_used_omap":0,"kb_used_meta":99008,"kb_avail":94253908,"statfs":{"total":96636764160,"available":96516001792,"internally_reserved":0,"allocated":19361792,"data_stored":299920632,"data_compressed":14232458,"data_compressed_allocated":18735104,"data_compressed_original":299679744,"omap_allocated":0,"internal_metadata":101384192},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":19062784,"data_stored":305004544,"data_compressed":14482482,"data_compressed_allocated":19062784,"data_compressed_original":305004544,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":21774336,"data_stored":348389376,"data_compressed":16542562,"data_compressed_allocated":21774336,"data_compressed_original":348389376,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":22343680,"data_stored":357498880,"data_compressed":16975074,"data_compressed_allocated":22343680,"data_compressed_original":357498880,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20893696,"data_stored":334299136,"data_compressed":15873464,"data_compressed_allocated":20893696,"data_compressed_original":334299136,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:59:50.261 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 39 16 7782 7766 12.4444 11.25 0.0896762 0.0802436 2024-09-22T03:59:50.407 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:59:50.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:59:50.529+0000 7fe465f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:59:50.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:59:50.582+0000 7fe465f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:59:51.261 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:2024-09-22T03:59:51.260710+0000 min lat: 0.0159369 max lat: 0.255428 avg lat: 0.0805864 2024-09-22T03:59:51.261 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-22T03:59:51.261 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 40 16 7953 7937 12.4004 10.6875 0.0684662 0.0805864 2024-09-22T03:59:52.261 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 41 16 8145 8129 12.3906 12 0.078271 0.0805957 2024-09-22T03:59:53.062 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:59:53.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:59:53.224+0000 7f8769791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:59:53.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:59:53.234+0000 7f8769791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:59:53.261 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 42 16 8333 8317 12.3754 11.75 0.0806057 0.0806799 2024-09-22T03:59:54.261 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 43 16 8527 8511 12.3695 12.125 0.0984912 0.0807365 2024-09-22T03:59:54.981 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:59:54.981 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:59:54.981 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:59:55.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:59:55.142+0000 7fe281f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:59:55.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:59:55.156+0000 7fe281f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:59:55.261 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 44 16 8716 8700 12.3568 11.8125 0.0721318 0.080819 2024-09-22T03:59:55.490 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T03:59:55.491 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-22T03:59:55.511 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":388,"stamp":"2024-09-22T03:59:55.098646+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":512950835,"num_objects":7822,"num_object_clones":0,"num_object_copies":23466,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":7899,"num_write_kb":501460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7873,"ondisk_log_size":7873,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":515696,"kb_used_data":94640,"kb_used_omap":0,"kb_used_meta":420992,"kb_avail":376971664,"statfs":{"total":386547056640,"available":386018983936,"internally_reserved":0,"allocated":96911360,"data_stored":1511305721,"data_compressed":71725078,"data_compressed_allocated":94412800,"data_compressed_original":1510359040,"omap_allocated":0,"internal_metadata":431095808},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":125960192,"num_objects":1922,"num_object_clones":0,"num_object_copies":5766,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1922,"num_write_kb":123008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002576"},"pg_stats":[{"pgid":"6.f","version":"72'524","reported_seq":548,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:59:51.157903+0000","last_change":"2024-09-22T03:59:10.330036+0000","last_active":"2024-09-22T03:59:51.157903+0000","last_peered":"2024-09-22T03:59:51.157903+0000","last_clean":"2024-09-22T03:59:51.157903+0000","last_became_active":"2024-09-22T03:59:10.319097+0000","last_became_peered":"2024-09-22T03:59:10.319097+0000","last_unstale":"2024-09-22T03:59:51.157903+0000","last_undegraded":"2024-09-22T03:59:51.157903+0000","last_fullsized":"2024-09-22T03:59:51.157903+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":524,"log_dups_size":0,"ondisk_log_size":524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34340864,"num_objects":524,"num_object_clones":0,"num_object_copies":1572,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":524,"num_write_kb":33536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"72'485","reported_seq":509,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:59:50.113278+0000","last_change":"2024-09-22T03:59:10.321450+0000","last_active":"2024-09-22T03:59:50.113278+0000","last_peered":"2024-09-22T03:59:50.113278+0000","last_clean":"2024-09-22T03:59:50.113278+0000","last_became_active":"2024-09-22T03:59:10.311447+0000","last_became_peered":"2024-09-22T03:59:10.311447+0000","last_unstale":"2024-09-22T03:59:50.113278+0000","last_undegraded":"2024-09-22T03:59:50.113278+0000","last_fullsized":"2024-09-22T03:59:50.113278+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31784960,"num_objects":485,"num_object_clones":0,"num_object_copies":1455,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":485,"num_write_kb":31040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"72'468","reported_seq":492,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:59:49.984492+0000","last_change":"2024-09-22T03:59:10.349259+0000","last_active":"2024-09-22T03:59:49.984492+0000","last_peered":"2024-09-22T03:59:49.984492+0000","last_clean":"2024-09-22T03:59:49.984492+0000","last_became_active":"2024-09-22T03:59:10.341464+0000","last_became_peered":"2024-09-22T03:59:10.341464+0000","last_unstale":"2024-09-22T03:59:49.984492+0000","last_undegraded":"2024-09-22T03:59:49.984492+0000","last_fullsized":"2024-09-22T03:59:49.984492+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30670848,"num_objects":468,"num_object_clones":0,"num_object_copies":1404,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":468,"num_write_kb":29952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"72'471","reported_seq":495,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:59:51.202487+0000","last_change":"2024-09-22T03:59:10.365539+0000","last_active":"2024-09-22T03:59:51.202487+0000","last_peered":"2024-09-22T03:59:51.202487+0000","last_clean":"2024-09-22T03:59:51.202487+0000","last_became_active":"2024-09-22T03:59:10.339689+0000","last_became_peered":"2024-09-22T03:59:10.339689+0000","last_unstale":"2024-09-22T03:59:51.202487+0000","last_undegraded":"2024-09-22T03:59:51.202487+0000","last_fullsized":"2024-09-22T03:59:51.202487+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30867456,"num_objects":471,"num_object_clones":0,"num_object_copies":1413,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":471,"num_write_kb":30144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"72'468","reported_seq":492,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:59:50.065672+0000","last_change":"2024-09-22T03:59:10.331496+0000","last_active":"2024-09-22T03:59:50.065672+0000","last_peered":"2024-09-22T03:59:50.065672+0000","last_clean":"2024-09-22T03:59:50.065672+0000","last_became_active":"2024-09-22T03:59:10.322922+0000","last_became_peered":"2024-09-22T03:59:10.322922+0000","last_unstale":"2024-09-22T03:59:50.065672+0000","last_undegraded":"2024-09-22T03:59:50.065672+0000","last_fullsized":"2024-09-22T03:59:50.065672+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30670848,"num_objects":468,"num_object_clones":0,"num_object_copies":1404,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":468,"num_write_kb":29952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.a","version":"72'426","reported_seq":450,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:59:50.150887+0000","last_change":"2024-09-22T03:59:10.268812+0000","last_active":"2024-09-22T03:59:50.150887+0000","last_peered":"2024-09-22T03:59:50.150887+0000","last_clean":"2024-09-22T03:59:50.150887+0000","last_became_active":"2024-09-22T03:59:10.261529+0000","last_became_peered":"2024-09-22T03:59:10.261529+0000","last_unstale":"2024-09-22T03:59:50.150887+0000","last_undegraded":"2024-09-22T03:59:50.150887+0000","last_fullsized":"2024-09-22T03:59:50.150887+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27918336,"num_objects":426,"num_object_clones":0,"num_object_copies":1278,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":426,"num_write_kb":27264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"72'496","reported_seq":520,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:59:49.946304+0000","last_change":"2024-09-22T03:59:10.357775+0000","last_active":"2024-09-22T03:59:49.946304+0000","last_peered":"2024-09-22T03:59:49.946304+0000","last_clean":"2024-09-22T03:59:49.946304+0000","last_became_active":"2024-09-22T03:59:10.350219+0000","last_became_peered":"2024-09-22T03:59:10.350219+0000","last_unstale":"2024-09-22T03:59:49.946304+0000","last_undegraded":"2024-09-22T03:59:49.946304+0000","last_fullsized":"2024-09-22T03:59:49.946304+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":496,"log_dups_size":0,"ondisk_log_size":496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32505856,"num_objects":496,"num_object_clones":0,"num_object_copies":1488,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":496,"num_write_kb":31744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"72'474","reported_seq":498,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:59:49.965483+0000","last_change":"2024-09-22T03:59:10.302834+0000","last_active":"2024-09-22T03:59:49.965483+0000","last_peered":"2024-09-22T03:59:49.965483+0000","last_clean":"2024-09-22T03:59:49.965483+0000","last_became_active":"2024-09-22T03:59:10.294403+0000","last_became_peered":"2024-09-22T03:59:10.294403+0000","last_unstale":"2024-09-22T03:59:49.965483+0000","last_undegraded":"2024-09-22T03:59:49.965483+0000","last_fullsized":"2024-09-22T03:59:49.965483+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":474,"log_dups_size":0,"ondisk_log_size":474,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31064064,"num_objects":474,"num_object_clones":0,"num_object_copies":1422,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":474,"num_write_kb":30336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"72'504","reported_seq":528,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:59:50.006164+0000","last_change":"2024-09-22T03:59:10.311620+0000","last_active":"2024-09-22T03:59:50.006164+0000","last_peered":"2024-09-22T03:59:50.006164+0000","last_clean":"2024-09-22T03:59:50.006164+0000","last_became_active":"2024-09-22T03:59:10.304722+0000","last_became_peered":"2024-09-22T03:59:10.304722+0000","last_unstale":"2024-09-22T03:59:50.006164+0000","last_undegraded":"2024-09-22T03:59:50.006164+0000","last_fullsized":"2024-09-22T03:59:50.006164+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":504,"log_dups_size":0,"ondisk_log_size":504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33030144,"num_objects":504,"num_object_clones":0,"num_object_copies":1512,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":504,"num_write_kb":32256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":259,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:59:27.749571+0000","last_change":"2024-09-22T03:49:12.034704+0000","last_active":"2024-09-22T03:59:27.749571+0000","last_peered":"2024-09-22T03:59:27.749571+0000","last_clean":"2024-09-22T03:59:27.749571+0000","last_became_active":"2024-09-22T03:49:12.027470+0000","last_became_peered":"2024-09-22T03:49:12.027470+0000","last_unstale":"2024-09-22T03:59:27.749571+0000","last_undegraded":"2024-09-22T03:59:27.749571+0000","last_fullsized":"2024-09-22T03:59:27.749571+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_clean_scrub_stamp":"2024-09-22T03:49:10.979949+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":185,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:59:27.767983+0000","last_change":"2024-09-22T03:49:17.031458+0000","last_active":"2024-09-22T03:59:27.767983+0000","last_peered":"2024-09-22T03:59:27.767983+0000","last_clean":"2024-09-22T03:59:27.767983+0000","last_became_active":"2024-09-22T03:49:15.125490+0000","last_became_peered":"2024-09-22T03:49:15.125490+0000","last_unstale":"2024-09-22T03:59:27.767983+0000","last_undegraded":"2024-09-22T03:59:27.767983+0000","last_fullsized":"2024-09-22T03:59:27.767983+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"72'529","reported_seq":553,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:59:51.165711+0000","last_change":"2024-09-22T03:59:10.355702+0000","last_active":"2024-09-22T03:59:51.165711+0000","last_peered":"2024-09-22T03:59:51.165711+0000","last_clean":"2024-09-22T03:59:51.165711+0000","last_became_active":"2024-09-22T03:59:10.330418+0000","last_became_peered":"2024-09-22T03:59:10.330418+0000","last_unstale":"2024-09-22T03:59:51.165711+0000","last_undegraded":"2024-09-22T03:59:51.165711+0000","last_fullsized":"2024-09-22T03:59:51.165711+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":529,"log_dups_size":0,"ondisk_log_size":529,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34668544,"num_objects":529,"num_object_clones":0,"num_object_copies":1587,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":529,"num_write_kb":33856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":184,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:59:27.768540+0000","last_change":"2024-09-22T03:49:17.029339+0000","last_active":"2024-09-22T03:59:27.768540+0000","last_peered":"2024-09-22T03:59:27.768540+0000","last_clean":"2024-09-22T03:59:27.768540+0000","last_became_active":"2024-09-22T03:49:15.097304+0000","last_became_peered":"2024-09-22T03:49:15.097304+0000","last_unstale":"2024-09-22T03:59:27.768540+0000","last_undegraded":"2024-09-22T03:59:27.768540+0000","last_fullsized":"2024-09-22T03:59:27.768540+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.5","version":"72'513","reported_seq":537,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:59:50.060112+0000","last_change":"2024-09-22T03:59:10.300610+0000","last_active":"2024-09-22T03:59:50.060112+0000","last_peered":"2024-09-22T03:59:50.060112+0000","last_clean":"2024-09-22T03:59:50.060112+0000","last_became_active":"2024-09-22T03:59:10.293587+0000","last_became_peered":"2024-09-22T03:59:10.293587+0000","last_unstale":"2024-09-22T03:59:50.060112+0000","last_undegraded":"2024-09-22T03:59:50.060112+0000","last_fullsized":"2024-09-22T03:59:50.060112+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":513,"log_dups_size":0,"ondisk_log_size":513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33619968,"num_objects":513,"num_object_clones":0,"num_object_copies":1539,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":513,"num_write_kb":32832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":184,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:59:27.767507+0000","last_change":"2024-09-22T03:49:17.029349+0000","last_active":"2024-09-22T03:59:27.767507+0000","last_peered":"2024-09-22T03:59:27.767507+0000","last_clean":"2024-09-22T03:59:27.767507+0000","last_became_active":"2024-09-22T03:49:15.094890+0000","last_became_peered":"2024-09-22T03:49:15.094890+0000","last_unstale":"2024-09-22T03:59:27.767507+0000","last_undegraded":"2024-09-22T03:59:27.767507+0000","last_fullsized":"2024-09-22T03:59:27.767507+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"72'522","reported_seq":546,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:59:51.137069+0000","last_change":"2024-09-22T03:59:10.359896+0000","last_active":"2024-09-22T03:59:51.137069+0000","last_peered":"2024-09-22T03:59:51.137069+0000","last_clean":"2024-09-22T03:59:51.137069+0000","last_became_active":"2024-09-22T03:59:10.342929+0000","last_became_peered":"2024-09-22T03:59:10.342929+0000","last_unstale":"2024-09-22T03:59:51.137069+0000","last_undegraded":"2024-09-22T03:59:51.137069+0000","last_fullsized":"2024-09-22T03:59:51.137069+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":522,"log_dups_size":0,"ondisk_log_size":522,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34209792,"num_objects":522,"num_object_clones":0,"num_object_copies":1566,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":522,"num_write_kb":33408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":186,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:59:27.773632+0000","last_change":"2024-09-22T03:49:17.031466+0000","last_active":"2024-09-22T03:59:27.773632+0000","last_peered":"2024-09-22T03:59:27.773632+0000","last_clean":"2024-09-22T03:59:27.773632+0000","last_became_active":"2024-09-22T03:49:15.098420+0000","last_became_peered":"2024-09-22T03:49:15.098420+0000","last_unstale":"2024-09-22T03:59:27.773632+0000","last_undegraded":"2024-09-22T03:59:27.773632+0000","last_fullsized":"2024-09-22T03:59:27.773632+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.0","version":"72'496","reported_seq":520,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:59:50.101871+0000","last_change":"2024-09-22T03:59:10.339795+0000","last_active":"2024-09-22T03:59:50.101871+0000","last_peered":"2024-09-22T03:59:50.101871+0000","last_clean":"2024-09-22T03:59:50.101871+0000","last_became_active":"2024-09-22T03:59:10.325306+0000","last_became_peered":"2024-09-22T03:59:10.325306+0000","last_unstale":"2024-09-22T03:59:50.101871+0000","last_undegraded":"2024-09-22T03:59:50.101871+0000","last_fullsized":"2024-09-22T03:59:50.101871+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":496,"log_dups_size":0,"ondisk_log_size":496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32505856,"num_objects":496,"num_object_clones":0,"num_object_copies":1488,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":496,"num_write_kb":31744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":184,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:59:27.761988+0000","last_change":"2024-09-22T03:49:17.036954+0000","last_active":"2024-09-22T03:59:27.761988+0000","last_peered":"2024-09-22T03:59:27.761988+0000","last_clean":"2024-09-22T03:59:27.761988+0000","last_became_active":"2024-09-22T03:49:15.110506+0000","last_became_peered":"2024-09-22T03:49:15.110506+0000","last_unstale":"2024-09-22T03:59:27.761988+0000","last_undegraded":"2024-09-22T03:59:27.761988+0000","last_fullsized":"2024-09-22T03:59:27.761988+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"72'481","reported_seq":505,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:59:51.062477+0000","last_change":"2024-09-22T03:59:10.361108+0000","last_active":"2024-09-22T03:59:51.062477+0000","last_peered":"2024-09-22T03:59:51.062477+0000","last_clean":"2024-09-22T03:59:51.062477+0000","last_became_active":"2024-09-22T03:59:10.347213+0000","last_became_peered":"2024-09-22T03:59:10.347213+0000","last_unstale":"2024-09-22T03:59:51.062477+0000","last_undegraded":"2024-09-22T03:59:51.062477+0000","last_fullsized":"2024-09-22T03:59:51.062477+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":481,"log_dups_size":0,"ondisk_log_size":481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31522816,"num_objects":481,"num_object_clones":0,"num_object_copies":1443,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":481,"num_write_kb":30784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":184,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:59:27.752229+0000","last_change":"2024-09-22T03:49:17.032989+0000","last_active":"2024-09-22T03:59:27.752229+0000","last_peered":"2024-09-22T03:59:27.752229+0000","last_clean":"2024-09-22T03:59:27.752229+0000","last_became_active":"2024-09-22T03:49:15.079260+0000","last_became_peered":"2024-09-22T03:49:15.079260+0000","last_unstale":"2024-09-22T03:59:27.752229+0000","last_undegraded":"2024-09-22T03:59:27.752229+0000","last_fullsized":"2024-09-22T03:59:27.752229+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2","version":"72'459","reported_seq":483,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:59:49.780742+0000","last_change":"2024-09-22T03:59:10.318033+0000","last_active":"2024-09-22T03:59:49.780742+0000","last_peered":"2024-09-22T03:59:49.780742+0000","last_clean":"2024-09-22T03:59:49.780742+0000","last_became_active":"2024-09-22T03:59:10.308707+0000","last_became_peered":"2024-09-22T03:59:10.308707+0000","last_unstale":"2024-09-22T03:59:49.780742+0000","last_undegraded":"2024-09-22T03:59:49.780742+0000","last_fullsized":"2024-09-22T03:59:49.780742+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30081024,"num_objects":459,"num_object_clones":0,"num_object_copies":1377,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":459,"num_write_kb":29376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":184,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:59:27.758487+0000","last_change":"2024-09-22T03:49:17.036402+0000","last_active":"2024-09-22T03:59:27.758487+0000","last_peered":"2024-09-22T03:59:27.758487+0000","last_clean":"2024-09-22T03:59:27.758487+0000","last_became_active":"2024-09-22T03:49:15.108430+0000","last_became_peered":"2024-09-22T03:49:15.108430+0000","last_unstale":"2024-09-22T03:59:27.758487+0000","last_undegraded":"2024-09-22T03:59:27.758487+0000","last_fullsized":"2024-09-22T03:59:27.758487+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"72'502","reported_seq":526,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:59:50.112864+0000","last_change":"2024-09-22T03:59:10.277817+0000","last_active":"2024-09-22T03:59:50.112864+0000","last_peered":"2024-09-22T03:59:50.112864+0000","last_clean":"2024-09-22T03:59:50.112864+0000","last_became_active":"2024-09-22T03:59:10.263119+0000","last_became_peered":"2024-09-22T03:59:10.263119+0000","last_unstale":"2024-09-22T03:59:50.112864+0000","last_undegraded":"2024-09-22T03:59:50.112864+0000","last_fullsized":"2024-09-22T03:59:50.112864+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":502,"log_dups_size":0,"ondisk_log_size":502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32899072,"num_objects":502,"num_object_clones":0,"num_object_copies":1506,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":502,"num_write_kb":32128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":184,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:59:27.767421+0000","last_change":"2024-09-22T03:49:17.029128+0000","last_active":"2024-09-22T03:59:27.767421+0000","last_peered":"2024-09-22T03:59:27.767421+0000","last_clean":"2024-09-22T03:59:27.767421+0000","last_became_active":"2024-09-22T03:49:15.113396+0000","last_became_peered":"2024-09-22T03:49:15.113396+0000","last_unstale":"2024-09-22T03:59:27.767421+0000","last_undegraded":"2024-09-22T03:59:27.767421+0000","last_fullsized":"2024-09-22T03:59:27.767421+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":512360448,"num_objects":7818,"num_object_clones":0,"num_object_copies":23454,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7818,"num_write_kb":500352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":95887360,"data_stored":1534197760,"data_compressed":72848590,"data_compressed_allocated":95887360,"data_compressed_original":1534197760,"omap_allocated":0,"internal_metadata":0},"log_size":7818,"ondisk_log_size":7818,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949673598,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":127596,"kb_used_data":24412,"kb_used_omap":0,"kb_used_meta":103168,"kb_avail":94244244,"statfs":{"total":96636764160,"available":96506105856,"internally_reserved":0,"allocated":24997888,"data_stored":390032651,"data_compressed":18511394,"data_compressed_allocated":24367104,"data_compressed_original":389791744,"omap_allocated":0,"internal_metadata":105644032},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654706302,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":130796,"kb_used_data":23452,"kb_used_omap":0,"kb_used_meta":107328,"kb_avail":94241044,"statfs":{"total":96636764160,"available":96502829056,"internally_reserved":0,"allocated":24014848,"data_stored":374696683,"data_compressed":17781120,"data_compressed_allocated":23404544,"data_compressed_original":374472704,"omap_allocated":0,"internal_metadata":109903872},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706302,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":132616,"kb_used_data":25272,"kb_used_omap":0,"kb_used_meta":107328,"kb_avail":94239224,"statfs":{"total":96636764160,"available":96500965376,"internally_reserved":0,"allocated":25878528,"data_stored":404122891,"data_compressed":19180418,"data_compressed_allocated":25247744,"data_compressed_original":403881984,"omap_allocated":0,"internal_metadata":109903872},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706302,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":124688,"kb_used_data":21504,"kb_used_omap":0,"kb_used_meta":103168,"kb_avail":94247152,"statfs":{"total":96636764160,"available":96509083648,"internally_reserved":0,"allocated":22020096,"data_stored":342453496,"data_compressed":16252146,"data_compressed_allocated":21393408,"data_compressed_original":342212608,"omap_allocated":0,"internal_metadata":105644032},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":21696512,"data_stored":347144192,"data_compressed":16483498,"data_compressed_allocated":21696512,"data_compressed_original":347144192,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24686592,"data_stored":394985472,"data_compressed":18755194,"data_compressed_allocated":24686592,"data_compressed_original":394985472,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":25554944,"data_stored":408879104,"data_compressed":19414882,"data_compressed_allocated":25554944,"data_compressed_original":408879104,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":23949312,"data_stored":383188992,"data_compressed":18195016,"data_compressed_allocated":23949312,"data_compressed_original":383188992,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:59:55.682 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:59:55.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:59:55.836+0000 7f2998391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:59:55.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:59:55.847+0000 7f2998391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:59:56.261 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 45 16 8904 8888 12.3433 11.75 0.121459 0.0809097 2024-09-22T03:59:57.261 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 46 16 9097 9081 12.3372 12.0625 0.091666 0.0809748 2024-09-22T03:59:58.244 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:59:58.261 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 47 16 9294 9278 12.3366 12.3125 0.0571525 0.0809966 2024-09-22T03:59:58.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:59:58.401+0000 7f8298f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:59:58.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T03:59:58.414+0000 7f8298f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:59:59.261 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 48 16 9473 9457 12.3127 11.1875 0.0302653 0.0811139 2024-09-22T04:00:00.261 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 49 15 9659 9644 12.2999 11.6875 0.184425 0.0811827 2024-09-22T04:00:00.513 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T04:00:00.513 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T04:00:00.513 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T04:00:00.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:00:00.687+0000 7fd70d991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:00.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:00:00.702+0000 7fd70d991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:01.021 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T04:00:01.022 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-22T04:00:01.043 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":390,"stamp":"2024-09-22T03:59:59.099534+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":575144499,"num_objects":8771,"num_object_clones":0,"num_object_copies":26313,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":8848,"num_write_kb":562196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8822,"ondisk_log_size":8822,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":535264,"kb_used_data":105888,"kb_used_omap":0,"kb_used_meta":429312,"kb_avail":376952096,"statfs":{"total":386547056640,"available":385998946304,"internally_reserved":0,"allocated":108429312,"data_stored":1695592953,"data_compressed":80476022,"data_compressed_allocated":105930752,"data_compressed_original":1694646272,"omap_allocated":0,"internal_metadata":439615488},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":124452864,"num_objects":1899,"num_object_clones":0,"num_object_copies":5697,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1899,"num_write_kb":121536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002588"},"pg_stats":[{"pgid":"6.f","version":"72'584","reported_seq":608,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:59:56.222500+0000","last_change":"2024-09-22T03:59:10.330036+0000","last_active":"2024-09-22T03:59:56.222500+0000","last_peered":"2024-09-22T03:59:56.222500+0000","last_clean":"2024-09-22T03:59:56.222500+0000","last_became_active":"2024-09-22T03:59:10.319097+0000","last_became_peered":"2024-09-22T03:59:10.319097+0000","last_unstale":"2024-09-22T03:59:56.222500+0000","last_undegraded":"2024-09-22T03:59:56.222500+0000","last_fullsized":"2024-09-22T03:59:56.222500+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":584,"log_dups_size":0,"ondisk_log_size":584,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38273024,"num_objects":584,"num_object_clones":0,"num_object_copies":1752,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":584,"num_write_kb":37376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"72'563","reported_seq":587,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:59:55.033288+0000","last_change":"2024-09-22T03:59:10.321450+0000","last_active":"2024-09-22T03:59:55.033288+0000","last_peered":"2024-09-22T03:59:55.033288+0000","last_clean":"2024-09-22T03:59:55.033288+0000","last_became_active":"2024-09-22T03:59:10.311447+0000","last_became_peered":"2024-09-22T03:59:10.311447+0000","last_unstale":"2024-09-22T03:59:55.033288+0000","last_undegraded":"2024-09-22T03:59:55.033288+0000","last_fullsized":"2024-09-22T03:59:55.033288+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":563,"log_dups_size":0,"ondisk_log_size":563,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36896768,"num_objects":563,"num_object_clones":0,"num_object_copies":1689,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":563,"num_write_kb":36032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"72'530","reported_seq":554,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:59:55.007398+0000","last_change":"2024-09-22T03:59:10.349259+0000","last_active":"2024-09-22T03:59:55.007398+0000","last_peered":"2024-09-22T03:59:55.007398+0000","last_clean":"2024-09-22T03:59:55.007398+0000","last_became_active":"2024-09-22T03:59:10.341464+0000","last_became_peered":"2024-09-22T03:59:10.341464+0000","last_unstale":"2024-09-22T03:59:55.007398+0000","last_undegraded":"2024-09-22T03:59:55.007398+0000","last_fullsized":"2024-09-22T03:59:55.007398+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":530,"log_dups_size":0,"ondisk_log_size":530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34734080,"num_objects":530,"num_object_clones":0,"num_object_copies":1590,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":530,"num_write_kb":33920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"72'521","reported_seq":545,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:59:55.973371+0000","last_change":"2024-09-22T03:59:10.365539+0000","last_active":"2024-09-22T03:59:55.973371+0000","last_peered":"2024-09-22T03:59:55.973371+0000","last_clean":"2024-09-22T03:59:55.973371+0000","last_became_active":"2024-09-22T03:59:10.339689+0000","last_became_peered":"2024-09-22T03:59:10.339689+0000","last_unstale":"2024-09-22T03:59:55.973371+0000","last_undegraded":"2024-09-22T03:59:55.973371+0000","last_fullsized":"2024-09-22T03:59:55.973371+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":521,"log_dups_size":0,"ondisk_log_size":521,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34144256,"num_objects":521,"num_object_clones":0,"num_object_copies":1563,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":521,"num_write_kb":33344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"72'520","reported_seq":544,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:59:55.027558+0000","last_change":"2024-09-22T03:59:10.331496+0000","last_active":"2024-09-22T03:59:55.027558+0000","last_peered":"2024-09-22T03:59:55.027558+0000","last_clean":"2024-09-22T03:59:55.027558+0000","last_became_active":"2024-09-22T03:59:10.322922+0000","last_became_peered":"2024-09-22T03:59:10.322922+0000","last_unstale":"2024-09-22T03:59:55.027558+0000","last_undegraded":"2024-09-22T03:59:55.027558+0000","last_fullsized":"2024-09-22T03:59:55.027558+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":520,"log_dups_size":0,"ondisk_log_size":520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34078720,"num_objects":520,"num_object_clones":0,"num_object_copies":1560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":520,"num_write_kb":33280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.a","version":"72'498","reported_seq":522,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:59:55.138986+0000","last_change":"2024-09-22T03:59:10.268812+0000","last_active":"2024-09-22T03:59:55.138986+0000","last_peered":"2024-09-22T03:59:55.138986+0000","last_clean":"2024-09-22T03:59:55.138986+0000","last_became_active":"2024-09-22T03:59:10.261529+0000","last_became_peered":"2024-09-22T03:59:10.261529+0000","last_unstale":"2024-09-22T03:59:55.138986+0000","last_undegraded":"2024-09-22T03:59:55.138986+0000","last_fullsized":"2024-09-22T03:59:55.138986+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":498,"log_dups_size":0,"ondisk_log_size":498,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32636928,"num_objects":498,"num_object_clones":0,"num_object_copies":1494,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":498,"num_write_kb":31872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"72'553","reported_seq":577,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:59:55.021591+0000","last_change":"2024-09-22T03:59:10.357775+0000","last_active":"2024-09-22T03:59:55.021591+0000","last_peered":"2024-09-22T03:59:55.021591+0000","last_clean":"2024-09-22T03:59:55.021591+0000","last_became_active":"2024-09-22T03:59:10.350219+0000","last_became_peered":"2024-09-22T03:59:10.350219+0000","last_unstale":"2024-09-22T03:59:55.021591+0000","last_undegraded":"2024-09-22T03:59:55.021591+0000","last_fullsized":"2024-09-22T03:59:55.021591+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":553,"log_dups_size":0,"ondisk_log_size":553,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36241408,"num_objects":553,"num_object_clones":0,"num_object_copies":1659,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":553,"num_write_kb":35392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"72'528","reported_seq":552,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:59:54.852690+0000","last_change":"2024-09-22T03:59:10.302834+0000","last_active":"2024-09-22T03:59:54.852690+0000","last_peered":"2024-09-22T03:59:54.852690+0000","last_clean":"2024-09-22T03:59:54.852690+0000","last_became_active":"2024-09-22T03:59:10.294403+0000","last_became_peered":"2024-09-22T03:59:10.294403+0000","last_unstale":"2024-09-22T03:59:54.852690+0000","last_undegraded":"2024-09-22T03:59:54.852690+0000","last_fullsized":"2024-09-22T03:59:54.852690+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34603008,"num_objects":528,"num_object_clones":0,"num_object_copies":1584,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":528,"num_write_kb":33792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"72'573","reported_seq":597,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:59:54.788965+0000","last_change":"2024-09-22T03:59:10.311620+0000","last_active":"2024-09-22T03:59:54.788965+0000","last_peered":"2024-09-22T03:59:54.788965+0000","last_clean":"2024-09-22T03:59:54.788965+0000","last_became_active":"2024-09-22T03:59:10.304722+0000","last_became_peered":"2024-09-22T03:59:10.304722+0000","last_unstale":"2024-09-22T03:59:54.788965+0000","last_undegraded":"2024-09-22T03:59:54.788965+0000","last_fullsized":"2024-09-22T03:59:54.788965+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":573,"log_dups_size":0,"ondisk_log_size":573,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37552128,"num_objects":573,"num_object_clones":0,"num_object_copies":1719,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":573,"num_write_kb":36672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":259,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:59:27.749571+0000","last_change":"2024-09-22T03:49:12.034704+0000","last_active":"2024-09-22T03:59:27.749571+0000","last_peered":"2024-09-22T03:59:27.749571+0000","last_clean":"2024-09-22T03:59:27.749571+0000","last_became_active":"2024-09-22T03:49:12.027470+0000","last_became_peered":"2024-09-22T03:49:12.027470+0000","last_unstale":"2024-09-22T03:59:27.749571+0000","last_undegraded":"2024-09-22T03:59:27.749571+0000","last_fullsized":"2024-09-22T03:59:27.749571+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_clean_scrub_stamp":"2024-09-22T03:49:10.979949+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":185,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:59:27.767983+0000","last_change":"2024-09-22T03:49:17.031458+0000","last_active":"2024-09-22T03:59:27.767983+0000","last_peered":"2024-09-22T03:59:27.767983+0000","last_clean":"2024-09-22T03:59:27.767983+0000","last_became_active":"2024-09-22T03:49:15.125490+0000","last_became_peered":"2024-09-22T03:49:15.125490+0000","last_unstale":"2024-09-22T03:59:27.767983+0000","last_undegraded":"2024-09-22T03:59:27.767983+0000","last_fullsized":"2024-09-22T03:59:27.767983+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"72'589","reported_seq":613,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:59:56.100706+0000","last_change":"2024-09-22T03:59:10.355702+0000","last_active":"2024-09-22T03:59:56.100706+0000","last_peered":"2024-09-22T03:59:56.100706+0000","last_clean":"2024-09-22T03:59:56.100706+0000","last_became_active":"2024-09-22T03:59:10.330418+0000","last_became_peered":"2024-09-22T03:59:10.330418+0000","last_unstale":"2024-09-22T03:59:56.100706+0000","last_undegraded":"2024-09-22T03:59:56.100706+0000","last_fullsized":"2024-09-22T03:59:56.100706+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":589,"log_dups_size":0,"ondisk_log_size":589,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38600704,"num_objects":589,"num_object_clones":0,"num_object_copies":1767,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":589,"num_write_kb":37696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":184,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:59:27.768540+0000","last_change":"2024-09-22T03:49:17.029339+0000","last_active":"2024-09-22T03:59:27.768540+0000","last_peered":"2024-09-22T03:59:27.768540+0000","last_clean":"2024-09-22T03:59:27.768540+0000","last_became_active":"2024-09-22T03:49:15.097304+0000","last_became_peered":"2024-09-22T03:49:15.097304+0000","last_unstale":"2024-09-22T03:59:27.768540+0000","last_undegraded":"2024-09-22T03:59:27.768540+0000","last_fullsized":"2024-09-22T03:59:27.768540+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.5","version":"72'560","reported_seq":584,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:59:55.051652+0000","last_change":"2024-09-22T03:59:10.300610+0000","last_active":"2024-09-22T03:59:55.051652+0000","last_peered":"2024-09-22T03:59:55.051652+0000","last_clean":"2024-09-22T03:59:55.051652+0000","last_became_active":"2024-09-22T03:59:10.293587+0000","last_became_peered":"2024-09-22T03:59:10.293587+0000","last_unstale":"2024-09-22T03:59:55.051652+0000","last_undegraded":"2024-09-22T03:59:55.051652+0000","last_fullsized":"2024-09-22T03:59:55.051652+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":560,"log_dups_size":0,"ondisk_log_size":560,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36700160,"num_objects":560,"num_object_clones":0,"num_object_copies":1680,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":560,"num_write_kb":35840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":184,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:59:27.767507+0000","last_change":"2024-09-22T03:49:17.029349+0000","last_active":"2024-09-22T03:59:27.767507+0000","last_peered":"2024-09-22T03:59:27.767507+0000","last_clean":"2024-09-22T03:59:27.767507+0000","last_became_active":"2024-09-22T03:49:15.094890+0000","last_became_peered":"2024-09-22T03:49:15.094890+0000","last_unstale":"2024-09-22T03:59:27.767507+0000","last_undegraded":"2024-09-22T03:59:27.767507+0000","last_fullsized":"2024-09-22T03:59:27.767507+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"72'580","reported_seq":604,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:59:56.150633+0000","last_change":"2024-09-22T03:59:10.359896+0000","last_active":"2024-09-22T03:59:56.150633+0000","last_peered":"2024-09-22T03:59:56.150633+0000","last_clean":"2024-09-22T03:59:56.150633+0000","last_became_active":"2024-09-22T03:59:10.342929+0000","last_became_peered":"2024-09-22T03:59:10.342929+0000","last_unstale":"2024-09-22T03:59:56.150633+0000","last_undegraded":"2024-09-22T03:59:56.150633+0000","last_fullsized":"2024-09-22T03:59:56.150633+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":580,"log_dups_size":0,"ondisk_log_size":580,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38010880,"num_objects":580,"num_object_clones":0,"num_object_copies":1740,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":580,"num_write_kb":37120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":186,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:59:27.773632+0000","last_change":"2024-09-22T03:49:17.031466+0000","last_active":"2024-09-22T03:59:27.773632+0000","last_peered":"2024-09-22T03:59:27.773632+0000","last_clean":"2024-09-22T03:59:27.773632+0000","last_became_active":"2024-09-22T03:49:15.098420+0000","last_became_peered":"2024-09-22T03:49:15.098420+0000","last_unstale":"2024-09-22T03:59:27.773632+0000","last_undegraded":"2024-09-22T03:59:27.773632+0000","last_fullsized":"2024-09-22T03:59:27.773632+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.0","version":"72'545","reported_seq":569,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:59:55.113894+0000","last_change":"2024-09-22T03:59:10.339795+0000","last_active":"2024-09-22T03:59:55.113894+0000","last_peered":"2024-09-22T03:59:55.113894+0000","last_clean":"2024-09-22T03:59:55.113894+0000","last_became_active":"2024-09-22T03:59:10.325306+0000","last_became_peered":"2024-09-22T03:59:10.325306+0000","last_unstale":"2024-09-22T03:59:55.113894+0000","last_undegraded":"2024-09-22T03:59:55.113894+0000","last_fullsized":"2024-09-22T03:59:55.113894+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":545,"log_dups_size":0,"ondisk_log_size":545,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35717120,"num_objects":545,"num_object_clones":0,"num_object_copies":1635,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":545,"num_write_kb":34880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":184,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:59:27.761988+0000","last_change":"2024-09-22T03:49:17.036954+0000","last_active":"2024-09-22T03:59:27.761988+0000","last_peered":"2024-09-22T03:59:27.761988+0000","last_clean":"2024-09-22T03:59:27.761988+0000","last_became_active":"2024-09-22T03:49:15.110506+0000","last_became_peered":"2024-09-22T03:49:15.110506+0000","last_unstale":"2024-09-22T03:59:27.761988+0000","last_undegraded":"2024-09-22T03:59:27.761988+0000","last_fullsized":"2024-09-22T03:59:27.761988+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"72'550","reported_seq":574,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:59:56.191560+0000","last_change":"2024-09-22T03:59:10.361108+0000","last_active":"2024-09-22T03:59:56.191560+0000","last_peered":"2024-09-22T03:59:56.191560+0000","last_clean":"2024-09-22T03:59:56.191560+0000","last_became_active":"2024-09-22T03:59:10.347213+0000","last_became_peered":"2024-09-22T03:59:10.347213+0000","last_unstale":"2024-09-22T03:59:56.191560+0000","last_undegraded":"2024-09-22T03:59:56.191560+0000","last_fullsized":"2024-09-22T03:59:56.191560+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":550,"log_dups_size":0,"ondisk_log_size":550,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36044800,"num_objects":550,"num_object_clones":0,"num_object_copies":1650,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":550,"num_write_kb":35200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":184,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:59:27.752229+0000","last_change":"2024-09-22T03:49:17.032989+0000","last_active":"2024-09-22T03:59:27.752229+0000","last_peered":"2024-09-22T03:59:27.752229+0000","last_clean":"2024-09-22T03:59:27.752229+0000","last_became_active":"2024-09-22T03:49:15.079260+0000","last_became_peered":"2024-09-22T03:49:15.079260+0000","last_unstale":"2024-09-22T03:59:27.752229+0000","last_undegraded":"2024-09-22T03:59:27.752229+0000","last_fullsized":"2024-09-22T03:59:27.752229+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2","version":"72'508","reported_seq":532,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:59:54.968376+0000","last_change":"2024-09-22T03:59:10.318033+0000","last_active":"2024-09-22T03:59:54.968376+0000","last_peered":"2024-09-22T03:59:54.968376+0000","last_clean":"2024-09-22T03:59:54.968376+0000","last_became_active":"2024-09-22T03:59:10.308707+0000","last_became_peered":"2024-09-22T03:59:10.308707+0000","last_unstale":"2024-09-22T03:59:54.968376+0000","last_undegraded":"2024-09-22T03:59:54.968376+0000","last_fullsized":"2024-09-22T03:59:54.968376+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":508,"log_dups_size":0,"ondisk_log_size":508,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33292288,"num_objects":508,"num_object_clones":0,"num_object_copies":1524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":508,"num_write_kb":32512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":184,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:59:27.758487+0000","last_change":"2024-09-22T03:49:17.036402+0000","last_active":"2024-09-22T03:59:27.758487+0000","last_peered":"2024-09-22T03:59:27.758487+0000","last_clean":"2024-09-22T03:59:27.758487+0000","last_became_active":"2024-09-22T03:49:15.108430+0000","last_became_peered":"2024-09-22T03:49:15.108430+0000","last_unstale":"2024-09-22T03:59:27.758487+0000","last_undegraded":"2024-09-22T03:59:27.758487+0000","last_fullsized":"2024-09-22T03:59:27.758487+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"72'565","reported_seq":589,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:59:55.120077+0000","last_change":"2024-09-22T03:59:10.277817+0000","last_active":"2024-09-22T03:59:55.120077+0000","last_peered":"2024-09-22T03:59:55.120077+0000","last_clean":"2024-09-22T03:59:55.120077+0000","last_became_active":"2024-09-22T03:59:10.263119+0000","last_became_peered":"2024-09-22T03:59:10.263119+0000","last_unstale":"2024-09-22T03:59:55.120077+0000","last_undegraded":"2024-09-22T03:59:55.120077+0000","last_fullsized":"2024-09-22T03:59:55.120077+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":565,"log_dups_size":0,"ondisk_log_size":565,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37027840,"num_objects":565,"num_object_clones":0,"num_object_copies":1695,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":565,"num_write_kb":36160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":184,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:59:27.767421+0000","last_change":"2024-09-22T03:49:17.029128+0000","last_active":"2024-09-22T03:59:27.767421+0000","last_peered":"2024-09-22T03:59:27.767421+0000","last_clean":"2024-09-22T03:59:27.767421+0000","last_became_active":"2024-09-22T03:49:15.113396+0000","last_became_peered":"2024-09-22T03:49:15.113396+0000","last_unstale":"2024-09-22T03:59:27.767421+0000","last_undegraded":"2024-09-22T03:59:27.767421+0000","last_fullsized":"2024-09-22T03:59:27.767421+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":574554112,"num_objects":8767,"num_object_clones":0,"num_object_copies":26301,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8767,"num_write_kb":561088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":107466752,"data_stored":1719468032,"data_compressed":81646214,"data_compressed_allocated":107466752,"data_compressed_original":1719468032,"omap_allocated":0,"internal_metadata":0},"log_size":8767,"ondisk_log_size":8767,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949673603,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":134632,"kb_used_data":27288,"kb_used_omap":0,"kb_used_meta":107328,"kb_avail":94237208,"statfs":{"total":96636764160,"available":96498900992,"internally_reserved":0,"allocated":27942912,"data_stored":437153035,"data_compressed":20748922,"data_compressed_allocated":27312128,"data_compressed_original":436912128,"omap_allocated":0,"internal_metadata":109903872},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654706307,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":133612,"kb_used_data":26268,"kb_used_omap":0,"kb_used_meta":107328,"kb_avail":94238228,"statfs":{"total":96636764160,"available":96499945472,"internally_reserved":0,"allocated":26898432,"data_stored":420834027,"data_compressed":19971968,"data_compressed_allocated":26288128,"data_compressed_original":420610048,"omap_allocated":0,"internal_metadata":109903872},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706307,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":139820,"kb_used_data":28316,"kb_used_omap":0,"kb_used_meta":111488,"kb_avail":94232020,"statfs":{"total":96636764160,"available":96493588480,"internally_reserved":0,"allocated":28995584,"data_stored":453995787,"data_compressed":21548650,"data_compressed_allocated":28364800,"data_compressed_original":453754880,"omap_allocated":0,"internal_metadata":114163712},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706307,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":127200,"kb_used_data":24016,"kb_used_omap":0,"kb_used_meta":103168,"kb_avail":94244640,"statfs":{"total":96636764160,"available":96506511360,"internally_reserved":0,"allocated":24592384,"data_stored":383610104,"data_compressed":18206482,"data_compressed_allocated":23965696,"data_compressed_original":383369216,"omap_allocated":0,"internal_metadata":105644032},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24305664,"data_stored":388890624,"data_compressed":18465842,"data_compressed_allocated":24305664,"data_compressed_original":388890624,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":27660288,"data_stored":442564608,"data_compressed":21014506,"data_compressed_allocated":27660288,"data_compressed_original":442564608,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28708864,"data_stored":459341824,"data_compressed":21811122,"data_compressed_allocated":28708864,"data_compressed_original":459341824,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":26791936,"data_stored":428670976,"data_compressed":20354744,"data_compressed_allocated":26791936,"data_compressed_original":428670976,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T04:00:01.117 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T04:00:01.262 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 50 16 9844 9828 12.2839 11.5 0.137497 0.0812972 2024-09-22T04:00:01.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:00:01.275+0000 7ff5a3591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:01.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:00:01.289+0000 7ff5a3591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:02.262 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 51 16 10036 10020 12.2783 12 0.0904571 0.0813535 2024-09-22T04:00:03.262 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 52 16 10222 10206 12.2657 11.625 0.111086 0.0814493 2024-09-22T04:00:03.835 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T04:00:04.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:00:04.010+0000 7f498e751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:04.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:00:04.021+0000 7f498e751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:04.262 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 53 16 10409 10393 12.2548 11.6875 0.0981442 0.0815149 2024-09-22T04:00:05.262 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 54 16 10607 10591 12.257 12.375 0.0939614 0.0815183 2024-09-22T04:00:06.045 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T04:00:06.045 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T04:00:06.046 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T04:00:06.046 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T04:00:06.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:00:06.197+0000 7f3cb4711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:06.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:00:06.213+0000 7f3cb4711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:06.301 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 55 16 10793 10777 12.2455 11.625 0.0683175 0.081575 2024-09-22T04:00:06.424 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:00:06.424 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:00:06.424 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:00:06.424 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:00:06.424 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:00:06.424 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:00:06.424 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:00:06.424 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:00:06.425 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:00:06.425 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:00:06.425 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:00:06.425 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:00:06.429 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:00:06.429 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:00:06.429 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T04:00:06.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:00:06.576+0000 7f4494ec8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:06.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:00:06.594+0000 7f4494ec8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:06.640 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T04:00:06.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:00:06.789+0000 7f8992191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:06.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:00:06.798+0000 7f8992191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:06.844 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:00:06.844 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:00:06.844 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:00:06.844 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:00:06.844 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:00:06.844 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:00:06.845 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:00:06.845 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:00:06.845 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:00:06.845 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:00:06.845 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:00:06.845 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:00:06.849 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:00:06.849 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:00:06.849 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T04:00:07.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:00:07.018+0000 7fef0fb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:07.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:00:07.033+0000 7fef0fb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:07.122 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:00:07.122 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:00:07.122 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:00:07.122 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:00:07.122 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:00:07.122 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:00:07.122 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:00:07.122 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:00:07.122 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:00:07.122 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:00:07.122 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:00:07.123 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:00:07.125 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:00:07.126 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:00:07.126 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T04:00:07.262 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 56 16 10963 10947 12.2165 10.625 0.0437046 0.0817593 2024-09-22T04:00:07.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:00:07.283+0000 7ff0b1791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:07.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:00:07.301+0000 7ff0b1791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:07.352 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:00:07.352 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:00:07.352 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:00:07.352 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:00:07.352 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:00:07.353 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:00:07.353 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:00:07.353 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:00:07.353 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:00:07.353 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:00:07.353 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:00:07.353 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:00:07.356 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:00:07.357 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:00:08.262 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 57 16 11153 11137 12.2105 11.875 0.129686 0.0818506 2024-09-22T04:00:09.243 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T04:00:09.262 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 58 16 11346 11330 12.2079 12.0625 0.0758518 0.0818558 2024-09-22T04:00:09.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:00:09.394+0000 7f7233ae3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:09.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:00:09.403+0000 7f7233ae3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:10.262 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 59 16 11528 11512 12.1938 11.375 0.0987189 0.0819366 2024-09-22T04:00:11.262 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:2024-09-22T04:00:11.262567+0000 min lat: 0.0159369 max lat: 0.255428 avg lat: 0.0819542 2024-09-22T04:00:11.263 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-22T04:00:11.263 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 60 16 11717 11701 12.1874 11.8125 0.0726157 0.0819542 2024-09-22T04:00:11.998 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T04:00:12.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:00:12.147+0000 7f969a46c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:12.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:00:12.159+0000 7f969a46c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:12.262 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 61 16 11901 11885 12.1761 11.5 0.0842716 0.0820745 2024-09-22T04:00:12.357 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T04:00:12.357 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T04:00:12.357 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T04:00:12.358 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T04:00:12.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:00:12.514+0000 7fbabd551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:12.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:00:12.533+0000 7fbabd551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:12.769 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:00:12.769 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:00:12.769 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:00:12.769 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:00:12.769 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:00:12.769 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:00:12.769 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:00:12.769 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:00:12.770 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:00:12.770 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:00:12.770 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:00:12.770 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:00:12.772 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:00:12.773 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:00:12.773 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T04:00:12.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:00:12.914+0000 7f0414b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:12.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:00:12.930+0000 7f0414b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:13.141 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:00:13.142 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:00:13.142 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:00:13.142 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:00:13.142 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:00:13.142 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:00:13.142 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:00:13.142 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:00:13.142 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:00:13.142 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:00:13.142 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:00:13.142 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:00:13.145 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:00:13.145 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:00:13.145 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T04:00:13.262 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 62 16 12071 12055 12.1511 10.625 0.0848705 0.0822114 2024-09-22T04:00:13.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:00:13.295+0000 7fcd12a7d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:13.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:00:13.314+0000 7fcd12a7d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:13.348 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:00:13.349 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:00:13.349 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:00:13.349 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:00:13.349 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:00:13.349 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:00:13.349 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:00:13.349 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:00:13.349 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:00:13.349 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:00:13.349 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:00:13.350 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:00:13.353 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:00:13.354 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:00:13.354 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T04:00:13.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:00:13.497+0000 7f54b3391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:13.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:00:13.513+0000 7f54b3391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:13.558 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:00:13.558 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:00:13.558 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:00:13.558 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:00:13.558 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:00:13.558 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:00:13.559 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:00:13.559 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:00:13.559 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:00:13.559 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:00:13.559 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:00:13.559 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:00:13.562 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:00:13.563 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:00:14.263 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 63 16 12260 12244 12.1457 11.8125 0.094219 0.0822775 2024-09-22T04:00:14.817 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T04:00:14.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:00:14.964+0000 7f4e7d4f4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:14.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:00:14.973+0000 7f4e7d4f4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:15.263 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 64 16 12444 12428 12.1356 11.5 0.136854 0.0823416 2024-09-22T04:00:16.263 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 65 16 12620 12604 12.1181 11 0.094509 0.0824647 2024-09-22T04:00:17.263 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 66 16 12811 12795 12.1154 11.9375 0.105817 0.0824781 2024-09-22T04:00:17.547 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T04:00:17.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:00:17.722+0000 7f63f6991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:17.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:00:17.734+0000 7f63f6991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:18.263 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 67 16 13000 12984 12.1108 11.8125 0.076129 0.0825176 2024-09-22T04:00:18.564 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T04:00:18.564 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T04:00:18.564 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T04:00:18.564 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T04:00:18.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:00:18.725+0000 7f99b22d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:18.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:00:18.740+0000 7f99b22d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:18.783 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:00:18.783 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:00:18.783 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:00:18.783 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:00:18.783 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:00:18.784 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:00:18.784 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:00:18.784 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:00:18.784 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:00:18.784 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:00:18.784 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:00:18.784 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:00:18.788 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:00:18.788 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:00:18.788 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T04:00:18.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:00:18.924+0000 7feddd351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:18.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:00:18.938+0000 7feddd351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:19.164 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:00:19.164 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:00:19.164 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:00:19.164 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:00:19.164 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:00:19.165 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:00:19.165 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:00:19.165 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:00:19.165 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:00:19.165 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:00:19.165 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:00:19.165 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:00:19.169 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:00:19.169 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:00:19.169 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T04:00:19.263 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 68 16 13181 13165 12.0991 11.3125 0.0853063 0.0825844 2024-09-22T04:00:19.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:00:19.333+0000 7f7cc0151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:19.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:00:19.352+0000 7f7cc0151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:19.409 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:00:19.409 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:00:19.409 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:00:19.409 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:00:19.409 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:00:19.409 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:00:19.410 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:00:19.410 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:00:19.410 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:00:19.410 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:00:19.410 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:00:19.410 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:00:19.413 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:00:19.413 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:00:19.413 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T04:00:19.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:00:19.567+0000 7f8b81ad1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:19.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:00:19.580+0000 7f8b81ad1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:19.657 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:00:19.657 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:00:19.657 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:00:19.657 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:00:19.657 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:00:19.657 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:00:19.657 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:00:19.657 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:00:19.657 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:00:19.658 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:00:19.658 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:00:19.658 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:00:19.662 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:00:19.662 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:00:20.086 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T04:00:20.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:00:20.253+0000 7f8e87111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:20.263 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 69 16 13359 13343 12.0849 11.125 0.118484 0.082686 2024-09-22T04:00:20.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:00:20.263+0000 7f8e87111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:21.263 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 70 16 13536 13520 12.0703 11.0625 0.0709566 0.0827458 2024-09-22T04:00:22.264 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 71 16 13726 13710 12.0676 11.875 0.0485374 0.0828119 2024-09-22T04:00:22.975 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T04:00:23.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:00:23.138+0000 7fdb7a551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:23.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:00:23.146+0000 7fdb7a551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:23.263 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 72 16 13903 13887 12.0536 11.0625 0.113861 0.0829071 2024-09-22T04:00:24.264 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 73 16 14087 14071 12.046 11.5 0.037511 0.0829536 2024-09-22T04:00:24.663 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T04:00:24.663 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-22T04:00:24.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:00:24.819+0000 7f2ab7d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:24.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:00:24.833+0000 7f2ab7d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:25.264 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 74 16 14257 14241 12.0268 10.625 0.0974616 0.0830876 2024-09-22T04:00:25.617 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T04:00:25.786 INFO:teuthology.orchestra.run.smithi037.stderr:reweighted osd.0 to 1 (10000) 2024-09-22T04:00:25.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:00:25.792+0000 7f045a391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:25.805 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-22T04:00:25.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:00:25.803+0000 7f045a391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:25.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:00:25.966+0000 7f9889b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:25.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:00:25.982+0000 7f9889b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:26.264 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 75 16 14426 14410 12.0072 10.5625 0.0513776 0.0831838 2024-09-22T04:00:26.784 INFO:teuthology.orchestra.run.smithi037.stderr:reweighted osd.1 to 1 (10000) 2024-09-22T04:00:26.802 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-22T04:00:26.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:00:26.965+0000 7fd749c5c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:26.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:00:26.983+0000 7fd749c5c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:27.264 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 76 16 14592 14576 11.9858 10.375 0.110475 0.0833414 2024-09-22T04:00:27.790 INFO:teuthology.orchestra.run.smithi037.stderr:reweighted osd.2 to 1 (10000) 2024-09-22T04:00:27.810 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-22T04:00:27.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:00:27.967+0000 7f47738bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:27.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:00:27.984+0000 7f47738bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:28.264 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 77 16 14766 14750 11.9713 10.875 0.088502 0.0834486 2024-09-22T04:00:28.477 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T04:00:28.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:00:28.643+0000 7f34b7b11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:28.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:00:28.656+0000 7f34b7b11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:28.796 INFO:teuthology.orchestra.run.smithi037.stderr:reweighted osd.3 to 1 (10000) 2024-09-22T04:00:28.822 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-22T04:00:28.822 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T04:00:29.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:00:28.997+0000 7f46fb674640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:29.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:00:29.010+0000 7f46fb674640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:29.264 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 78 16 14933 14917 11.9516 10.4375 0.04718 0.0836019 2024-09-22T04:00:29.372 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T04:00:29.373 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-22T04:00:29.393 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":409,"stamp":"2024-09-22T04:00:29.105682+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":937886259,"num_objects":14306,"num_object_clones":0,"num_object_copies":42918,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":14383,"num_write_kb":916436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14357,"ondisk_log_size":14357,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":602104,"kb_used_data":172728,"kb_used_omap":0,"kb_used_meta":429312,"kb_avail":376885256,"statfs":{"total":386547056640,"available":385930502144,"internally_reserved":0,"allocated":176873472,"data_stored":2790699513,"data_compressed":132477539,"data_compressed_allocated":174374912,"data_compressed_original":2789752832,"omap_allocated":0,"internal_metadata":439615488},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":58327040,"num_objects":890,"num_object_clones":0,"num_object_copies":2670,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":890,"num_write_kb":56960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000704"},"pg_stats":[{"pgid":"6.f","version":"73'927","reported_seq":954,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-22T04:00:26.139796+0000","last_change":"2024-09-22T03:59:10.330036+0000","last_active":"2024-09-22T04:00:26.139796+0000","last_peered":"2024-09-22T04:00:26.139796+0000","last_clean":"2024-09-22T04:00:26.139796+0000","last_became_active":"2024-09-22T03:59:10.319097+0000","last_became_peered":"2024-09-22T03:59:10.319097+0000","last_unstale":"2024-09-22T04:00:26.139796+0000","last_undegraded":"2024-09-22T04:00:26.139796+0000","last_fullsized":"2024-09-22T04:00:26.139796+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":927,"log_dups_size":0,"ondisk_log_size":927,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60751872,"num_objects":927,"num_object_clones":0,"num_object_copies":2781,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":927,"num_write_kb":59328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"72'892","reported_seq":916,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T04:00:24.911139+0000","last_change":"2024-09-22T03:59:10.321450+0000","last_active":"2024-09-22T04:00:24.911139+0000","last_peered":"2024-09-22T04:00:24.911139+0000","last_clean":"2024-09-22T04:00:24.911139+0000","last_became_active":"2024-09-22T03:59:10.311447+0000","last_became_peered":"2024-09-22T03:59:10.311447+0000","last_unstale":"2024-09-22T04:00:24.911139+0000","last_undegraded":"2024-09-22T04:00:24.911139+0000","last_fullsized":"2024-09-22T04:00:24.911139+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":892,"log_dups_size":0,"ondisk_log_size":892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58458112,"num_objects":892,"num_object_clones":0,"num_object_copies":2676,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":892,"num_write_kb":57088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"72'889","reported_seq":913,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T04:00:24.905574+0000","last_change":"2024-09-22T03:59:10.349259+0000","last_active":"2024-09-22T04:00:24.905574+0000","last_peered":"2024-09-22T04:00:24.905574+0000","last_clean":"2024-09-22T04:00:24.905574+0000","last_became_active":"2024-09-22T03:59:10.341464+0000","last_became_peered":"2024-09-22T03:59:10.341464+0000","last_unstale":"2024-09-22T04:00:24.905574+0000","last_undegraded":"2024-09-22T04:00:24.905574+0000","last_fullsized":"2024-09-22T04:00:24.905574+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":889,"log_dups_size":0,"ondisk_log_size":889,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58261504,"num_objects":889,"num_object_clones":0,"num_object_copies":2667,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":889,"num_write_kb":56896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"73'876","reported_seq":903,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-22T04:00:25.962744+0000","last_change":"2024-09-22T03:59:10.365539+0000","last_active":"2024-09-22T04:00:25.962744+0000","last_peered":"2024-09-22T04:00:25.962744+0000","last_clean":"2024-09-22T04:00:25.962744+0000","last_became_active":"2024-09-22T03:59:10.339689+0000","last_became_peered":"2024-09-22T03:59:10.339689+0000","last_unstale":"2024-09-22T04:00:25.962744+0000","last_undegraded":"2024-09-22T04:00:25.962744+0000","last_fullsized":"2024-09-22T04:00:25.962744+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":876,"log_dups_size":0,"ondisk_log_size":876,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57409536,"num_objects":876,"num_object_clones":0,"num_object_copies":2628,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":876,"num_write_kb":56064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"72'895","reported_seq":919,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T04:00:24.910886+0000","last_change":"2024-09-22T03:59:10.331496+0000","last_active":"2024-09-22T04:00:24.910886+0000","last_peered":"2024-09-22T04:00:24.910886+0000","last_clean":"2024-09-22T04:00:24.910886+0000","last_became_active":"2024-09-22T03:59:10.322922+0000","last_became_peered":"2024-09-22T03:59:10.322922+0000","last_unstale":"2024-09-22T04:00:24.910886+0000","last_undegraded":"2024-09-22T04:00:24.910886+0000","last_fullsized":"2024-09-22T04:00:24.910886+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":895,"log_dups_size":0,"ondisk_log_size":895,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58654720,"num_objects":895,"num_object_clones":0,"num_object_copies":2685,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":895,"num_write_kb":57280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.a","version":"72'855","reported_seq":879,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T04:00:25.055282+0000","last_change":"2024-09-22T03:59:10.268812+0000","last_active":"2024-09-22T04:00:25.055282+0000","last_peered":"2024-09-22T04:00:25.055282+0000","last_clean":"2024-09-22T04:00:25.055282+0000","last_became_active":"2024-09-22T03:59:10.261529+0000","last_became_peered":"2024-09-22T03:59:10.261529+0000","last_unstale":"2024-09-22T04:00:25.055282+0000","last_undegraded":"2024-09-22T04:00:25.055282+0000","last_fullsized":"2024-09-22T04:00:25.055282+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":855,"log_dups_size":0,"ondisk_log_size":855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56033280,"num_objects":855,"num_object_clones":0,"num_object_copies":2565,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":855,"num_write_kb":54720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"72'895","reported_seq":919,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T04:00:25.032181+0000","last_change":"2024-09-22T03:59:10.357775+0000","last_active":"2024-09-22T04:00:25.032181+0000","last_peered":"2024-09-22T04:00:25.032181+0000","last_clean":"2024-09-22T04:00:25.032181+0000","last_became_active":"2024-09-22T03:59:10.350219+0000","last_became_peered":"2024-09-22T03:59:10.350219+0000","last_unstale":"2024-09-22T04:00:25.032181+0000","last_undegraded":"2024-09-22T04:00:25.032181+0000","last_fullsized":"2024-09-22T04:00:25.032181+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":895,"log_dups_size":0,"ondisk_log_size":895,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58654720,"num_objects":895,"num_object_clones":0,"num_object_copies":2685,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":895,"num_write_kb":57280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"72'862","reported_seq":886,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T04:00:25.045234+0000","last_change":"2024-09-22T03:59:10.302834+0000","last_active":"2024-09-22T04:00:25.045234+0000","last_peered":"2024-09-22T04:00:25.045234+0000","last_clean":"2024-09-22T04:00:25.045234+0000","last_became_active":"2024-09-22T03:59:10.294403+0000","last_became_peered":"2024-09-22T03:59:10.294403+0000","last_unstale":"2024-09-22T04:00:25.045234+0000","last_undegraded":"2024-09-22T04:00:25.045234+0000","last_fullsized":"2024-09-22T04:00:25.045234+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":862,"log_dups_size":0,"ondisk_log_size":862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56492032,"num_objects":862,"num_object_clones":0,"num_object_copies":2586,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":862,"num_write_kb":55168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"72'911","reported_seq":935,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T04:00:24.740976+0000","last_change":"2024-09-22T03:59:10.311620+0000","last_active":"2024-09-22T04:00:24.740976+0000","last_peered":"2024-09-22T04:00:24.740976+0000","last_clean":"2024-09-22T04:00:24.740976+0000","last_became_active":"2024-09-22T03:59:10.304722+0000","last_became_peered":"2024-09-22T03:59:10.304722+0000","last_unstale":"2024-09-22T04:00:24.740976+0000","last_undegraded":"2024-09-22T04:00:24.740976+0000","last_fullsized":"2024-09-22T04:00:24.740976+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":911,"log_dups_size":0,"ondisk_log_size":911,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59703296,"num_objects":911,"num_object_clones":0,"num_object_copies":2733,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":911,"num_write_kb":58304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":262,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-22T04:00:25.837150+0000","last_change":"2024-09-22T03:49:12.034704+0000","last_active":"2024-09-22T04:00:25.837150+0000","last_peered":"2024-09-22T04:00:25.837150+0000","last_clean":"2024-09-22T04:00:25.837150+0000","last_became_active":"2024-09-22T03:49:12.027470+0000","last_became_peered":"2024-09-22T03:49:12.027470+0000","last_unstale":"2024-09-22T04:00:25.837150+0000","last_undegraded":"2024-09-22T04:00:25.837150+0000","last_fullsized":"2024-09-22T04:00:25.837150+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_clean_scrub_stamp":"2024-09-22T03:49:10.979949+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":185,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:59:27.767983+0000","last_change":"2024-09-22T03:49:17.031458+0000","last_active":"2024-09-22T03:59:27.767983+0000","last_peered":"2024-09-22T03:59:27.767983+0000","last_clean":"2024-09-22T03:59:27.767983+0000","last_became_active":"2024-09-22T03:49:15.125490+0000","last_became_peered":"2024-09-22T03:49:15.125490+0000","last_unstale":"2024-09-22T03:59:27.767983+0000","last_undegraded":"2024-09-22T03:59:27.767983+0000","last_fullsized":"2024-09-22T03:59:27.767983+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"73'917","reported_seq":944,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-22T04:00:26.098574+0000","last_change":"2024-09-22T03:59:10.355702+0000","last_active":"2024-09-22T04:00:26.098574+0000","last_peered":"2024-09-22T04:00:26.098574+0000","last_clean":"2024-09-22T04:00:26.098574+0000","last_became_active":"2024-09-22T03:59:10.330418+0000","last_became_peered":"2024-09-22T03:59:10.330418+0000","last_unstale":"2024-09-22T04:00:26.098574+0000","last_undegraded":"2024-09-22T04:00:26.098574+0000","last_fullsized":"2024-09-22T04:00:26.098574+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":917,"log_dups_size":0,"ondisk_log_size":917,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60096512,"num_objects":917,"num_object_clones":0,"num_object_copies":2751,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":917,"num_write_kb":58688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":184,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:59:27.768540+0000","last_change":"2024-09-22T03:49:17.029339+0000","last_active":"2024-09-22T03:59:27.768540+0000","last_peered":"2024-09-22T03:59:27.768540+0000","last_clean":"2024-09-22T03:59:27.768540+0000","last_became_active":"2024-09-22T03:49:15.097304+0000","last_became_peered":"2024-09-22T03:49:15.097304+0000","last_unstale":"2024-09-22T03:59:27.768540+0000","last_undegraded":"2024-09-22T03:59:27.768540+0000","last_fullsized":"2024-09-22T03:59:27.768540+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.5","version":"72'891","reported_seq":915,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T04:00:25.148694+0000","last_change":"2024-09-22T03:59:10.300610+0000","last_active":"2024-09-22T04:00:25.148694+0000","last_peered":"2024-09-22T04:00:25.148694+0000","last_clean":"2024-09-22T04:00:25.148694+0000","last_became_active":"2024-09-22T03:59:10.293587+0000","last_became_peered":"2024-09-22T03:59:10.293587+0000","last_unstale":"2024-09-22T04:00:25.148694+0000","last_undegraded":"2024-09-22T04:00:25.148694+0000","last_fullsized":"2024-09-22T04:00:25.148694+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":891,"log_dups_size":0,"ondisk_log_size":891,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58392576,"num_objects":891,"num_object_clones":0,"num_object_copies":2673,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":891,"num_write_kb":57024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":184,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:59:27.767507+0000","last_change":"2024-09-22T03:49:17.029349+0000","last_active":"2024-09-22T03:59:27.767507+0000","last_peered":"2024-09-22T03:59:27.767507+0000","last_clean":"2024-09-22T03:59:27.767507+0000","last_became_active":"2024-09-22T03:49:15.094890+0000","last_became_peered":"2024-09-22T03:49:15.094890+0000","last_unstale":"2024-09-22T03:59:27.767507+0000","last_undegraded":"2024-09-22T03:59:27.767507+0000","last_fullsized":"2024-09-22T03:59:27.767507+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"73'900","reported_seq":927,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-22T04:00:26.227240+0000","last_change":"2024-09-22T03:59:10.359896+0000","last_active":"2024-09-22T04:00:26.227240+0000","last_peered":"2024-09-22T04:00:26.227240+0000","last_clean":"2024-09-22T04:00:26.227240+0000","last_became_active":"2024-09-22T03:59:10.342929+0000","last_became_peered":"2024-09-22T03:59:10.342929+0000","last_unstale":"2024-09-22T04:00:26.227240+0000","last_undegraded":"2024-09-22T04:00:26.227240+0000","last_fullsized":"2024-09-22T04:00:26.227240+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":900,"log_dups_size":0,"ondisk_log_size":900,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58982400,"num_objects":900,"num_object_clones":0,"num_object_copies":2700,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":900,"num_write_kb":57600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":186,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:59:27.773632+0000","last_change":"2024-09-22T03:49:17.031466+0000","last_active":"2024-09-22T03:59:27.773632+0000","last_peered":"2024-09-22T03:59:27.773632+0000","last_clean":"2024-09-22T03:59:27.773632+0000","last_became_active":"2024-09-22T03:49:15.098420+0000","last_became_peered":"2024-09-22T03:49:15.098420+0000","last_unstale":"2024-09-22T03:59:27.773632+0000","last_undegraded":"2024-09-22T03:59:27.773632+0000","last_fullsized":"2024-09-22T03:59:27.773632+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.0","version":"72'903","reported_seq":927,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T04:00:25.106427+0000","last_change":"2024-09-22T03:59:10.339795+0000","last_active":"2024-09-22T04:00:25.106427+0000","last_peered":"2024-09-22T04:00:25.106427+0000","last_clean":"2024-09-22T04:00:25.106427+0000","last_became_active":"2024-09-22T03:59:10.325306+0000","last_became_peered":"2024-09-22T03:59:10.325306+0000","last_unstale":"2024-09-22T04:00:25.106427+0000","last_undegraded":"2024-09-22T04:00:25.106427+0000","last_fullsized":"2024-09-22T04:00:25.106427+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":903,"log_dups_size":0,"ondisk_log_size":903,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59179008,"num_objects":903,"num_object_clones":0,"num_object_copies":2709,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":903,"num_write_kb":57792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":187,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-22T04:00:25.848397+0000","last_change":"2024-09-22T03:49:17.036954+0000","last_active":"2024-09-22T04:00:25.848397+0000","last_peered":"2024-09-22T04:00:25.848397+0000","last_clean":"2024-09-22T04:00:25.848397+0000","last_became_active":"2024-09-22T03:49:15.110506+0000","last_became_peered":"2024-09-22T03:49:15.110506+0000","last_unstale":"2024-09-22T04:00:25.848397+0000","last_undegraded":"2024-09-22T04:00:25.848397+0000","last_fullsized":"2024-09-22T04:00:25.848397+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"73'906","reported_seq":933,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-22T04:00:26.157570+0000","last_change":"2024-09-22T03:59:10.361108+0000","last_active":"2024-09-22T04:00:26.157570+0000","last_peered":"2024-09-22T04:00:26.157570+0000","last_clean":"2024-09-22T04:00:26.157570+0000","last_became_active":"2024-09-22T03:59:10.347213+0000","last_became_peered":"2024-09-22T03:59:10.347213+0000","last_unstale":"2024-09-22T04:00:26.157570+0000","last_undegraded":"2024-09-22T04:00:26.157570+0000","last_fullsized":"2024-09-22T04:00:26.157570+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":906,"log_dups_size":0,"ondisk_log_size":906,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59375616,"num_objects":906,"num_object_clones":0,"num_object_copies":2718,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":906,"num_write_kb":57984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":187,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-22T04:00:25.829618+0000","last_change":"2024-09-22T03:49:17.032989+0000","last_active":"2024-09-22T04:00:25.829618+0000","last_peered":"2024-09-22T04:00:25.829618+0000","last_clean":"2024-09-22T04:00:25.829618+0000","last_became_active":"2024-09-22T03:49:15.079260+0000","last_became_peered":"2024-09-22T03:49:15.079260+0000","last_unstale":"2024-09-22T04:00:25.829618+0000","last_undegraded":"2024-09-22T04:00:25.829618+0000","last_fullsized":"2024-09-22T04:00:25.829618+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2","version":"72'864","reported_seq":888,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T04:00:24.862759+0000","last_change":"2024-09-22T03:59:10.318033+0000","last_active":"2024-09-22T04:00:24.862759+0000","last_peered":"2024-09-22T04:00:24.862759+0000","last_clean":"2024-09-22T04:00:24.862759+0000","last_became_active":"2024-09-22T03:59:10.308707+0000","last_became_peered":"2024-09-22T03:59:10.308707+0000","last_unstale":"2024-09-22T04:00:24.862759+0000","last_undegraded":"2024-09-22T04:00:24.862759+0000","last_fullsized":"2024-09-22T04:00:24.862759+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":864,"log_dups_size":0,"ondisk_log_size":864,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56623104,"num_objects":864,"num_object_clones":0,"num_object_copies":2592,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":864,"num_write_kb":55296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":187,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-22T04:00:25.844077+0000","last_change":"2024-09-22T03:49:17.036402+0000","last_active":"2024-09-22T04:00:25.844077+0000","last_peered":"2024-09-22T04:00:25.844077+0000","last_clean":"2024-09-22T04:00:25.844077+0000","last_became_active":"2024-09-22T03:49:15.108430+0000","last_became_peered":"2024-09-22T03:49:15.108430+0000","last_unstale":"2024-09-22T04:00:25.844077+0000","last_undegraded":"2024-09-22T04:00:25.844077+0000","last_fullsized":"2024-09-22T04:00:25.844077+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"72'919","reported_seq":943,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T04:00:24.850158+0000","last_change":"2024-09-22T03:59:10.277817+0000","last_active":"2024-09-22T04:00:24.850158+0000","last_peered":"2024-09-22T04:00:24.850158+0000","last_clean":"2024-09-22T04:00:24.850158+0000","last_became_active":"2024-09-22T03:59:10.263119+0000","last_became_peered":"2024-09-22T03:59:10.263119+0000","last_unstale":"2024-09-22T04:00:24.850158+0000","last_undegraded":"2024-09-22T04:00:24.850158+0000","last_fullsized":"2024-09-22T04:00:24.850158+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":919,"log_dups_size":0,"ondisk_log_size":919,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60227584,"num_objects":919,"num_object_clones":0,"num_object_copies":2757,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":919,"num_write_kb":58816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":184,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:59:27.767421+0000","last_change":"2024-09-22T03:49:17.029128+0000","last_active":"2024-09-22T03:59:27.767421+0000","last_peered":"2024-09-22T03:59:27.767421+0000","last_clean":"2024-09-22T03:59:27.767421+0000","last_became_active":"2024-09-22T03:49:15.113396+0000","last_became_peered":"2024-09-22T03:49:15.113396+0000","last_unstale":"2024-09-22T03:59:27.767421+0000","last_undegraded":"2024-09-22T03:59:27.767421+0000","last_fullsized":"2024-09-22T03:59:27.767421+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":937295872,"num_objects":14302,"num_object_clones":0,"num_object_copies":42906,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14302,"num_write_kb":915328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":175525888,"data_stored":2808414208,"data_compressed":133355203,"data_compressed_allocated":175525888,"data_compressed_original":2808414208,"omap_allocated":0,"internal_metadata":0},"log_size":14302,"ondisk_log_size":14302,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949673633,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":151224,"kb_used_data":43880,"kb_used_omap":0,"kb_used_meta":107328,"kb_avail":94220616,"statfs":{"total":96636764160,"available":96481910784,"internally_reserved":0,"allocated":44933120,"data_stored":708996363,"data_compressed":33657497,"data_compressed_allocated":44302336,"data_compressed_original":708755456,"omap_allocated":0,"internal_metadata":109903872},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654706337,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":150240,"kb_used_data":42896,"kb_used_omap":0,"kb_used_meta":107328,"kb_avail":94221600,"statfs":{"total":96636764160,"available":96482918400,"internally_reserved":0,"allocated":43925504,"data_stored":693267179,"data_compressed":32908551,"data_compressed_allocated":43315200,"data_compressed_original":693043200,"omap_allocated":0,"internal_metadata":109903872},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706337,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":158108,"kb_used_data":46604,"kb_used_omap":0,"kb_used_meta":111488,"kb_avail":94213732,"statfs":{"total":96636764160,"available":96474861568,"internally_reserved":0,"allocated":47722496,"data_stored":753626379,"data_compressed":35776714,"data_compressed_allocated":47091712,"data_compressed_original":753385472,"omap_allocated":0,"internal_metadata":114163712},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706337,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":142532,"kb_used_data":39348,"kb_used_omap":0,"kb_used_meta":103168,"kb_avail":94229308,"statfs":{"total":96636764160,"available":96490811392,"internally_reserved":0,"allocated":40292352,"data_stored":634809592,"data_compressed":30134777,"data_compressed_allocated":39665664,"data_compressed_original":634568704,"omap_allocated":0,"internal_metadata":105644032},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":39862272,"data_stored":637796352,"data_compressed":30285217,"data_compressed_allocated":39862272,"data_compressed_original":637796352,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":44568576,"data_stored":713097216,"data_compressed":33860841,"data_compressed_allocated":44568576,"data_compressed_original":713097216,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":47329280,"data_stored":757268480,"data_compressed":35958274,"data_compressed_allocated":47329280,"data_compressed_original":757268480,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":43765760,"data_stored":700252160,"data_compressed":33250871,"data_compressed_allocated":43765760,"data_compressed_original":700252160,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T04:00:29.394 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T04:00:29.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:00:29.567+0000 7fd1aa991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:29.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:00:29.585+0000 7fd1aa991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:29.983 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T04:00:29.984 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-22T04:00:29.999 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":409,"stamp":"2024-09-22T04:00:29.105682+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":937886259,"num_objects":14306,"num_object_clones":0,"num_object_copies":42918,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":14383,"num_write_kb":916436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14357,"ondisk_log_size":14357,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":602104,"kb_used_data":172728,"kb_used_omap":0,"kb_used_meta":429312,"kb_avail":376885256,"statfs":{"total":386547056640,"available":385930502144,"internally_reserved":0,"allocated":176873472,"data_stored":2790699513,"data_compressed":132477539,"data_compressed_allocated":174374912,"data_compressed_original":2789752832,"omap_allocated":0,"internal_metadata":439615488},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":58327040,"num_objects":890,"num_object_clones":0,"num_object_copies":2670,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":890,"num_write_kb":56960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000704"},"pg_stats":[{"pgid":"6.f","version":"73'927","reported_seq":954,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-22T04:00:26.139796+0000","last_change":"2024-09-22T03:59:10.330036+0000","last_active":"2024-09-22T04:00:26.139796+0000","last_peered":"2024-09-22T04:00:26.139796+0000","last_clean":"2024-09-22T04:00:26.139796+0000","last_became_active":"2024-09-22T03:59:10.319097+0000","last_became_peered":"2024-09-22T03:59:10.319097+0000","last_unstale":"2024-09-22T04:00:26.139796+0000","last_undegraded":"2024-09-22T04:00:26.139796+0000","last_fullsized":"2024-09-22T04:00:26.139796+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":927,"log_dups_size":0,"ondisk_log_size":927,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60751872,"num_objects":927,"num_object_clones":0,"num_object_copies":2781,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":927,"num_write_kb":59328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"72'892","reported_seq":916,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T04:00:24.911139+0000","last_change":"2024-09-22T03:59:10.321450+0000","last_active":"2024-09-22T04:00:24.911139+0000","last_peered":"2024-09-22T04:00:24.911139+0000","last_clean":"2024-09-22T04:00:24.911139+0000","last_became_active":"2024-09-22T03:59:10.311447+0000","last_became_peered":"2024-09-22T03:59:10.311447+0000","last_unstale":"2024-09-22T04:00:24.911139+0000","last_undegraded":"2024-09-22T04:00:24.911139+0000","last_fullsized":"2024-09-22T04:00:24.911139+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":892,"log_dups_size":0,"ondisk_log_size":892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58458112,"num_objects":892,"num_object_clones":0,"num_object_copies":2676,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":892,"num_write_kb":57088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"72'889","reported_seq":913,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T04:00:24.905574+0000","last_change":"2024-09-22T03:59:10.349259+0000","last_active":"2024-09-22T04:00:24.905574+0000","last_peered":"2024-09-22T04:00:24.905574+0000","last_clean":"2024-09-22T04:00:24.905574+0000","last_became_active":"2024-09-22T03:59:10.341464+0000","last_became_peered":"2024-09-22T03:59:10.341464+0000","last_unstale":"2024-09-22T04:00:24.905574+0000","last_undegraded":"2024-09-22T04:00:24.905574+0000","last_fullsized":"2024-09-22T04:00:24.905574+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":889,"log_dups_size":0,"ondisk_log_size":889,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58261504,"num_objects":889,"num_object_clones":0,"num_object_copies":2667,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":889,"num_write_kb":56896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"73'876","reported_seq":903,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-22T04:00:25.962744+0000","last_change":"2024-09-22T03:59:10.365539+0000","last_active":"2024-09-22T04:00:25.962744+0000","last_peered":"2024-09-22T04:00:25.962744+0000","last_clean":"2024-09-22T04:00:25.962744+0000","last_became_active":"2024-09-22T03:59:10.339689+0000","last_became_peered":"2024-09-22T03:59:10.339689+0000","last_unstale":"2024-09-22T04:00:25.962744+0000","last_undegraded":"2024-09-22T04:00:25.962744+0000","last_fullsized":"2024-09-22T04:00:25.962744+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":876,"log_dups_size":0,"ondisk_log_size":876,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57409536,"num_objects":876,"num_object_clones":0,"num_object_copies":2628,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":876,"num_write_kb":56064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"72'895","reported_seq":919,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T04:00:24.910886+0000","last_change":"2024-09-22T03:59:10.331496+0000","last_active":"2024-09-22T04:00:24.910886+0000","last_peered":"2024-09-22T04:00:24.910886+0000","last_clean":"2024-09-22T04:00:24.910886+0000","last_became_active":"2024-09-22T03:59:10.322922+0000","last_became_peered":"2024-09-22T03:59:10.322922+0000","last_unstale":"2024-09-22T04:00:24.910886+0000","last_undegraded":"2024-09-22T04:00:24.910886+0000","last_fullsized":"2024-09-22T04:00:24.910886+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":895,"log_dups_size":0,"ondisk_log_size":895,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58654720,"num_objects":895,"num_object_clones":0,"num_object_copies":2685,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":895,"num_write_kb":57280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.a","version":"72'855","reported_seq":879,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T04:00:25.055282+0000","last_change":"2024-09-22T03:59:10.268812+0000","last_active":"2024-09-22T04:00:25.055282+0000","last_peered":"2024-09-22T04:00:25.055282+0000","last_clean":"2024-09-22T04:00:25.055282+0000","last_became_active":"2024-09-22T03:59:10.261529+0000","last_became_peered":"2024-09-22T03:59:10.261529+0000","last_unstale":"2024-09-22T04:00:25.055282+0000","last_undegraded":"2024-09-22T04:00:25.055282+0000","last_fullsized":"2024-09-22T04:00:25.055282+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":855,"log_dups_size":0,"ondisk_log_size":855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56033280,"num_objects":855,"num_object_clones":0,"num_object_copies":2565,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":855,"num_write_kb":54720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"72'895","reported_seq":919,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T04:00:25.032181+0000","last_change":"2024-09-22T03:59:10.357775+0000","last_active":"2024-09-22T04:00:25.032181+0000","last_peered":"2024-09-22T04:00:25.032181+0000","last_clean":"2024-09-22T04:00:25.032181+0000","last_became_active":"2024-09-22T03:59:10.350219+0000","last_became_peered":"2024-09-22T03:59:10.350219+0000","last_unstale":"2024-09-22T04:00:25.032181+0000","last_undegraded":"2024-09-22T04:00:25.032181+0000","last_fullsized":"2024-09-22T04:00:25.032181+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":895,"log_dups_size":0,"ondisk_log_size":895,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58654720,"num_objects":895,"num_object_clones":0,"num_object_copies":2685,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":895,"num_write_kb":57280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"72'862","reported_seq":886,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T04:00:25.045234+0000","last_change":"2024-09-22T03:59:10.302834+0000","last_active":"2024-09-22T04:00:25.045234+0000","last_peered":"2024-09-22T04:00:25.045234+0000","last_clean":"2024-09-22T04:00:25.045234+0000","last_became_active":"2024-09-22T03:59:10.294403+0000","last_became_peered":"2024-09-22T03:59:10.294403+0000","last_unstale":"2024-09-22T04:00:25.045234+0000","last_undegraded":"2024-09-22T04:00:25.045234+0000","last_fullsized":"2024-09-22T04:00:25.045234+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":862,"log_dups_size":0,"ondisk_log_size":862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56492032,"num_objects":862,"num_object_clones":0,"num_object_copies":2586,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":862,"num_write_kb":55168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"72'911","reported_seq":935,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T04:00:24.740976+0000","last_change":"2024-09-22T03:59:10.311620+0000","last_active":"2024-09-22T04:00:24.740976+0000","last_peered":"2024-09-22T04:00:24.740976+0000","last_clean":"2024-09-22T04:00:24.740976+0000","last_became_active":"2024-09-22T03:59:10.304722+0000","last_became_peered":"2024-09-22T03:59:10.304722+0000","last_unstale":"2024-09-22T04:00:24.740976+0000","last_undegraded":"2024-09-22T04:00:24.740976+0000","last_fullsized":"2024-09-22T04:00:24.740976+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":911,"log_dups_size":0,"ondisk_log_size":911,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59703296,"num_objects":911,"num_object_clones":0,"num_object_copies":2733,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":911,"num_write_kb":58304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":262,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-22T04:00:25.837150+0000","last_change":"2024-09-22T03:49:12.034704+0000","last_active":"2024-09-22T04:00:25.837150+0000","last_peered":"2024-09-22T04:00:25.837150+0000","last_clean":"2024-09-22T04:00:25.837150+0000","last_became_active":"2024-09-22T03:49:12.027470+0000","last_became_peered":"2024-09-22T03:49:12.027470+0000","last_unstale":"2024-09-22T04:00:25.837150+0000","last_undegraded":"2024-09-22T04:00:25.837150+0000","last_fullsized":"2024-09-22T04:00:25.837150+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_clean_scrub_stamp":"2024-09-22T03:49:10.979949+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":185,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:59:27.767983+0000","last_change":"2024-09-22T03:49:17.031458+0000","last_active":"2024-09-22T03:59:27.767983+0000","last_peered":"2024-09-22T03:59:27.767983+0000","last_clean":"2024-09-22T03:59:27.767983+0000","last_became_active":"2024-09-22T03:49:15.125490+0000","last_became_peered":"2024-09-22T03:49:15.125490+0000","last_unstale":"2024-09-22T03:59:27.767983+0000","last_undegraded":"2024-09-22T03:59:27.767983+0000","last_fullsized":"2024-09-22T03:59:27.767983+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"73'917","reported_seq":944,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-22T04:00:26.098574+0000","last_change":"2024-09-22T03:59:10.355702+0000","last_active":"2024-09-22T04:00:26.098574+0000","last_peered":"2024-09-22T04:00:26.098574+0000","last_clean":"2024-09-22T04:00:26.098574+0000","last_became_active":"2024-09-22T03:59:10.330418+0000","last_became_peered":"2024-09-22T03:59:10.330418+0000","last_unstale":"2024-09-22T04:00:26.098574+0000","last_undegraded":"2024-09-22T04:00:26.098574+0000","last_fullsized":"2024-09-22T04:00:26.098574+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":917,"log_dups_size":0,"ondisk_log_size":917,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60096512,"num_objects":917,"num_object_clones":0,"num_object_copies":2751,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":917,"num_write_kb":58688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":184,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:59:27.768540+0000","last_change":"2024-09-22T03:49:17.029339+0000","last_active":"2024-09-22T03:59:27.768540+0000","last_peered":"2024-09-22T03:59:27.768540+0000","last_clean":"2024-09-22T03:59:27.768540+0000","last_became_active":"2024-09-22T03:49:15.097304+0000","last_became_peered":"2024-09-22T03:49:15.097304+0000","last_unstale":"2024-09-22T03:59:27.768540+0000","last_undegraded":"2024-09-22T03:59:27.768540+0000","last_fullsized":"2024-09-22T03:59:27.768540+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.5","version":"72'891","reported_seq":915,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T04:00:25.148694+0000","last_change":"2024-09-22T03:59:10.300610+0000","last_active":"2024-09-22T04:00:25.148694+0000","last_peered":"2024-09-22T04:00:25.148694+0000","last_clean":"2024-09-22T04:00:25.148694+0000","last_became_active":"2024-09-22T03:59:10.293587+0000","last_became_peered":"2024-09-22T03:59:10.293587+0000","last_unstale":"2024-09-22T04:00:25.148694+0000","last_undegraded":"2024-09-22T04:00:25.148694+0000","last_fullsized":"2024-09-22T04:00:25.148694+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":891,"log_dups_size":0,"ondisk_log_size":891,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58392576,"num_objects":891,"num_object_clones":0,"num_object_copies":2673,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":891,"num_write_kb":57024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":184,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:59:27.767507+0000","last_change":"2024-09-22T03:49:17.029349+0000","last_active":"2024-09-22T03:59:27.767507+0000","last_peered":"2024-09-22T03:59:27.767507+0000","last_clean":"2024-09-22T03:59:27.767507+0000","last_became_active":"2024-09-22T03:49:15.094890+0000","last_became_peered":"2024-09-22T03:49:15.094890+0000","last_unstale":"2024-09-22T03:59:27.767507+0000","last_undegraded":"2024-09-22T03:59:27.767507+0000","last_fullsized":"2024-09-22T03:59:27.767507+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"73'900","reported_seq":927,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-22T04:00:26.227240+0000","last_change":"2024-09-22T03:59:10.359896+0000","last_active":"2024-09-22T04:00:26.227240+0000","last_peered":"2024-09-22T04:00:26.227240+0000","last_clean":"2024-09-22T04:00:26.227240+0000","last_became_active":"2024-09-22T03:59:10.342929+0000","last_became_peered":"2024-09-22T03:59:10.342929+0000","last_unstale":"2024-09-22T04:00:26.227240+0000","last_undegraded":"2024-09-22T04:00:26.227240+0000","last_fullsized":"2024-09-22T04:00:26.227240+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":900,"log_dups_size":0,"ondisk_log_size":900,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58982400,"num_objects":900,"num_object_clones":0,"num_object_copies":2700,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":900,"num_write_kb":57600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":186,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:59:27.773632+0000","last_change":"2024-09-22T03:49:17.031466+0000","last_active":"2024-09-22T03:59:27.773632+0000","last_peered":"2024-09-22T03:59:27.773632+0000","last_clean":"2024-09-22T03:59:27.773632+0000","last_became_active":"2024-09-22T03:49:15.098420+0000","last_became_peered":"2024-09-22T03:49:15.098420+0000","last_unstale":"2024-09-22T03:59:27.773632+0000","last_undegraded":"2024-09-22T03:59:27.773632+0000","last_fullsized":"2024-09-22T03:59:27.773632+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.0","version":"72'903","reported_seq":927,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T04:00:25.106427+0000","last_change":"2024-09-22T03:59:10.339795+0000","last_active":"2024-09-22T04:00:25.106427+0000","last_peered":"2024-09-22T04:00:25.106427+0000","last_clean":"2024-09-22T04:00:25.106427+0000","last_became_active":"2024-09-22T03:59:10.325306+0000","last_became_peered":"2024-09-22T03:59:10.325306+0000","last_unstale":"2024-09-22T04:00:25.106427+0000","last_undegraded":"2024-09-22T04:00:25.106427+0000","last_fullsized":"2024-09-22T04:00:25.106427+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":903,"log_dups_size":0,"ondisk_log_size":903,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59179008,"num_objects":903,"num_object_clones":0,"num_object_copies":2709,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":903,"num_write_kb":57792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":187,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-22T04:00:25.848397+0000","last_change":"2024-09-22T03:49:17.036954+0000","last_active":"2024-09-22T04:00:25.848397+0000","last_peered":"2024-09-22T04:00:25.848397+0000","last_clean":"2024-09-22T04:00:25.848397+0000","last_became_active":"2024-09-22T03:49:15.110506+0000","last_became_peered":"2024-09-22T03:49:15.110506+0000","last_unstale":"2024-09-22T04:00:25.848397+0000","last_undegraded":"2024-09-22T04:00:25.848397+0000","last_fullsized":"2024-09-22T04:00:25.848397+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"73'906","reported_seq":933,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-22T04:00:26.157570+0000","last_change":"2024-09-22T03:59:10.361108+0000","last_active":"2024-09-22T04:00:26.157570+0000","last_peered":"2024-09-22T04:00:26.157570+0000","last_clean":"2024-09-22T04:00:26.157570+0000","last_became_active":"2024-09-22T03:59:10.347213+0000","last_became_peered":"2024-09-22T03:59:10.347213+0000","last_unstale":"2024-09-22T04:00:26.157570+0000","last_undegraded":"2024-09-22T04:00:26.157570+0000","last_fullsized":"2024-09-22T04:00:26.157570+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":906,"log_dups_size":0,"ondisk_log_size":906,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59375616,"num_objects":906,"num_object_clones":0,"num_object_copies":2718,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":906,"num_write_kb":57984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":187,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-22T04:00:25.829618+0000","last_change":"2024-09-22T03:49:17.032989+0000","last_active":"2024-09-22T04:00:25.829618+0000","last_peered":"2024-09-22T04:00:25.829618+0000","last_clean":"2024-09-22T04:00:25.829618+0000","last_became_active":"2024-09-22T03:49:15.079260+0000","last_became_peered":"2024-09-22T03:49:15.079260+0000","last_unstale":"2024-09-22T04:00:25.829618+0000","last_undegraded":"2024-09-22T04:00:25.829618+0000","last_fullsized":"2024-09-22T04:00:25.829618+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2","version":"72'864","reported_seq":888,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T04:00:24.862759+0000","last_change":"2024-09-22T03:59:10.318033+0000","last_active":"2024-09-22T04:00:24.862759+0000","last_peered":"2024-09-22T04:00:24.862759+0000","last_clean":"2024-09-22T04:00:24.862759+0000","last_became_active":"2024-09-22T03:59:10.308707+0000","last_became_peered":"2024-09-22T03:59:10.308707+0000","last_unstale":"2024-09-22T04:00:24.862759+0000","last_undegraded":"2024-09-22T04:00:24.862759+0000","last_fullsized":"2024-09-22T04:00:24.862759+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":864,"log_dups_size":0,"ondisk_log_size":864,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56623104,"num_objects":864,"num_object_clones":0,"num_object_copies":2592,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":864,"num_write_kb":55296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":187,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-22T04:00:25.844077+0000","last_change":"2024-09-22T03:49:17.036402+0000","last_active":"2024-09-22T04:00:25.844077+0000","last_peered":"2024-09-22T04:00:25.844077+0000","last_clean":"2024-09-22T04:00:25.844077+0000","last_became_active":"2024-09-22T03:49:15.108430+0000","last_became_peered":"2024-09-22T03:49:15.108430+0000","last_unstale":"2024-09-22T04:00:25.844077+0000","last_undegraded":"2024-09-22T04:00:25.844077+0000","last_fullsized":"2024-09-22T04:00:25.844077+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"72'919","reported_seq":943,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T04:00:24.850158+0000","last_change":"2024-09-22T03:59:10.277817+0000","last_active":"2024-09-22T04:00:24.850158+0000","last_peered":"2024-09-22T04:00:24.850158+0000","last_clean":"2024-09-22T04:00:24.850158+0000","last_became_active":"2024-09-22T03:59:10.263119+0000","last_became_peered":"2024-09-22T03:59:10.263119+0000","last_unstale":"2024-09-22T04:00:24.850158+0000","last_undegraded":"2024-09-22T04:00:24.850158+0000","last_fullsized":"2024-09-22T04:00:24.850158+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":919,"log_dups_size":0,"ondisk_log_size":919,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60227584,"num_objects":919,"num_object_clones":0,"num_object_copies":2757,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":919,"num_write_kb":58816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":184,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-22T03:59:27.767421+0000","last_change":"2024-09-22T03:49:17.029128+0000","last_active":"2024-09-22T03:59:27.767421+0000","last_peered":"2024-09-22T03:59:27.767421+0000","last_clean":"2024-09-22T03:59:27.767421+0000","last_became_active":"2024-09-22T03:49:15.113396+0000","last_became_peered":"2024-09-22T03:49:15.113396+0000","last_unstale":"2024-09-22T03:59:27.767421+0000","last_undegraded":"2024-09-22T03:59:27.767421+0000","last_fullsized":"2024-09-22T03:59:27.767421+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":937295872,"num_objects":14302,"num_object_clones":0,"num_object_copies":42906,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14302,"num_write_kb":915328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":175525888,"data_stored":2808414208,"data_compressed":133355203,"data_compressed_allocated":175525888,"data_compressed_original":2808414208,"omap_allocated":0,"internal_metadata":0},"log_size":14302,"ondisk_log_size":14302,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949673633,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":151224,"kb_used_data":43880,"kb_used_omap":0,"kb_used_meta":107328,"kb_avail":94220616,"statfs":{"total":96636764160,"available":96481910784,"internally_reserved":0,"allocated":44933120,"data_stored":708996363,"data_compressed":33657497,"data_compressed_allocated":44302336,"data_compressed_original":708755456,"omap_allocated":0,"internal_metadata":109903872},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654706337,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":150240,"kb_used_data":42896,"kb_used_omap":0,"kb_used_meta":107328,"kb_avail":94221600,"statfs":{"total":96636764160,"available":96482918400,"internally_reserved":0,"allocated":43925504,"data_stored":693267179,"data_compressed":32908551,"data_compressed_allocated":43315200,"data_compressed_original":693043200,"omap_allocated":0,"internal_metadata":109903872},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706337,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":158108,"kb_used_data":46604,"kb_used_omap":0,"kb_used_meta":111488,"kb_avail":94213732,"statfs":{"total":96636764160,"available":96474861568,"internally_reserved":0,"allocated":47722496,"data_stored":753626379,"data_compressed":35776714,"data_compressed_allocated":47091712,"data_compressed_original":753385472,"omap_allocated":0,"internal_metadata":114163712},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706337,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":142532,"kb_used_data":39348,"kb_used_omap":0,"kb_used_meta":103168,"kb_avail":94229308,"statfs":{"total":96636764160,"available":96490811392,"internally_reserved":0,"allocated":40292352,"data_stored":634809592,"data_compressed":30134777,"data_compressed_allocated":39665664,"data_compressed_original":634568704,"omap_allocated":0,"internal_metadata":105644032},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":39862272,"data_stored":637796352,"data_compressed":30285217,"data_compressed_allocated":39862272,"data_compressed_original":637796352,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":44568576,"data_stored":713097216,"data_compressed":33860841,"data_compressed_allocated":44568576,"data_compressed_original":713097216,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":47329280,"data_stored":757268480,"data_compressed":35958274,"data_compressed_allocated":47329280,"data_compressed_original":757268480,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":43765760,"data_stored":700252160,"data_compressed":33250871,"data_compressed_allocated":43765760,"data_compressed_original":700252160,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T04:00:30.002 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-22T04:00:30.002 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T04:00:30.002 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T04:00:30.002 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T04:00:30.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:00:30.169+0000 7f8f18b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:30.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:00:30.183+0000 7f8f18b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:30.264 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 79 16 15106 15090 11.9372 10.8125 0.0672401 0.083705 2024-09-22T04:00:30.276 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:00:30.276 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:00:30.276 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:00:30.276 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:00:30.276 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:00:30.276 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:00:30.276 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:00:30.276 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:00:30.276 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:00:30.276 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:00:30.276 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:00:30.276 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:00:30.279 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:00:30.280 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:00:30.280 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T04:00:30.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:00:30.433+0000 7f9953023640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:30.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:00:30.452+0000 7f9953023640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:30.595 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:00:30.595 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:00:30.595 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:00:30.595 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:00:30.595 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:00:30.596 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:00:30.596 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:00:30.596 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:00:30.596 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:00:30.596 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:00:30.596 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:00:30.596 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:00:30.600 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:00:30.600 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:00:30.600 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T04:00:30.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:00:30.747+0000 7f5bbd991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:30.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:00:30.762+0000 7f5bbd991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:30.822 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:00:30.822 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:00:30.822 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:00:30.822 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:00:30.822 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:00:30.822 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:00:30.822 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:00:30.822 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:00:30.822 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:00:30.822 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:00:30.822 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:00:30.822 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:00:30.826 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:00:30.826 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:00:30.826 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T04:00:30.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:00:30.981+0000 7f6ddaad1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:31.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:00:31.000+0000 7f6ddaad1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:31.032 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:00:31.032 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:00:31.033 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:00:31.033 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:00:31.033 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:00:31.033 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:00:31.033 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:00:31.033 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:00:31.033 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:00:31.033 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:00:31.033 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:00:31.033 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:00:31.036 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:00:31.036 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:00:31.152 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T04:00:31.264 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:2024-09-22T04:00:31.264466+0000 min lat: 0.0159369 max lat: 0.25958 avg lat: 0.0838388 2024-09-22T04:00:31.264 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-22T04:00:31.265 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 80 16 15275 15259 11.92 10.5625 0.0689924 0.0838388 2024-09-22T04:00:31.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:00:31.299+0000 7f5a84191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:31.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:00:31.309+0000 7f5a84191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:32.264 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 81 16 15457 15441 11.9133 11.375 0.085489 0.0838901 2024-09-22T04:00:33.265 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 82 16 15640 15624 11.9074 11.4375 0.0723272 0.0839375 2024-09-22T04:00:33.876 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T04:00:34.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:00:34.039+0000 7f3310711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:34.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:00:34.047+0000 7f3310711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:34.265 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 83 16 15821 15805 11.9003 11.3125 0.0834264 0.0839741 2024-09-22T04:00:35.265 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 84 16 15997 15981 11.8895 11 0.0466862 0.0840414 2024-09-22T04:00:36.037 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T04:00:36.037 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T04:00:36.037 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T04:00:36.037 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T04:00:36.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:00:36.198+0000 7f2086111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:36.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:00:36.216+0000 7f2086111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:36.265 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 85 16 16171 16155 11.8776 10.875 0.0570501 0.0841325 2024-09-22T04:00:36.429 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:00:36.429 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:00:36.429 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:00:36.429 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:00:36.430 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:00:36.430 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:00:36.430 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:00:36.430 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:00:36.430 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:00:36.430 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:00:36.431 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:00:36.431 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:00:36.433 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:00:36.433 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:00:36.434 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T04:00:36.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:00:36.595+0000 7f9f48748640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:36.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:00:36.615+0000 7f9f48748640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:36.642 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T04:00:36.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:00:36.819+0000 7fed6bd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:36.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:00:36.830+0000 7fed6bd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:36.846 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:00:36.846 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:00:36.846 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:00:36.846 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:00:36.846 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:00:36.846 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:00:36.846 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:00:36.846 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:00:36.846 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:00:36.846 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:00:36.846 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:00:36.847 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:00:36.849 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:00:36.938 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:00:36.938 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T04:00:37.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:00:37.116+0000 7f6167cfd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:37.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:00:37.130+0000 7f6167cfd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:37.155 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:00:37.155 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:00:37.155 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:00:37.155 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:00:37.155 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:00:37.155 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:00:37.156 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:00:37.156 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:00:37.156 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:00:37.156 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:00:37.156 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:00:37.156 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:00:37.159 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:00:37.159 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:00:37.159 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T04:00:37.265 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 86 16 16337 16321 11.8601 10.375 0.151564 0.084243 2024-09-22T04:00:37.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:00:37.290+0000 7f93b7511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:37.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:00:37.306+0000 7f93b7511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:37.415 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:00:37.415 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:00:37.415 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:00:37.415 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:00:37.415 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:00:37.415 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:00:37.416 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:00:37.416 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:00:37.416 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:00:37.416 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:00:37.416 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:00:37.416 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:00:37.419 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:00:37.420 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:00:38.265 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 87 16 16510 16494 11.848 10.8125 0.0802968 0.0843499 2024-09-22T04:00:39.265 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 88 16 16688 16672 11.8398 11.125 0.0744424 0.0844225 2024-09-22T04:00:39.534 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T04:00:39.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:00:39.683+0000 7f7886d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:39.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:00:39.692+0000 7f7886d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:40.265 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 89 16 16855 16839 11.8241 10.4375 0.129427 0.0844971 2024-09-22T04:00:41.265 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 90 15 17028 17013 11.8135 10.875 0.0947667 0.0846001 2024-09-22T04:00:42.232 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T04:00:42.265 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Total time run: 90.0544 2024-09-22T04:00:42.265 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Total writes made: 17028 2024-09-22T04:00:42.266 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Write size: 65536 2024-09-22T04:00:42.266 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Object size: 65536 2024-09-22T04:00:42.266 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Bandwidth (MB/sec): 11.8179 2024-09-22T04:00:42.266 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Stddev Bandwidth: 0.802715 2024-09-22T04:00:42.266 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Max bandwidth (MB/sec): 13.625 2024-09-22T04:00:42.266 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Min bandwidth (MB/sec): 10.375 2024-09-22T04:00:42.266 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Average IOPS: 189 2024-09-22T04:00:42.266 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Stddev IOPS: 12.8434 2024-09-22T04:00:42.266 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Max IOPS: 218 2024-09-22T04:00:42.266 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Min IOPS: 166 2024-09-22T04:00:42.266 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Average Latency(s): 0.0845924 2024-09-22T04:00:42.266 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Stddev Latency(s): 0.0314172 2024-09-22T04:00:42.266 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Max latency(s): 0.25958 2024-09-22T04:00:42.266 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Min latency(s): 0.0159369 2024-09-22T04:00:42.305 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Cleaning up (deleting benchmark objects) 2024-09-22T04:00:42.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:00:42.372+0000 7f8849711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:42.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:00:42.381+0000 7f8849711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:42.420 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T04:00:42.420 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T04:00:42.420 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T04:00:42.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:00:42.600+0000 7f73dab51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:42.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:00:42.613+0000 7f73dab51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:42.942 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T04:00:42.943 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-22T04:00:42.965 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":415,"stamp":"2024-09-22T04:00:41.108580+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1089995315,"num_objects":16627,"num_object_clones":0,"num_object_copies":49881,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":16704,"num_write_kb":1064980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16678,"ondisk_log_size":16678,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":644748,"kb_used_data":201480,"kb_used_omap":0,"kb_used_meta":443200,"kb_avail":376842612,"statfs":{"total":386547056640,"available":385886834688,"internally_reserved":0,"allocated":206315520,"data_stored":3259727497,"data_compressed":154747011,"data_compressed_allocated":203685888,"data_compressed_original":3258728448,"omap_allocated":0,"internal_metadata":453836800},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":152109056,"num_objects":2321,"num_object_clones":0,"num_object_copies":6963,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2321,"num_write_kb":148544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002898"},"pg_stats":[{"pgid":"6.f","version":"76'1036","reported_seq":1072,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:36.052578+0000","last_change":"2024-09-22T03:59:10.330036+0000","last_active":"2024-09-22T04:00:36.052578+0000","last_peered":"2024-09-22T04:00:36.052578+0000","last_clean":"2024-09-22T04:00:36.052578+0000","last_became_active":"2024-09-22T03:59:10.319097+0000","last_became_peered":"2024-09-22T03:59:10.319097+0000","last_unstale":"2024-09-22T04:00:36.052578+0000","last_undegraded":"2024-09-22T04:00:36.052578+0000","last_fullsized":"2024-09-22T04:00:36.052578+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":1036,"log_dups_size":0,"ondisk_log_size":1036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67895296,"num_objects":1036,"num_object_clones":0,"num_object_copies":3108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1036,"num_write_kb":66304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"76'1053","reported_seq":1089,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:40.101528+0000","last_change":"2024-09-22T03:59:10.321450+0000","last_active":"2024-09-22T04:00:40.101528+0000","last_peered":"2024-09-22T04:00:40.101528+0000","last_clean":"2024-09-22T04:00:40.101528+0000","last_became_active":"2024-09-22T03:59:10.311447+0000","last_became_peered":"2024-09-22T03:59:10.311447+0000","last_unstale":"2024-09-22T04:00:40.101528+0000","last_undegraded":"2024-09-22T04:00:40.101528+0000","last_fullsized":"2024-09-22T04:00:40.101528+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":1053,"log_dups_size":0,"ondisk_log_size":1053,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69009408,"num_objects":1053,"num_object_clones":0,"num_object_copies":3159,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1053,"num_write_kb":67392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"76'1063","reported_seq":1099,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:39.968019+0000","last_change":"2024-09-22T03:59:10.349259+0000","last_active":"2024-09-22T04:00:39.968019+0000","last_peered":"2024-09-22T04:00:39.968019+0000","last_clean":"2024-09-22T04:00:39.968019+0000","last_became_active":"2024-09-22T03:59:10.341464+0000","last_became_peered":"2024-09-22T03:59:10.341464+0000","last_unstale":"2024-09-22T04:00:39.968019+0000","last_undegraded":"2024-09-22T04:00:39.968019+0000","last_fullsized":"2024-09-22T04:00:39.968019+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":1063,"log_dups_size":0,"ondisk_log_size":1063,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69664768,"num_objects":1063,"num_object_clones":0,"num_object_copies":3189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1063,"num_write_kb":68032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"76'984","reported_seq":1020,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:36.125347+0000","last_change":"2024-09-22T03:59:10.365539+0000","last_active":"2024-09-22T04:00:36.125347+0000","last_peered":"2024-09-22T04:00:36.125347+0000","last_clean":"2024-09-22T04:00:36.125347+0000","last_became_active":"2024-09-22T03:59:10.339689+0000","last_became_peered":"2024-09-22T03:59:10.339689+0000","last_unstale":"2024-09-22T04:00:36.125347+0000","last_undegraded":"2024-09-22T04:00:36.125347+0000","last_fullsized":"2024-09-22T04:00:36.125347+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":984,"log_dups_size":0,"ondisk_log_size":984,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64487424,"num_objects":984,"num_object_clones":0,"num_object_copies":2952,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":984,"num_write_kb":62976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"76'1078","reported_seq":1114,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:39.921344+0000","last_change":"2024-09-22T03:59:10.331496+0000","last_active":"2024-09-22T04:00:39.921344+0000","last_peered":"2024-09-22T04:00:39.921344+0000","last_clean":"2024-09-22T04:00:39.921344+0000","last_became_active":"2024-09-22T03:59:10.322922+0000","last_became_peered":"2024-09-22T03:59:10.322922+0000","last_unstale":"2024-09-22T04:00:39.921344+0000","last_undegraded":"2024-09-22T04:00:39.921344+0000","last_fullsized":"2024-09-22T04:00:39.921344+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":1078,"log_dups_size":0,"ondisk_log_size":1078,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70647808,"num_objects":1078,"num_object_clones":0,"num_object_copies":3234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1078,"num_write_kb":68992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.a","version":"76'1012","reported_seq":1048,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:40.145263+0000","last_change":"2024-09-22T03:59:10.268812+0000","last_active":"2024-09-22T04:00:40.145263+0000","last_peered":"2024-09-22T04:00:40.145263+0000","last_clean":"2024-09-22T04:00:40.145263+0000","last_became_active":"2024-09-22T03:59:10.261529+0000","last_became_peered":"2024-09-22T03:59:10.261529+0000","last_unstale":"2024-09-22T04:00:40.145263+0000","last_undegraded":"2024-09-22T04:00:40.145263+0000","last_fullsized":"2024-09-22T04:00:40.145263+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":1012,"log_dups_size":0,"ondisk_log_size":1012,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66322432,"num_objects":1012,"num_object_clones":0,"num_object_copies":3036,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1012,"num_write_kb":64768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"76'1076","reported_seq":1112,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:40.103166+0000","last_change":"2024-09-22T03:59:10.357775+0000","last_active":"2024-09-22T04:00:40.103166+0000","last_peered":"2024-09-22T04:00:40.103166+0000","last_clean":"2024-09-22T04:00:40.103166+0000","last_became_active":"2024-09-22T03:59:10.350219+0000","last_became_peered":"2024-09-22T03:59:10.350219+0000","last_unstale":"2024-09-22T04:00:40.103166+0000","last_undegraded":"2024-09-22T04:00:40.103166+0000","last_fullsized":"2024-09-22T04:00:40.103166+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":1076,"log_dups_size":0,"ondisk_log_size":1076,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70516736,"num_objects":1076,"num_object_clones":0,"num_object_copies":3228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1076,"num_write_kb":68864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"76'1008","reported_seq":1044,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:39.430878+0000","last_change":"2024-09-22T03:59:10.302834+0000","last_active":"2024-09-22T04:00:39.430878+0000","last_peered":"2024-09-22T04:00:39.430878+0000","last_clean":"2024-09-22T04:00:39.430878+0000","last_became_active":"2024-09-22T03:59:10.294403+0000","last_became_peered":"2024-09-22T03:59:10.294403+0000","last_unstale":"2024-09-22T04:00:39.430878+0000","last_undegraded":"2024-09-22T04:00:39.430878+0000","last_fullsized":"2024-09-22T04:00:39.430878+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":1008,"log_dups_size":0,"ondisk_log_size":1008,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66060288,"num_objects":1008,"num_object_clones":0,"num_object_copies":3024,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1008,"num_write_kb":64512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"76'1067","reported_seq":1103,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:39.727851+0000","last_change":"2024-09-22T03:59:10.311620+0000","last_active":"2024-09-22T04:00:39.727851+0000","last_peered":"2024-09-22T04:00:39.727851+0000","last_clean":"2024-09-22T04:00:39.727851+0000","last_became_active":"2024-09-22T03:59:10.304722+0000","last_became_peered":"2024-09-22T03:59:10.304722+0000","last_unstale":"2024-09-22T04:00:39.727851+0000","last_undegraded":"2024-09-22T04:00:39.727851+0000","last_fullsized":"2024-09-22T04:00:39.727851+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":1067,"log_dups_size":0,"ondisk_log_size":1067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69926912,"num_objects":1067,"num_object_clones":0,"num_object_copies":3201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1067,"num_write_kb":68288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":271,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:28.843226+0000","last_change":"2024-09-22T03:49:12.034704+0000","last_active":"2024-09-22T04:00:28.843226+0000","last_peered":"2024-09-22T04:00:28.843226+0000","last_clean":"2024-09-22T04:00:28.843226+0000","last_became_active":"2024-09-22T03:49:12.027470+0000","last_became_peered":"2024-09-22T03:49:12.027470+0000","last_unstale":"2024-09-22T04:00:28.843226+0000","last_undegraded":"2024-09-22T04:00:28.843226+0000","last_fullsized":"2024-09-22T04:00:28.843226+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_clean_scrub_stamp":"2024-09-22T03:49:10.979949+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":197,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:28.847103+0000","last_change":"2024-09-22T03:49:17.031458+0000","last_active":"2024-09-22T04:00:28.847103+0000","last_peered":"2024-09-22T04:00:28.847103+0000","last_clean":"2024-09-22T04:00:28.847103+0000","last_became_active":"2024-09-22T03:49:15.125490+0000","last_became_peered":"2024-09-22T03:49:15.125490+0000","last_unstale":"2024-09-22T04:00:28.847103+0000","last_undegraded":"2024-09-22T04:00:28.847103+0000","last_fullsized":"2024-09-22T04:00:28.847103+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"76'1023","reported_seq":1059,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:35.884548+0000","last_change":"2024-09-22T03:59:10.355702+0000","last_active":"2024-09-22T04:00:35.884548+0000","last_peered":"2024-09-22T04:00:35.884548+0000","last_clean":"2024-09-22T04:00:35.884548+0000","last_became_active":"2024-09-22T03:59:10.330418+0000","last_became_peered":"2024-09-22T03:59:10.330418+0000","last_unstale":"2024-09-22T04:00:35.884548+0000","last_undegraded":"2024-09-22T04:00:35.884548+0000","last_fullsized":"2024-09-22T04:00:35.884548+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":1023,"log_dups_size":0,"ondisk_log_size":1023,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67043328,"num_objects":1023,"num_object_clones":0,"num_object_copies":3069,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1023,"num_write_kb":65472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:28.835971+0000","last_change":"2024-09-22T03:49:17.029339+0000","last_active":"2024-09-22T04:00:28.835971+0000","last_peered":"2024-09-22T04:00:28.835971+0000","last_clean":"2024-09-22T04:00:28.835971+0000","last_became_active":"2024-09-22T03:49:15.097304+0000","last_became_peered":"2024-09-22T03:49:15.097304+0000","last_unstale":"2024-09-22T04:00:28.835971+0000","last_undegraded":"2024-09-22T04:00:28.835971+0000","last_fullsized":"2024-09-22T04:00:28.835971+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.5","version":"76'1058","reported_seq":1094,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:40.192690+0000","last_change":"2024-09-22T03:59:10.300610+0000","last_active":"2024-09-22T04:00:40.192690+0000","last_peered":"2024-09-22T04:00:40.192690+0000","last_clean":"2024-09-22T04:00:40.192690+0000","last_became_active":"2024-09-22T03:59:10.293587+0000","last_became_peered":"2024-09-22T03:59:10.293587+0000","last_unstale":"2024-09-22T04:00:40.192690+0000","last_undegraded":"2024-09-22T04:00:40.192690+0000","last_fullsized":"2024-09-22T04:00:40.192690+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":1058,"log_dups_size":0,"ondisk_log_size":1058,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69337088,"num_objects":1058,"num_object_clones":0,"num_object_copies":3174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1058,"num_write_kb":67712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:28.834492+0000","last_change":"2024-09-22T03:49:17.029349+0000","last_active":"2024-09-22T04:00:28.834492+0000","last_peered":"2024-09-22T04:00:28.834492+0000","last_clean":"2024-09-22T04:00:28.834492+0000","last_became_active":"2024-09-22T03:49:15.094890+0000","last_became_peered":"2024-09-22T03:49:15.094890+0000","last_unstale":"2024-09-22T04:00:28.834492+0000","last_undegraded":"2024-09-22T04:00:28.834492+0000","last_fullsized":"2024-09-22T04:00:28.834492+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"76'1003","reported_seq":1039,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:36.133382+0000","last_change":"2024-09-22T03:59:10.359896+0000","last_active":"2024-09-22T04:00:36.133382+0000","last_peered":"2024-09-22T04:00:36.133382+0000","last_clean":"2024-09-22T04:00:36.133382+0000","last_became_active":"2024-09-22T03:59:10.342929+0000","last_became_peered":"2024-09-22T03:59:10.342929+0000","last_unstale":"2024-09-22T04:00:36.133382+0000","last_undegraded":"2024-09-22T04:00:36.133382+0000","last_fullsized":"2024-09-22T04:00:36.133382+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":1003,"log_dups_size":0,"ondisk_log_size":1003,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65732608,"num_objects":1003,"num_object_clones":0,"num_object_copies":3009,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1003,"num_write_kb":64192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":198,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:28.839096+0000","last_change":"2024-09-22T03:49:17.031466+0000","last_active":"2024-09-22T04:00:28.839096+0000","last_peered":"2024-09-22T04:00:28.839096+0000","last_clean":"2024-09-22T04:00:28.839096+0000","last_became_active":"2024-09-22T03:49:15.098420+0000","last_became_peered":"2024-09-22T03:49:15.098420+0000","last_unstale":"2024-09-22T04:00:28.839096+0000","last_undegraded":"2024-09-22T04:00:28.839096+0000","last_fullsized":"2024-09-22T04:00:28.839096+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.0","version":"76'1040","reported_seq":1076,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:40.171570+0000","last_change":"2024-09-22T03:59:10.339795+0000","last_active":"2024-09-22T04:00:40.171570+0000","last_peered":"2024-09-22T04:00:40.171570+0000","last_clean":"2024-09-22T04:00:40.171570+0000","last_became_active":"2024-09-22T03:59:10.325306+0000","last_became_peered":"2024-09-22T03:59:10.325306+0000","last_unstale":"2024-09-22T04:00:40.171570+0000","last_undegraded":"2024-09-22T04:00:40.171570+0000","last_fullsized":"2024-09-22T04:00:40.171570+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":1040,"log_dups_size":0,"ondisk_log_size":1040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68157440,"num_objects":1040,"num_object_clones":0,"num_object_copies":3120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1040,"num_write_kb":66560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:28.846177+0000","last_change":"2024-09-22T03:49:17.036954+0000","last_active":"2024-09-22T04:00:28.846177+0000","last_peered":"2024-09-22T04:00:28.846177+0000","last_clean":"2024-09-22T04:00:28.846177+0000","last_became_active":"2024-09-22T03:49:15.110506+0000","last_became_peered":"2024-09-22T03:49:15.110506+0000","last_unstale":"2024-09-22T04:00:28.846177+0000","last_undegraded":"2024-09-22T04:00:28.846177+0000","last_fullsized":"2024-09-22T04:00:28.846177+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"76'1017","reported_seq":1053,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:36.211044+0000","last_change":"2024-09-22T03:59:10.361108+0000","last_active":"2024-09-22T04:00:36.211044+0000","last_peered":"2024-09-22T04:00:36.211044+0000","last_clean":"2024-09-22T04:00:36.211044+0000","last_became_active":"2024-09-22T03:59:10.347213+0000","last_became_peered":"2024-09-22T03:59:10.347213+0000","last_unstale":"2024-09-22T04:00:36.211044+0000","last_undegraded":"2024-09-22T04:00:36.211044+0000","last_fullsized":"2024-09-22T04:00:36.211044+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":1017,"log_dups_size":0,"ondisk_log_size":1017,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66650112,"num_objects":1017,"num_object_clones":0,"num_object_copies":3051,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1017,"num_write_kb":65088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:28.844399+0000","last_change":"2024-09-22T03:49:17.032989+0000","last_active":"2024-09-22T04:00:28.844399+0000","last_peered":"2024-09-22T04:00:28.844399+0000","last_clean":"2024-09-22T04:00:28.844399+0000","last_became_active":"2024-09-22T03:49:15.079260+0000","last_became_peered":"2024-09-22T03:49:15.079260+0000","last_unstale":"2024-09-22T04:00:28.844399+0000","last_undegraded":"2024-09-22T04:00:28.844399+0000","last_fullsized":"2024-09-22T04:00:28.844399+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2","version":"76'1022","reported_seq":1058,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:40.040256+0000","last_change":"2024-09-22T03:59:10.318033+0000","last_active":"2024-09-22T04:00:40.040256+0000","last_peered":"2024-09-22T04:00:40.040256+0000","last_clean":"2024-09-22T04:00:40.040256+0000","last_became_active":"2024-09-22T03:59:10.308707+0000","last_became_peered":"2024-09-22T03:59:10.308707+0000","last_unstale":"2024-09-22T04:00:40.040256+0000","last_undegraded":"2024-09-22T04:00:40.040256+0000","last_fullsized":"2024-09-22T04:00:40.040256+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":1022,"log_dups_size":0,"ondisk_log_size":1022,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66977792,"num_objects":1022,"num_object_clones":0,"num_object_copies":3066,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1022,"num_write_kb":65408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:28.849513+0000","last_change":"2024-09-22T03:49:17.036402+0000","last_active":"2024-09-22T04:00:28.849513+0000","last_peered":"2024-09-22T04:00:28.849513+0000","last_clean":"2024-09-22T04:00:28.849513+0000","last_became_active":"2024-09-22T03:49:15.108430+0000","last_became_peered":"2024-09-22T03:49:15.108430+0000","last_unstale":"2024-09-22T04:00:28.849513+0000","last_undegraded":"2024-09-22T04:00:28.849513+0000","last_fullsized":"2024-09-22T04:00:28.849513+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"76'1083","reported_seq":1119,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:39.856822+0000","last_change":"2024-09-22T03:59:10.277817+0000","last_active":"2024-09-22T04:00:39.856822+0000","last_peered":"2024-09-22T04:00:39.856822+0000","last_clean":"2024-09-22T04:00:39.856822+0000","last_became_active":"2024-09-22T03:59:10.263119+0000","last_became_peered":"2024-09-22T03:59:10.263119+0000","last_unstale":"2024-09-22T04:00:39.856822+0000","last_undegraded":"2024-09-22T04:00:39.856822+0000","last_fullsized":"2024-09-22T04:00:39.856822+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":1083,"log_dups_size":0,"ondisk_log_size":1083,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70975488,"num_objects":1083,"num_object_clones":0,"num_object_copies":3249,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1083,"num_write_kb":69312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:28.833568+0000","last_change":"2024-09-22T03:49:17.029128+0000","last_active":"2024-09-22T04:00:28.833568+0000","last_peered":"2024-09-22T04:00:28.833568+0000","last_clean":"2024-09-22T04:00:28.833568+0000","last_became_active":"2024-09-22T03:49:15.113396+0000","last_became_peered":"2024-09-22T03:49:15.113396+0000","last_unstale":"2024-09-22T04:00:28.833568+0000","last_undegraded":"2024-09-22T04:00:28.833568+0000","last_fullsized":"2024-09-22T04:00:28.833568+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":1089404928,"num_objects":16623,"num_object_clones":0,"num_object_copies":49869,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16623,"num_write_kb":1063872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":204763136,"data_stored":3276210176,"data_compressed":155568659,"data_compressed_allocated":204763136,"data_compressed_original":3276210176,"omap_allocated":0,"internal_metadata":0},"log_size":16623,"ondisk_log_size":16623,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949673643,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":160656,"kb_used_data":49148,"kb_used_omap":0,"kb_used_meta":111488,"kb_avail":94211184,"statfs":{"total":96636764160,"available":96472252416,"internally_reserved":0,"allocated":50327552,"data_stored":794796079,"data_compressed":37731105,"data_compressed_allocated":49664000,"data_compressed_original":794542080,"omap_allocated":0,"internal_metadata":114163712},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654706352,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":167852,"kb_used_data":50780,"kb_used_omap":0,"kb_used_meta":117056,"kb_avail":94203988,"statfs":{"total":96636764160,"available":96464883712,"internally_reserved":0,"allocated":51998720,"data_stored":821927439,"data_compressed":39017407,"data_compressed_allocated":51355648,"data_compressed_original":821690368,"omap_allocated":0,"internal_metadata":119865344},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706352,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":158296,"kb_used_data":55112,"kb_used_omap":0,"kb_used_meta":103168,"kb_avail":94213544,"statfs":{"total":96636764160,"available":96474669056,"internally_reserved":0,"allocated":56434688,"data_stored":892510255,"data_compressed":42371042,"data_compressed_allocated":55771136,"data_compressed_original":892256256,"omap_allocated":0,"internal_metadata":105644032},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706352,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":157944,"kb_used_data":46440,"kb_used_omap":0,"kb_used_meta":111488,"kb_avail":94213896,"statfs":{"total":96636764160,"available":96475029504,"internally_reserved":0,"allocated":47554560,"data_stored":750493724,"data_compressed":35627457,"data_compressed_allocated":46895104,"data_compressed_original":750239744,"omap_allocated":0,"internal_metadata":114163712},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":47079424,"data_stored":753270784,"data_compressed":35768561,"data_compressed_allocated":47079424,"data_compressed_original":753270784,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":49917952,"data_stored":798687232,"data_compressed":37925113,"data_compressed_allocated":49917952,"data_compressed_original":798687232,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55926784,"data_stored":894828544,"data_compressed":42490362,"data_compressed_allocated":55926784,"data_compressed_original":894828544,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":51838976,"data_stored":829423616,"data_compressed":39384623,"data_compressed_allocated":51838976,"data_compressed_original":829423616,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T04:00:44.894 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T04:00:45.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:00:45.063+0000 7f7e62391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:45.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:00:45.072+0000 7f7e62391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:47.500 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T04:00:47.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:00:47.670+0000 7f4a81d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:47.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:00:47.680+0000 7f4a81d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:47.967 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T04:00:47.967 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T04:00:47.967 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T04:00:47.968 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T04:00:48.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:00:48.138+0000 7f5a0e85a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:48.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:00:48.156+0000 7f5a0e85a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:48.247 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:00:48.248 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:00:48.248 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:00:48.248 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:00:48.248 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:00:48.248 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:00:48.248 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:00:48.248 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:00:48.248 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:00:48.248 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:00:48.248 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:00:48.248 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:00:48.252 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:00:48.252 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:00:48.252 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T04:00:48.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:00:48.423+0000 7f17fd751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:48.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:00:48.443+0000 7f17fd751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:48.622 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:00:48.623 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:00:48.623 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:00:48.623 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:00:48.623 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:00:48.623 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:00:48.623 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:00:48.623 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:00:48.623 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:00:48.623 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:00:48.623 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:00:48.623 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:00:48.627 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:00:48.627 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:00:48.627 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T04:00:48.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:00:48.790+0000 7fe5fb991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:48.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:00:48.805+0000 7fe5fb991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:48.917 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:00:48.917 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:00:48.917 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:00:48.917 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:00:48.918 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:00:48.918 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:00:48.918 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:00:48.918 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:00:48.918 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:00:48.918 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:00:48.918 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:00:48.918 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:00:48.920 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:00:48.921 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:00:48.921 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T04:00:49.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:00:49.069+0000 7f03e4591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:49.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:00:49.088+0000 7f03e4591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:49.129 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:00:49.129 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:00:49.129 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:00:49.129 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:00:49.129 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:00:49.130 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:00:49.130 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:00:49.130 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:00:49.130 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:00:49.130 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:00:49.130 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:00:49.130 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:00:49.132 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:00:49.133 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:00:50.271 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T04:00:50.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:00:50.448+0000 7f65f2191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:50.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:00:50.460+0000 7f65f2191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:52.781 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T04:00:52.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:00:52.943+0000 7fc5b8591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:52.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:00:52.953+0000 7fc5b8591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:54.134 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T04:00:54.134 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T04:00:54.134 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T04:00:54.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:00:54.302+0000 7f185cafd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:54.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:00:54.320+0000 7f185cafd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:54.604 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T04:00:54.604 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-22T04:00:54.629 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":421,"stamp":"2024-09-22T04:00:53.110992+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1014170187,"num_objects":15471,"num_object_clones":0,"num_object_copies":46413,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":18672,"num_write_kb":1090901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18646,"ondisk_log_size":18646,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":620540,"kb_used_data":189748,"kb_used_omap":0,"kb_used_meta":430720,"kb_avail":376866820,"statfs":{"total":386547056640,"available":385911623680,"internally_reserved":0,"allocated":194301952,"data_stored":3067313873,"data_compressed":145613509,"data_compressed_allocated":191660032,"data_compressed_original":3066314752,"omap_allocated":0,"internal_metadata":441057280},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-75825128,"num_objects":-1156,"num_object_clones":0,"num_object_copies":-3468,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1968,"num_write_kb":25921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002412"},"pg_stats":[{"pgid":"6.f","version":"76'1195","reported_seq":1231,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:51.095797+0000","last_change":"2024-09-22T03:59:10.330036+0000","last_active":"2024-09-22T04:00:51.095797+0000","last_peered":"2024-09-22T04:00:51.095797+0000","last_clean":"2024-09-22T04:00:51.095797+0000","last_became_active":"2024-09-22T03:59:10.319097+0000","last_became_peered":"2024-09-22T03:59:10.319097+0000","last_unstale":"2024-09-22T04:00:51.095797+0000","last_undegraded":"2024-09-22T04:00:51.095797+0000","last_fullsized":"2024-09-22T04:00:51.095797+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":1195,"log_dups_size":0,"ondisk_log_size":1195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65601536,"num_objects":1001,"num_object_clones":0,"num_object_copies":3003,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1195,"num_write_kb":70272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"76'1150","reported_seq":1186,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:49.914425+0000","last_change":"2024-09-22T03:59:10.321450+0000","last_active":"2024-09-22T04:00:49.914425+0000","last_peered":"2024-09-22T04:00:49.914425+0000","last_clean":"2024-09-22T04:00:49.914425+0000","last_became_active":"2024-09-22T03:59:10.311447+0000","last_became_peered":"2024-09-22T03:59:10.311447+0000","last_unstale":"2024-09-22T04:00:49.914425+0000","last_undegraded":"2024-09-22T04:00:49.914425+0000","last_fullsized":"2024-09-22T04:00:49.914425+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":1150,"log_dups_size":0,"ondisk_log_size":1150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64356352,"num_objects":982,"num_object_clones":0,"num_object_copies":2946,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1150,"num_write_kb":68224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"76'1165","reported_seq":1202,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:49.686338+0000","last_change":"2024-09-22T03:59:10.349259+0000","last_active":"2024-09-22T04:00:49.686338+0000","last_peered":"2024-09-22T04:00:49.686338+0000","last_clean":"2024-09-22T04:00:49.686338+0000","last_became_active":"2024-09-22T03:59:10.341464+0000","last_became_peered":"2024-09-22T03:59:10.341464+0000","last_unstale":"2024-09-22T04:00:49.686338+0000","last_undegraded":"2024-09-22T04:00:49.686338+0000","last_fullsized":"2024-09-22T04:00:49.686338+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":1165,"log_dups_size":0,"ondisk_log_size":1165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64618520,"num_objects":987,"num_object_clones":0,"num_object_copies":2961,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1165,"num_write_kb":68801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"76'1147","reported_seq":1183,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:51.208955+0000","last_change":"2024-09-22T03:59:10.365539+0000","last_active":"2024-09-22T04:00:51.208955+0000","last_peered":"2024-09-22T04:00:51.208955+0000","last_clean":"2024-09-22T04:00:51.208955+0000","last_became_active":"2024-09-22T03:59:10.339689+0000","last_became_peered":"2024-09-22T03:59:10.339689+0000","last_unstale":"2024-09-22T04:00:51.208955+0000","last_undegraded":"2024-09-22T04:00:51.208955+0000","last_fullsized":"2024-09-22T04:00:51.208955+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":1147,"log_dups_size":0,"ondisk_log_size":1147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61145088,"num_objects":933,"num_object_clones":0,"num_object_copies":2799,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1147,"num_write_kb":66560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"76'1167","reported_seq":1203,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:49.783889+0000","last_change":"2024-09-22T03:59:10.331496+0000","last_active":"2024-09-22T04:00:49.783889+0000","last_peered":"2024-09-22T04:00:49.783889+0000","last_clean":"2024-09-22T04:00:49.783889+0000","last_became_active":"2024-09-22T03:59:10.322922+0000","last_became_peered":"2024-09-22T03:59:10.322922+0000","last_unstale":"2024-09-22T04:00:49.783889+0000","last_undegraded":"2024-09-22T04:00:49.783889+0000","last_fullsized":"2024-09-22T04:00:49.783889+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":1167,"log_dups_size":0,"ondisk_log_size":1167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66256896,"num_objects":1011,"num_object_clones":0,"num_object_copies":3033,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1167,"num_write_kb":69696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.a","version":"76'1110","reported_seq":1146,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:49.818880+0000","last_change":"2024-09-22T03:59:10.268812+0000","last_active":"2024-09-22T04:00:49.818880+0000","last_peered":"2024-09-22T04:00:49.818880+0000","last_clean":"2024-09-22T04:00:49.818880+0000","last_became_active":"2024-09-22T03:59:10.261529+0000","last_became_peered":"2024-09-22T03:59:10.261529+0000","last_unstale":"2024-09-22T04:00:49.818880+0000","last_undegraded":"2024-09-22T04:00:49.818880+0000","last_fullsized":"2024-09-22T04:00:49.818880+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":1110,"log_dups_size":0,"ondisk_log_size":1110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61603840,"num_objects":940,"num_object_clones":0,"num_object_copies":2820,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1110,"num_write_kb":65600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"76'1175","reported_seq":1211,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:50.034441+0000","last_change":"2024-09-22T03:59:10.357775+0000","last_active":"2024-09-22T04:00:50.034441+0000","last_peered":"2024-09-22T04:00:50.034441+0000","last_clean":"2024-09-22T04:00:50.034441+0000","last_became_active":"2024-09-22T03:59:10.350219+0000","last_became_peered":"2024-09-22T03:59:10.350219+0000","last_unstale":"2024-09-22T04:00:50.034441+0000","last_undegraded":"2024-09-22T04:00:50.034441+0000","last_fullsized":"2024-09-22T04:00:50.034441+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":1175,"log_dups_size":0,"ondisk_log_size":1175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65208320,"num_objects":995,"num_object_clones":0,"num_object_copies":2985,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1175,"num_write_kb":69440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"76'1101","reported_seq":1137,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:49.920013+0000","last_change":"2024-09-22T03:59:10.302834+0000","last_active":"2024-09-22T04:00:49.920013+0000","last_peered":"2024-09-22T04:00:49.920013+0000","last_clean":"2024-09-22T04:00:49.920013+0000","last_became_active":"2024-09-22T03:59:10.294403+0000","last_became_peered":"2024-09-22T03:59:10.294403+0000","last_unstale":"2024-09-22T04:00:49.920013+0000","last_undegraded":"2024-09-22T04:00:49.920013+0000","last_fullsized":"2024-09-22T04:00:49.920013+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":1101,"log_dups_size":0,"ondisk_log_size":1101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61145088,"num_objects":933,"num_object_clones":0,"num_object_copies":2799,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1101,"num_write_kb":65088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"76'1187","reported_seq":1223,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:49.815833+0000","last_change":"2024-09-22T03:59:10.311620+0000","last_active":"2024-09-22T04:00:49.815833+0000","last_peered":"2024-09-22T04:00:49.815833+0000","last_clean":"2024-09-22T04:00:49.815833+0000","last_became_active":"2024-09-22T03:59:10.304722+0000","last_became_peered":"2024-09-22T03:59:10.304722+0000","last_unstale":"2024-09-22T04:00:49.815833+0000","last_undegraded":"2024-09-22T04:00:49.815833+0000","last_fullsized":"2024-09-22T04:00:49.815833+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":1187,"log_dups_size":0,"ondisk_log_size":1187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63504384,"num_objects":969,"num_object_clones":0,"num_object_copies":2907,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1187,"num_write_kb":68992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":271,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:28.843226+0000","last_change":"2024-09-22T03:49:12.034704+0000","last_active":"2024-09-22T04:00:28.843226+0000","last_peered":"2024-09-22T04:00:28.843226+0000","last_clean":"2024-09-22T04:00:28.843226+0000","last_became_active":"2024-09-22T03:49:12.027470+0000","last_became_peered":"2024-09-22T03:49:12.027470+0000","last_unstale":"2024-09-22T04:00:28.843226+0000","last_undegraded":"2024-09-22T04:00:28.843226+0000","last_fullsized":"2024-09-22T04:00:28.843226+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_clean_scrub_stamp":"2024-09-22T03:49:10.979949+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":197,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:28.847103+0000","last_change":"2024-09-22T03:49:17.031458+0000","last_active":"2024-09-22T04:00:28.847103+0000","last_peered":"2024-09-22T04:00:28.847103+0000","last_clean":"2024-09-22T04:00:28.847103+0000","last_became_active":"2024-09-22T03:49:15.125490+0000","last_became_peered":"2024-09-22T03:49:15.125490+0000","last_unstale":"2024-09-22T04:00:28.847103+0000","last_undegraded":"2024-09-22T04:00:28.847103+0000","last_fullsized":"2024-09-22T04:00:28.847103+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"76'1190","reported_seq":1226,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:51.196704+0000","last_change":"2024-09-22T03:59:10.355702+0000","last_active":"2024-09-22T04:00:51.196704+0000","last_peered":"2024-09-22T04:00:51.196704+0000","last_clean":"2024-09-22T04:00:51.196704+0000","last_became_active":"2024-09-22T03:59:10.330418+0000","last_became_peered":"2024-09-22T03:59:10.330418+0000","last_unstale":"2024-09-22T04:00:51.196704+0000","last_undegraded":"2024-09-22T04:00:51.196704+0000","last_fullsized":"2024-09-22T04:00:51.196704+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":1190,"log_dups_size":0,"ondisk_log_size":1190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63569920,"num_objects":970,"num_object_clones":0,"num_object_copies":2910,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1190,"num_write_kb":69120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:28.835971+0000","last_change":"2024-09-22T03:49:17.029339+0000","last_active":"2024-09-22T04:00:28.835971+0000","last_peered":"2024-09-22T04:00:28.835971+0000","last_clean":"2024-09-22T04:00:28.835971+0000","last_became_active":"2024-09-22T03:49:15.097304+0000","last_became_peered":"2024-09-22T03:49:15.097304+0000","last_unstale":"2024-09-22T04:00:28.835971+0000","last_undegraded":"2024-09-22T04:00:28.835971+0000","last_fullsized":"2024-09-22T04:00:28.835971+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.5","version":"76'1179","reported_seq":1215,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:50.186964+0000","last_change":"2024-09-22T03:59:10.300610+0000","last_active":"2024-09-22T04:00:50.186964+0000","last_peered":"2024-09-22T04:00:50.186964+0000","last_clean":"2024-09-22T04:00:50.186964+0000","last_became_active":"2024-09-22T03:59:10.293587+0000","last_became_peered":"2024-09-22T03:59:10.293587+0000","last_unstale":"2024-09-22T04:00:50.186964+0000","last_undegraded":"2024-09-22T04:00:50.186964+0000","last_fullsized":"2024-09-22T04:00:50.186964+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":1179,"log_dups_size":0,"ondisk_log_size":1179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62717952,"num_objects":957,"num_object_clones":0,"num_object_copies":2871,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1179,"num_write_kb":68352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:28.834492+0000","last_change":"2024-09-22T03:49:17.029349+0000","last_active":"2024-09-22T04:00:28.834492+0000","last_peered":"2024-09-22T04:00:28.834492+0000","last_clean":"2024-09-22T04:00:28.834492+0000","last_became_active":"2024-09-22T03:49:15.094890+0000","last_became_peered":"2024-09-22T03:49:15.094890+0000","last_unstale":"2024-09-22T04:00:28.834492+0000","last_undegraded":"2024-09-22T04:00:28.834492+0000","last_fullsized":"2024-09-22T04:00:28.834492+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"76'1181","reported_seq":1217,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:51.016639+0000","last_change":"2024-09-22T03:59:10.359896+0000","last_active":"2024-09-22T04:00:51.016639+0000","last_peered":"2024-09-22T04:00:51.016639+0000","last_clean":"2024-09-22T04:00:51.016639+0000","last_became_active":"2024-09-22T03:59:10.342929+0000","last_became_peered":"2024-09-22T03:59:10.342929+0000","last_unstale":"2024-09-22T04:00:51.016639+0000","last_undegraded":"2024-09-22T04:00:51.016639+0000","last_fullsized":"2024-09-22T04:00:51.016639+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":1181,"log_dups_size":0,"ondisk_log_size":1181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61931520,"num_objects":945,"num_object_clones":0,"num_object_copies":2835,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1181,"num_write_kb":68032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":198,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:28.839096+0000","last_change":"2024-09-22T03:49:17.031466+0000","last_active":"2024-09-22T04:00:28.839096+0000","last_peered":"2024-09-22T04:00:28.839096+0000","last_clean":"2024-09-22T04:00:28.839096+0000","last_became_active":"2024-09-22T03:49:15.098420+0000","last_became_peered":"2024-09-22T03:49:15.098420+0000","last_unstale":"2024-09-22T04:00:28.839096+0000","last_undegraded":"2024-09-22T04:00:28.839096+0000","last_fullsized":"2024-09-22T04:00:28.839096+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.0","version":"76'1141","reported_seq":1177,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:50.133626+0000","last_change":"2024-09-22T03:59:10.339795+0000","last_active":"2024-09-22T04:00:50.133626+0000","last_peered":"2024-09-22T04:00:50.133626+0000","last_clean":"2024-09-22T04:00:50.133626+0000","last_became_active":"2024-09-22T03:59:10.325306+0000","last_became_peered":"2024-09-22T03:59:10.325306+0000","last_unstale":"2024-09-22T04:00:50.133626+0000","last_undegraded":"2024-09-22T04:00:50.133626+0000","last_fullsized":"2024-09-22T04:00:50.133626+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":1141,"log_dups_size":0,"ondisk_log_size":1141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62717952,"num_objects":957,"num_object_clones":0,"num_object_copies":2871,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1141,"num_write_kb":67136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:28.846177+0000","last_change":"2024-09-22T03:49:17.036954+0000","last_active":"2024-09-22T04:00:28.846177+0000","last_peered":"2024-09-22T04:00:28.846177+0000","last_clean":"2024-09-22T04:00:28.846177+0000","last_became_active":"2024-09-22T03:49:15.110506+0000","last_became_peered":"2024-09-22T03:49:15.110506+0000","last_unstale":"2024-09-22T04:00:28.846177+0000","last_undegraded":"2024-09-22T04:00:28.846177+0000","last_fullsized":"2024-09-22T04:00:28.846177+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"76'1182","reported_seq":1218,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:51.136633+0000","last_change":"2024-09-22T03:59:10.361108+0000","last_active":"2024-09-22T04:00:51.136633+0000","last_peered":"2024-09-22T04:00:51.136633+0000","last_clean":"2024-09-22T04:00:51.136633+0000","last_became_active":"2024-09-22T03:59:10.347213+0000","last_became_peered":"2024-09-22T03:59:10.347213+0000","last_unstale":"2024-09-22T04:00:51.136633+0000","last_undegraded":"2024-09-22T04:00:51.136633+0000","last_fullsized":"2024-09-22T04:00:51.136633+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":1182,"log_dups_size":0,"ondisk_log_size":1182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63176704,"num_objects":964,"num_object_clones":0,"num_object_copies":2892,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1182,"num_write_kb":68672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:28.844399+0000","last_change":"2024-09-22T03:49:17.032989+0000","last_active":"2024-09-22T04:00:28.844399+0000","last_peered":"2024-09-22T04:00:28.844399+0000","last_clean":"2024-09-22T04:00:28.844399+0000","last_became_active":"2024-09-22T03:49:15.079260+0000","last_became_peered":"2024-09-22T03:49:15.079260+0000","last_unstale":"2024-09-22T04:00:28.844399+0000","last_undegraded":"2024-09-22T04:00:28.844399+0000","last_fullsized":"2024-09-22T04:00:28.844399+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2","version":"76'1123","reported_seq":1159,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:49.902894+0000","last_change":"2024-09-22T03:59:10.318033+0000","last_active":"2024-09-22T04:00:49.902894+0000","last_peered":"2024-09-22T04:00:49.902894+0000","last_clean":"2024-09-22T04:00:49.902894+0000","last_became_active":"2024-09-22T03:59:10.308707+0000","last_became_peered":"2024-09-22T03:59:10.308707+0000","last_unstale":"2024-09-22T04:00:49.902894+0000","last_undegraded":"2024-09-22T04:00:49.902894+0000","last_fullsized":"2024-09-22T04:00:49.902894+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":1123,"log_dups_size":0,"ondisk_log_size":1123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61538304,"num_objects":939,"num_object_clones":0,"num_object_copies":2817,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1123,"num_write_kb":65984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:28.849513+0000","last_change":"2024-09-22T03:49:17.036402+0000","last_active":"2024-09-22T04:00:28.849513+0000","last_peered":"2024-09-22T04:00:28.849513+0000","last_clean":"2024-09-22T04:00:28.849513+0000","last_became_active":"2024-09-22T03:49:15.108430+0000","last_became_peered":"2024-09-22T03:49:15.108430+0000","last_unstale":"2024-09-22T04:00:28.849513+0000","last_undegraded":"2024-09-22T04:00:28.849513+0000","last_fullsized":"2024-09-22T04:00:28.849513+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"76'1198","reported_seq":1234,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:50.089650+0000","last_change":"2024-09-22T03:59:10.277817+0000","last_active":"2024-09-22T04:00:50.089650+0000","last_peered":"2024-09-22T04:00:50.089650+0000","last_clean":"2024-09-22T04:00:50.089650+0000","last_became_active":"2024-09-22T03:59:10.263119+0000","last_became_peered":"2024-09-22T03:59:10.263119+0000","last_unstale":"2024-09-22T04:00:50.089650+0000","last_undegraded":"2024-09-22T04:00:50.089650+0000","last_fullsized":"2024-09-22T04:00:50.089650+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":1198,"log_dups_size":0,"ondisk_log_size":1198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64487424,"num_objects":984,"num_object_clones":0,"num_object_copies":2952,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1198,"num_write_kb":69824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:28.833568+0000","last_change":"2024-09-22T03:49:17.029128+0000","last_active":"2024-09-22T04:00:28.833568+0000","last_peered":"2024-09-22T04:00:28.833568+0000","last_clean":"2024-09-22T04:00:28.833568+0000","last_became_active":"2024-09-22T03:49:15.113396+0000","last_became_peered":"2024-09-22T03:49:15.113396+0000","last_unstale":"2024-09-22T04:00:28.833568+0000","last_undegraded":"2024-09-22T04:00:28.833568+0000","last_fullsized":"2024-09-22T04:00:28.833568+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":1013579800,"num_objects":15467,"num_object_clones":0,"num_object_copies":46401,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":18591,"num_write_kb":1089793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":190275584,"data_stored":3044212808,"data_compressed":144555509,"data_compressed_allocated":190263296,"data_compressed_original":3044212736,"omap_allocated":0,"internal_metadata":0},"log_size":18591,"ondisk_log_size":18591,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949673658,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":150516,"kb_used_data":47332,"kb_used_omap":0,"kb_used_meta":103168,"kb_avail":94221324,"statfs":{"total":96636764160,"available":96482635776,"internally_reserved":0,"allocated":48467968,"data_stored":764977223,"data_compressed":36315975,"data_compressed_allocated":47800320,"data_compressed_original":764723200,"omap_allocated":0,"internal_metadata":105644032},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654706362,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":169020,"kb_used_data":47788,"kb_used_omap":0,"kb_used_meta":121216,"kb_avail":94202820,"statfs":{"total":96636764160,"available":96463687680,"internally_reserved":0,"allocated":48934912,"data_stored":772906511,"data_compressed":36690479,"data_compressed_allocated":48291840,"data_compressed_original":772669440,"omap_allocated":0,"internal_metadata":124125184},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706362,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":158764,"kb_used_data":51420,"kb_used_omap":0,"kb_used_meta":107328,"kb_avail":94213076,"statfs":{"total":96636764160,"available":96474189824,"internally_reserved":0,"allocated":52654080,"data_stored":831955015,"data_compressed":39496440,"data_compressed_allocated":51986432,"data_compressed_original":831700992,"omap_allocated":0,"internal_metadata":109903872},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706362,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":142240,"kb_used_data":43208,"kb_used_omap":0,"kb_used_meta":99008,"kb_avail":94229600,"statfs":{"total":96636764160,"available":96491110400,"internally_reserved":0,"allocated":44244992,"data_stored":697475124,"data_compressed":33110615,"data_compressed_allocated":43581440,"data_compressed_original":697221120,"omap_allocated":0,"internal_metadata":101384192},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":43302912,"data_stored":692781080,"data_compressed":32896951,"data_compressed_allocated":43298816,"data_compressed_original":692781056,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":47452160,"data_stored":759169048,"data_compressed":36049407,"data_compressed_allocated":47448064,"data_compressed_original":759169024,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":51720192,"data_stored":827457560,"data_compressed":39292112,"data_compressed_allocated":51716096,"data_compressed_original":827457536,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":47800320,"data_stored":764805120,"data_compressed":36317039,"data_compressed_allocated":47800320,"data_compressed_original":764805120,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T04:00:55.418 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T04:00:55.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:00:55.576+0000 7f06a6151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:55.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:00:55.585+0000 7f06a6151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:58.470 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T04:00:58.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:00:58.631+0000 7f3590991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:58.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:00:58.641+0000 7f3590991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:59.630 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T04:00:59.631 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T04:00:59.631 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T04:00:59.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:00:59.800+0000 7f36fbf91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:00:59.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:00:59.816+0000 7f36fbf91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:01:00.202 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T04:01:00.203 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-22T04:01:00.219 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":424,"stamp":"2024-09-22T04:00:59.112278+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":952107595,"num_objects":14524,"num_object_clones":0,"num_object_copies":43572,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":19619,"num_write_kb":1090901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19593,"ondisk_log_size":19593,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":621688,"kb_used_data":178424,"kb_used_omap":0,"kb_used_meta":443200,"kb_avail":376865672,"statfs":{"total":386547056640,"available":385910448128,"internally_reserved":0,"allocated":182706176,"data_stored":2881781457,"data_compressed":136803437,"data_compressed_allocated":180064256,"data_compressed_original":2880782336,"omap_allocated":0,"internal_metadata":453836800},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-124321792,"num_objects":-1897,"num_object_clones":0,"num_object_copies":-5691,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1897,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002491"},"pg_stats":[{"pgid":"6.f","version":"76'1268","reported_seq":1304,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:56.257560+0000","last_change":"2024-09-22T03:59:10.330036+0000","last_active":"2024-09-22T04:00:56.257560+0000","last_peered":"2024-09-22T04:00:56.257560+0000","last_clean":"2024-09-22T04:00:56.257560+0000","last_became_active":"2024-09-22T03:59:10.319097+0000","last_became_peered":"2024-09-22T03:59:10.319097+0000","last_unstale":"2024-09-22T04:00:56.257560+0000","last_undegraded":"2024-09-22T04:00:56.257560+0000","last_fullsized":"2024-09-22T04:00:56.257560+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":1268,"log_dups_size":0,"ondisk_log_size":1268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60817408,"num_objects":928,"num_object_clones":0,"num_object_copies":2784,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1268,"num_write_kb":70272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"76'1218","reported_seq":1254,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:55.071921+0000","last_change":"2024-09-22T03:59:10.321450+0000","last_active":"2024-09-22T04:00:55.071921+0000","last_peered":"2024-09-22T04:00:55.071921+0000","last_clean":"2024-09-22T04:00:55.071921+0000","last_became_active":"2024-09-22T03:59:10.311447+0000","last_became_peered":"2024-09-22T03:59:10.311447+0000","last_unstale":"2024-09-22T04:00:55.071921+0000","last_undegraded":"2024-09-22T04:00:55.071921+0000","last_fullsized":"2024-09-22T04:00:55.071921+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":1218,"log_dups_size":0,"ondisk_log_size":1218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59899904,"num_objects":914,"num_object_clones":0,"num_object_copies":2742,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1218,"num_write_kb":68224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"76'1219","reported_seq":1256,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:54.841613+0000","last_change":"2024-09-22T03:59:10.349259+0000","last_active":"2024-09-22T04:00:54.841613+0000","last_peered":"2024-09-22T04:00:54.841613+0000","last_clean":"2024-09-22T04:00:54.841613+0000","last_became_active":"2024-09-22T03:59:10.341464+0000","last_became_peered":"2024-09-22T03:59:10.341464+0000","last_unstale":"2024-09-22T04:00:54.841613+0000","last_undegraded":"2024-09-22T04:00:54.841613+0000","last_fullsized":"2024-09-22T04:00:54.841613+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":1219,"log_dups_size":0,"ondisk_log_size":1219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61079576,"num_objects":933,"num_object_clones":0,"num_object_copies":2799,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1219,"num_write_kb":68801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"76'1198","reported_seq":1234,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:56.142996+0000","last_change":"2024-09-22T03:59:10.365539+0000","last_active":"2024-09-22T04:00:56.142996+0000","last_peered":"2024-09-22T04:00:56.142996+0000","last_clean":"2024-09-22T04:00:56.142996+0000","last_became_active":"2024-09-22T03:59:10.339689+0000","last_became_peered":"2024-09-22T03:59:10.339689+0000","last_unstale":"2024-09-22T04:00:56.142996+0000","last_undegraded":"2024-09-22T04:00:56.142996+0000","last_fullsized":"2024-09-22T04:00:56.142996+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":1198,"log_dups_size":0,"ondisk_log_size":1198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57802752,"num_objects":882,"num_object_clones":0,"num_object_copies":2646,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1198,"num_write_kb":66560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"76'1223","reported_seq":1259,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:54.914343+0000","last_change":"2024-09-22T03:59:10.331496+0000","last_active":"2024-09-22T04:00:54.914343+0000","last_peered":"2024-09-22T04:00:54.914343+0000","last_clean":"2024-09-22T04:00:54.914343+0000","last_became_active":"2024-09-22T03:59:10.322922+0000","last_became_peered":"2024-09-22T03:59:10.322922+0000","last_unstale":"2024-09-22T04:00:54.914343+0000","last_undegraded":"2024-09-22T04:00:54.914343+0000","last_fullsized":"2024-09-22T04:00:54.914343+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":1223,"log_dups_size":0,"ondisk_log_size":1223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62586880,"num_objects":955,"num_object_clones":0,"num_object_copies":2865,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1223,"num_write_kb":69696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.a","version":"76'1161","reported_seq":1197,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:55.076277+0000","last_change":"2024-09-22T03:59:10.268812+0000","last_active":"2024-09-22T04:00:55.076277+0000","last_peered":"2024-09-22T04:00:55.076277+0000","last_clean":"2024-09-22T04:00:55.076277+0000","last_became_active":"2024-09-22T03:59:10.261529+0000","last_became_peered":"2024-09-22T03:59:10.261529+0000","last_unstale":"2024-09-22T04:00:55.076277+0000","last_undegraded":"2024-09-22T04:00:55.076277+0000","last_fullsized":"2024-09-22T04:00:55.076277+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":1161,"log_dups_size":0,"ondisk_log_size":1161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58261504,"num_objects":889,"num_object_clones":0,"num_object_copies":2667,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1161,"num_write_kb":65600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"76'1235","reported_seq":1271,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:55.195000+0000","last_change":"2024-09-22T03:59:10.357775+0000","last_active":"2024-09-22T04:00:55.195000+0000","last_peered":"2024-09-22T04:00:55.195000+0000","last_clean":"2024-09-22T04:00:55.195000+0000","last_became_active":"2024-09-22T03:59:10.350219+0000","last_became_peered":"2024-09-22T03:59:10.350219+0000","last_unstale":"2024-09-22T04:00:55.195000+0000","last_undegraded":"2024-09-22T04:00:55.195000+0000","last_fullsized":"2024-09-22T04:00:55.195000+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":1235,"log_dups_size":0,"ondisk_log_size":1235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61276160,"num_objects":935,"num_object_clones":0,"num_object_copies":2805,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1235,"num_write_kb":69440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"76'1155","reported_seq":1191,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:54.546461+0000","last_change":"2024-09-22T03:59:10.302834+0000","last_active":"2024-09-22T04:00:54.546461+0000","last_peered":"2024-09-22T04:00:54.546461+0000","last_clean":"2024-09-22T04:00:54.546461+0000","last_became_active":"2024-09-22T03:59:10.294403+0000","last_became_peered":"2024-09-22T03:59:10.294403+0000","last_unstale":"2024-09-22T04:00:54.546461+0000","last_undegraded":"2024-09-22T04:00:54.546461+0000","last_fullsized":"2024-09-22T04:00:54.546461+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":1155,"log_dups_size":0,"ondisk_log_size":1155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57606144,"num_objects":879,"num_object_clones":0,"num_object_copies":2637,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1155,"num_write_kb":65088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"76'1239","reported_seq":1275,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:54.846809+0000","last_change":"2024-09-22T03:59:10.311620+0000","last_active":"2024-09-22T04:00:54.846809+0000","last_peered":"2024-09-22T04:00:54.846809+0000","last_clean":"2024-09-22T04:00:54.846809+0000","last_became_active":"2024-09-22T03:59:10.304722+0000","last_became_peered":"2024-09-22T03:59:10.304722+0000","last_unstale":"2024-09-22T04:00:54.846809+0000","last_undegraded":"2024-09-22T04:00:54.846809+0000","last_fullsized":"2024-09-22T04:00:54.846809+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":1239,"log_dups_size":0,"ondisk_log_size":1239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60096512,"num_objects":917,"num_object_clones":0,"num_object_copies":2751,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1239,"num_write_kb":68992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":271,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:28.843226+0000","last_change":"2024-09-22T03:49:12.034704+0000","last_active":"2024-09-22T04:00:28.843226+0000","last_peered":"2024-09-22T04:00:28.843226+0000","last_clean":"2024-09-22T04:00:28.843226+0000","last_became_active":"2024-09-22T03:49:12.027470+0000","last_became_peered":"2024-09-22T03:49:12.027470+0000","last_unstale":"2024-09-22T04:00:28.843226+0000","last_undegraded":"2024-09-22T04:00:28.843226+0000","last_fullsized":"2024-09-22T04:00:28.843226+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_clean_scrub_stamp":"2024-09-22T03:49:10.979949+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":197,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:28.847103+0000","last_change":"2024-09-22T03:49:17.031458+0000","last_active":"2024-09-22T04:00:28.847103+0000","last_peered":"2024-09-22T04:00:28.847103+0000","last_clean":"2024-09-22T04:00:28.847103+0000","last_became_active":"2024-09-22T03:49:15.125490+0000","last_became_peered":"2024-09-22T03:49:15.125490+0000","last_unstale":"2024-09-22T04:00:28.847103+0000","last_undegraded":"2024-09-22T04:00:28.847103+0000","last_fullsized":"2024-09-22T04:00:28.847103+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"76'1266","reported_seq":1302,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:56.209116+0000","last_change":"2024-09-22T03:59:10.355702+0000","last_active":"2024-09-22T04:00:56.209116+0000","last_peered":"2024-09-22T04:00:56.209116+0000","last_clean":"2024-09-22T04:00:56.209116+0000","last_became_active":"2024-09-22T03:59:10.330418+0000","last_became_peered":"2024-09-22T03:59:10.330418+0000","last_unstale":"2024-09-22T04:00:56.209116+0000","last_undegraded":"2024-09-22T04:00:56.209116+0000","last_fullsized":"2024-09-22T04:00:56.209116+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":1266,"log_dups_size":0,"ondisk_log_size":1266,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58589184,"num_objects":894,"num_object_clones":0,"num_object_copies":2682,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1266,"num_write_kb":69120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:28.835971+0000","last_change":"2024-09-22T03:49:17.029339+0000","last_active":"2024-09-22T04:00:28.835971+0000","last_peered":"2024-09-22T04:00:28.835971+0000","last_clean":"2024-09-22T04:00:28.835971+0000","last_became_active":"2024-09-22T03:49:15.097304+0000","last_became_peered":"2024-09-22T03:49:15.097304+0000","last_unstale":"2024-09-22T04:00:28.835971+0000","last_undegraded":"2024-09-22T04:00:28.835971+0000","last_fullsized":"2024-09-22T04:00:28.835971+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.5","version":"76'1238","reported_seq":1274,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:55.045686+0000","last_change":"2024-09-22T03:59:10.300610+0000","last_active":"2024-09-22T04:00:55.045686+0000","last_peered":"2024-09-22T04:00:55.045686+0000","last_clean":"2024-09-22T04:00:55.045686+0000","last_became_active":"2024-09-22T03:59:10.293587+0000","last_became_peered":"2024-09-22T03:59:10.293587+0000","last_unstale":"2024-09-22T04:00:55.045686+0000","last_undegraded":"2024-09-22T04:00:55.045686+0000","last_fullsized":"2024-09-22T04:00:55.045686+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":1238,"log_dups_size":0,"ondisk_log_size":1238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58851328,"num_objects":898,"num_object_clones":0,"num_object_copies":2694,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1238,"num_write_kb":68352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:28.834492+0000","last_change":"2024-09-22T03:49:17.029349+0000","last_active":"2024-09-22T04:00:28.834492+0000","last_peered":"2024-09-22T04:00:28.834492+0000","last_clean":"2024-09-22T04:00:28.834492+0000","last_became_active":"2024-09-22T03:49:15.094890+0000","last_became_peered":"2024-09-22T03:49:15.094890+0000","last_unstale":"2024-09-22T04:00:28.834492+0000","last_undegraded":"2024-09-22T04:00:28.834492+0000","last_fullsized":"2024-09-22T04:00:28.834492+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"76'1242","reported_seq":1278,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:56.002222+0000","last_change":"2024-09-22T03:59:10.359896+0000","last_active":"2024-09-22T04:00:56.002222+0000","last_peered":"2024-09-22T04:00:56.002222+0000","last_clean":"2024-09-22T04:00:56.002222+0000","last_became_active":"2024-09-22T03:59:10.342929+0000","last_became_peered":"2024-09-22T03:59:10.342929+0000","last_unstale":"2024-09-22T04:00:56.002222+0000","last_undegraded":"2024-09-22T04:00:56.002222+0000","last_fullsized":"2024-09-22T04:00:56.002222+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":1242,"log_dups_size":0,"ondisk_log_size":1242,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57933824,"num_objects":884,"num_object_clones":0,"num_object_copies":2652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1242,"num_write_kb":68032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":198,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:28.839096+0000","last_change":"2024-09-22T03:49:17.031466+0000","last_active":"2024-09-22T04:00:28.839096+0000","last_peered":"2024-09-22T04:00:28.839096+0000","last_clean":"2024-09-22T04:00:28.839096+0000","last_became_active":"2024-09-22T03:49:15.098420+0000","last_became_peered":"2024-09-22T03:49:15.098420+0000","last_unstale":"2024-09-22T04:00:28.839096+0000","last_undegraded":"2024-09-22T04:00:28.839096+0000","last_fullsized":"2024-09-22T04:00:28.839096+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.0","version":"76'1205","reported_seq":1241,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:55.184376+0000","last_change":"2024-09-22T03:59:10.339795+0000","last_active":"2024-09-22T04:00:55.184376+0000","last_peered":"2024-09-22T04:00:55.184376+0000","last_clean":"2024-09-22T04:00:55.184376+0000","last_became_active":"2024-09-22T03:59:10.325306+0000","last_became_peered":"2024-09-22T03:59:10.325306+0000","last_unstale":"2024-09-22T04:00:55.184376+0000","last_undegraded":"2024-09-22T04:00:55.184376+0000","last_fullsized":"2024-09-22T04:00:55.184376+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":1205,"log_dups_size":0,"ondisk_log_size":1205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58523648,"num_objects":893,"num_object_clones":0,"num_object_copies":2679,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1205,"num_write_kb":67136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:28.846177+0000","last_change":"2024-09-22T03:49:17.036954+0000","last_active":"2024-09-22T04:00:28.846177+0000","last_peered":"2024-09-22T04:00:28.846177+0000","last_clean":"2024-09-22T04:00:28.846177+0000","last_became_active":"2024-09-22T03:49:15.110506+0000","last_became_peered":"2024-09-22T03:49:15.110506+0000","last_unstale":"2024-09-22T04:00:28.846177+0000","last_undegraded":"2024-09-22T04:00:28.846177+0000","last_fullsized":"2024-09-22T04:00:28.846177+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"76'1233","reported_seq":1269,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:56.196596+0000","last_change":"2024-09-22T03:59:10.361108+0000","last_active":"2024-09-22T04:00:56.196596+0000","last_peered":"2024-09-22T04:00:56.196596+0000","last_clean":"2024-09-22T04:00:56.196596+0000","last_became_active":"2024-09-22T03:59:10.347213+0000","last_became_peered":"2024-09-22T03:59:10.347213+0000","last_unstale":"2024-09-22T04:00:56.196596+0000","last_undegraded":"2024-09-22T04:00:56.196596+0000","last_fullsized":"2024-09-22T04:00:56.196596+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":1233,"log_dups_size":0,"ondisk_log_size":1233,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59834368,"num_objects":913,"num_object_clones":0,"num_object_copies":2739,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1233,"num_write_kb":68672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:28.844399+0000","last_change":"2024-09-22T03:49:17.032989+0000","last_active":"2024-09-22T04:00:28.844399+0000","last_peered":"2024-09-22T04:00:28.844399+0000","last_clean":"2024-09-22T04:00:28.844399+0000","last_became_active":"2024-09-22T03:49:15.079260+0000","last_became_peered":"2024-09-22T03:49:15.079260+0000","last_unstale":"2024-09-22T04:00:28.844399+0000","last_undegraded":"2024-09-22T04:00:28.844399+0000","last_fullsized":"2024-09-22T04:00:28.844399+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2","version":"76'1174","reported_seq":1210,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:55.051341+0000","last_change":"2024-09-22T03:59:10.318033+0000","last_active":"2024-09-22T04:00:55.051341+0000","last_peered":"2024-09-22T04:00:55.051341+0000","last_clean":"2024-09-22T04:00:55.051341+0000","last_became_active":"2024-09-22T03:59:10.308707+0000","last_became_peered":"2024-09-22T03:59:10.308707+0000","last_unstale":"2024-09-22T04:00:55.051341+0000","last_undegraded":"2024-09-22T04:00:55.051341+0000","last_fullsized":"2024-09-22T04:00:55.051341+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":1174,"log_dups_size":0,"ondisk_log_size":1174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58195968,"num_objects":888,"num_object_clones":0,"num_object_copies":2664,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1174,"num_write_kb":65984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:28.849513+0000","last_change":"2024-09-22T03:49:17.036402+0000","last_active":"2024-09-22T04:00:28.849513+0000","last_peered":"2024-09-22T04:00:28.849513+0000","last_clean":"2024-09-22T04:00:28.849513+0000","last_became_active":"2024-09-22T03:49:15.108430+0000","last_became_peered":"2024-09-22T03:49:15.108430+0000","last_unstale":"2024-09-22T04:00:28.849513+0000","last_undegraded":"2024-09-22T04:00:28.849513+0000","last_fullsized":"2024-09-22T04:00:28.849513+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"76'1264","reported_seq":1300,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:55.103258+0000","last_change":"2024-09-22T03:59:10.277817+0000","last_active":"2024-09-22T04:00:55.103258+0000","last_peered":"2024-09-22T04:00:55.103258+0000","last_clean":"2024-09-22T04:00:55.103258+0000","last_became_active":"2024-09-22T03:59:10.263119+0000","last_became_peered":"2024-09-22T03:59:10.263119+0000","last_unstale":"2024-09-22T04:00:55.103258+0000","last_undegraded":"2024-09-22T04:00:55.103258+0000","last_fullsized":"2024-09-22T04:00:55.103258+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":1264,"log_dups_size":0,"ondisk_log_size":1264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60162048,"num_objects":918,"num_object_clones":0,"num_object_copies":2754,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1264,"num_write_kb":69824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:28.833568+0000","last_change":"2024-09-22T03:49:17.029128+0000","last_active":"2024-09-22T04:00:28.833568+0000","last_peered":"2024-09-22T04:00:28.833568+0000","last_clean":"2024-09-22T04:00:28.833568+0000","last_became_active":"2024-09-22T03:49:15.113396+0000","last_became_peered":"2024-09-22T03:49:15.113396+0000","last_unstale":"2024-09-22T04:00:28.833568+0000","last_undegraded":"2024-09-22T04:00:28.833568+0000","last_fullsized":"2024-09-22T04:00:28.833568+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":951517208,"num_objects":14520,"num_object_clones":0,"num_object_copies":43560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":19538,"num_write_kb":1089793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":178683904,"data_stored":2858745928,"data_compressed":135748549,"data_compressed_allocated":178671616,"data_compressed_original":2858745856,"omap_allocated":0,"internal_metadata":0},"log_size":19538,"ondisk_log_size":19538,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949673663,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":151792,"kb_used_data":44448,"kb_used_omap":0,"kb_used_meta":107328,"kb_avail":94220048,"statfs":{"total":96636764160,"available":96481329152,"internally_reserved":0,"allocated":45514752,"data_stored":717725767,"data_compressed":34072223,"data_compressed_allocated":44847104,"data_compressed_original":717471744,"omap_allocated":0,"internal_metadata":109903872},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654706367,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":170324,"kb_used_data":44932,"kb_used_omap":0,"kb_used_meta":125376,"kb_avail":94201516,"statfs":{"total":96636764160,"available":96462352384,"internally_reserved":0,"allocated":46010368,"data_stored":726113807,"data_compressed":34468511,"data_compressed_allocated":45367296,"data_compressed_original":725876736,"omap_allocated":0,"internal_metadata":128385024},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706367,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":159896,"kb_used_data":48392,"kb_used_omap":0,"kb_used_meta":111488,"kb_avail":94211944,"statfs":{"total":96636764160,"available":96473030656,"internally_reserved":0,"allocated":49553408,"data_stored":782344263,"data_compressed":37140656,"data_compressed_allocated":48885760,"data_compressed_original":782090240,"omap_allocated":0,"internal_metadata":114163712},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706367,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":139676,"kb_used_data":40652,"kb_used_omap":0,"kb_used_meta":99008,"kb_avail":94232164,"statfs":{"total":96636764160,"available":96493735936,"internally_reserved":0,"allocated":41627648,"data_stored":655597620,"data_compressed":31122047,"data_compressed_allocated":40964096,"data_compressed_original":655343616,"omap_allocated":0,"internal_metadata":101384192},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40681472,"data_stored":650838040,"data_compressed":30905271,"data_compressed_allocated":40677376,"data_compressed_original":650838016,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":44470272,"data_stored":711458840,"data_compressed":33783871,"data_compressed_allocated":44466176,"data_compressed_original":711458816,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":48615424,"data_stored":777781272,"data_compressed":36933216,"data_compressed_allocated":48611328,"data_compressed_original":777781248,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":44916736,"data_stored":718667776,"data_compressed":34126191,"data_compressed_allocated":44916736,"data_compressed_original":718667776,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T04:01:01.207 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T04:01:01.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:01:01.380+0000 7f43e8791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:01:01.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:01:01.393+0000 7f43e8791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:01:03.930 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T04:01:04.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:01:04.067+0000 7effe3391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:01:04.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:01:04.076+0000 7effe3391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:01:05.221 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T04:01:05.221 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T04:01:05.221 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T04:01:05.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:01:05.381+0000 7f651d191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:01:05.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:01:05.396+0000 7f651d191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:01:05.759 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T04:01:05.759 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-22T04:01:05.779 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":427,"stamp":"2024-09-22T04:01:05.113542+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":891355723,"num_objects":13597,"num_object_clones":0,"num_object_copies":40791,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":20546,"num_write_kb":1090901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":20520,"ondisk_log_size":20520,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":624348,"kb_used_data":167184,"kb_used_omap":0,"kb_used_meta":457088,"kb_avail":376863012,"statfs":{"total":386547056640,"available":385907724288,"internally_reserved":0,"allocated":171196416,"data_stored":2697625297,"data_compressed":128058717,"data_compressed_allocated":168554496,"data_compressed_original":2696626176,"omap_allocated":0,"internal_metadata":468058112},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-122814464,"num_objects":-1874,"num_object_clones":0,"num_object_copies":-5622,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1874,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002549"},"pg_stats":[{"pgid":"6.f","version":"76'1328","reported_seq":1364,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:01:01.007814+0000","last_change":"2024-09-22T03:59:10.330036+0000","last_active":"2024-09-22T04:01:01.007814+0000","last_peered":"2024-09-22T04:01:01.007814+0000","last_clean":"2024-09-22T04:01:01.007814+0000","last_became_active":"2024-09-22T03:59:10.319097+0000","last_became_peered":"2024-09-22T03:59:10.319097+0000","last_unstale":"2024-09-22T04:01:01.007814+0000","last_undegraded":"2024-09-22T04:01:01.007814+0000","last_fullsized":"2024-09-22T04:01:01.007814+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":1328,"log_dups_size":0,"ondisk_log_size":1328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56885248,"num_objects":868,"num_object_clones":0,"num_object_copies":2604,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1328,"num_write_kb":70272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"76'1279","reported_seq":1315,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:01:00.094876+0000","last_change":"2024-09-22T03:59:10.321450+0000","last_active":"2024-09-22T04:01:00.094876+0000","last_peered":"2024-09-22T04:01:00.094876+0000","last_clean":"2024-09-22T04:01:00.094876+0000","last_became_active":"2024-09-22T03:59:10.311447+0000","last_became_peered":"2024-09-22T03:59:10.311447+0000","last_unstale":"2024-09-22T04:01:00.094876+0000","last_undegraded":"2024-09-22T04:01:00.094876+0000","last_fullsized":"2024-09-22T04:01:00.094876+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":1279,"log_dups_size":0,"ondisk_log_size":1279,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55902208,"num_objects":853,"num_object_clones":0,"num_object_copies":2559,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1279,"num_write_kb":68224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"76'1278","reported_seq":1315,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:59.860408+0000","last_change":"2024-09-22T03:59:10.349259+0000","last_active":"2024-09-22T04:00:59.860408+0000","last_peered":"2024-09-22T04:00:59.860408+0000","last_clean":"2024-09-22T04:00:59.860408+0000","last_became_active":"2024-09-22T03:59:10.341464+0000","last_became_peered":"2024-09-22T03:59:10.341464+0000","last_unstale":"2024-09-22T04:00:59.860408+0000","last_undegraded":"2024-09-22T04:00:59.860408+0000","last_fullsized":"2024-09-22T04:00:59.860408+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":1278,"log_dups_size":0,"ondisk_log_size":1278,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57212952,"num_objects":874,"num_object_clones":0,"num_object_copies":2622,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1278,"num_write_kb":68801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"76'1253","reported_seq":1289,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:01:01.162150+0000","last_change":"2024-09-22T03:59:10.365539+0000","last_active":"2024-09-22T04:01:01.162150+0000","last_peered":"2024-09-22T04:01:01.162150+0000","last_clean":"2024-09-22T04:01:01.162150+0000","last_became_active":"2024-09-22T03:59:10.339689+0000","last_became_peered":"2024-09-22T03:59:10.339689+0000","last_unstale":"2024-09-22T04:01:01.162150+0000","last_undegraded":"2024-09-22T04:01:01.162150+0000","last_fullsized":"2024-09-22T04:01:01.162150+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":1253,"log_dups_size":0,"ondisk_log_size":1253,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54198272,"num_objects":827,"num_object_clones":0,"num_object_copies":2481,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1253,"num_write_kb":66560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"76'1271","reported_seq":1307,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:01:00.074355+0000","last_change":"2024-09-22T03:59:10.331496+0000","last_active":"2024-09-22T04:01:00.074355+0000","last_peered":"2024-09-22T04:01:00.074355+0000","last_clean":"2024-09-22T04:01:00.074355+0000","last_became_active":"2024-09-22T03:59:10.322922+0000","last_became_peered":"2024-09-22T03:59:10.322922+0000","last_unstale":"2024-09-22T04:01:00.074355+0000","last_undegraded":"2024-09-22T04:01:00.074355+0000","last_fullsized":"2024-09-22T04:01:00.074355+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":1271,"log_dups_size":0,"ondisk_log_size":1271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59441152,"num_objects":907,"num_object_clones":0,"num_object_copies":2721,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1271,"num_write_kb":69696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.a","version":"76'1211","reported_seq":1247,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:01:00.237539+0000","last_change":"2024-09-22T03:59:10.268812+0000","last_active":"2024-09-22T04:01:00.237539+0000","last_peered":"2024-09-22T04:01:00.237539+0000","last_clean":"2024-09-22T04:01:00.237539+0000","last_became_active":"2024-09-22T03:59:10.261529+0000","last_became_peered":"2024-09-22T03:59:10.261529+0000","last_unstale":"2024-09-22T04:01:00.237539+0000","last_undegraded":"2024-09-22T04:01:00.237539+0000","last_fullsized":"2024-09-22T04:01:00.237539+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":1211,"log_dups_size":0,"ondisk_log_size":1211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54984704,"num_objects":839,"num_object_clones":0,"num_object_copies":2517,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1211,"num_write_kb":65600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"76'1286","reported_seq":1322,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:01:00.098297+0000","last_change":"2024-09-22T03:59:10.357775+0000","last_active":"2024-09-22T04:01:00.098297+0000","last_peered":"2024-09-22T04:01:00.098297+0000","last_clean":"2024-09-22T04:01:00.098297+0000","last_became_active":"2024-09-22T03:59:10.350219+0000","last_became_peered":"2024-09-22T03:59:10.350219+0000","last_unstale":"2024-09-22T04:01:00.098297+0000","last_undegraded":"2024-09-22T04:01:00.098297+0000","last_fullsized":"2024-09-22T04:01:00.098297+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":1286,"log_dups_size":0,"ondisk_log_size":1286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57933824,"num_objects":884,"num_object_clones":0,"num_object_copies":2652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1286,"num_write_kb":69440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"76'1213","reported_seq":1249,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:01:00.064016+0000","last_change":"2024-09-22T03:59:10.302834+0000","last_active":"2024-09-22T04:01:00.064016+0000","last_peered":"2024-09-22T04:01:00.064016+0000","last_clean":"2024-09-22T04:01:00.064016+0000","last_became_active":"2024-09-22T03:59:10.294403+0000","last_became_peered":"2024-09-22T03:59:10.294403+0000","last_unstale":"2024-09-22T04:01:00.064016+0000","last_undegraded":"2024-09-22T04:01:00.064016+0000","last_fullsized":"2024-09-22T04:01:00.064016+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":1213,"log_dups_size":0,"ondisk_log_size":1213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53805056,"num_objects":821,"num_object_clones":0,"num_object_copies":2463,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1213,"num_write_kb":65088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"76'1297","reported_seq":1333,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:01:00.010820+0000","last_change":"2024-09-22T03:59:10.311620+0000","last_active":"2024-09-22T04:01:00.010820+0000","last_peered":"2024-09-22T04:01:00.010820+0000","last_clean":"2024-09-22T04:01:00.010820+0000","last_became_active":"2024-09-22T03:59:10.304722+0000","last_became_peered":"2024-09-22T03:59:10.304722+0000","last_unstale":"2024-09-22T04:01:00.010820+0000","last_undegraded":"2024-09-22T04:01:00.010820+0000","last_fullsized":"2024-09-22T04:01:00.010820+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":1297,"log_dups_size":0,"ondisk_log_size":1297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56295424,"num_objects":859,"num_object_clones":0,"num_object_copies":2577,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1297,"num_write_kb":68992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":271,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:28.843226+0000","last_change":"2024-09-22T03:49:12.034704+0000","last_active":"2024-09-22T04:00:28.843226+0000","last_peered":"2024-09-22T04:00:28.843226+0000","last_clean":"2024-09-22T04:00:28.843226+0000","last_became_active":"2024-09-22T03:49:12.027470+0000","last_became_peered":"2024-09-22T03:49:12.027470+0000","last_unstale":"2024-09-22T04:00:28.843226+0000","last_undegraded":"2024-09-22T04:00:28.843226+0000","last_fullsized":"2024-09-22T04:00:28.843226+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_clean_scrub_stamp":"2024-09-22T03:49:10.979949+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":197,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:28.847103+0000","last_change":"2024-09-22T03:49:17.031458+0000","last_active":"2024-09-22T04:00:28.847103+0000","last_peered":"2024-09-22T04:00:28.847103+0000","last_clean":"2024-09-22T04:00:28.847103+0000","last_became_active":"2024-09-22T03:49:15.125490+0000","last_became_peered":"2024-09-22T03:49:15.125490+0000","last_unstale":"2024-09-22T04:00:28.847103+0000","last_undegraded":"2024-09-22T04:00:28.847103+0000","last_fullsized":"2024-09-22T04:00:28.847103+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"76'1319","reported_seq":1355,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:01:01.199549+0000","last_change":"2024-09-22T03:59:10.355702+0000","last_active":"2024-09-22T04:01:01.199549+0000","last_peered":"2024-09-22T04:01:01.199549+0000","last_clean":"2024-09-22T04:01:01.199549+0000","last_became_active":"2024-09-22T03:59:10.330418+0000","last_became_peered":"2024-09-22T03:59:10.330418+0000","last_unstale":"2024-09-22T04:01:01.199549+0000","last_undegraded":"2024-09-22T04:01:01.199549+0000","last_fullsized":"2024-09-22T04:01:01.199549+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":1319,"log_dups_size":0,"ondisk_log_size":1319,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55115776,"num_objects":841,"num_object_clones":0,"num_object_copies":2523,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1319,"num_write_kb":69120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:28.835971+0000","last_change":"2024-09-22T03:49:17.029339+0000","last_active":"2024-09-22T04:00:28.835971+0000","last_peered":"2024-09-22T04:00:28.835971+0000","last_clean":"2024-09-22T04:00:28.835971+0000","last_became_active":"2024-09-22T03:49:15.097304+0000","last_became_peered":"2024-09-22T03:49:15.097304+0000","last_unstale":"2024-09-22T04:00:28.835971+0000","last_undegraded":"2024-09-22T04:00:28.835971+0000","last_fullsized":"2024-09-22T04:00:28.835971+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.5","version":"76'1310","reported_seq":1346,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:01:00.108972+0000","last_change":"2024-09-22T03:59:10.300610+0000","last_active":"2024-09-22T04:01:00.108972+0000","last_peered":"2024-09-22T04:01:00.108972+0000","last_clean":"2024-09-22T04:01:00.108972+0000","last_became_active":"2024-09-22T03:59:10.293587+0000","last_became_peered":"2024-09-22T03:59:10.293587+0000","last_unstale":"2024-09-22T04:01:00.108972+0000","last_undegraded":"2024-09-22T04:01:00.108972+0000","last_fullsized":"2024-09-22T04:01:00.108972+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":1310,"log_dups_size":0,"ondisk_log_size":1310,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54132736,"num_objects":826,"num_object_clones":0,"num_object_copies":2478,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1310,"num_write_kb":68352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:28.834492+0000","last_change":"2024-09-22T03:49:17.029349+0000","last_active":"2024-09-22T04:00:28.834492+0000","last_peered":"2024-09-22T04:00:28.834492+0000","last_clean":"2024-09-22T04:00:28.834492+0000","last_became_active":"2024-09-22T03:49:15.094890+0000","last_became_peered":"2024-09-22T03:49:15.094890+0000","last_unstale":"2024-09-22T04:00:28.834492+0000","last_undegraded":"2024-09-22T04:00:28.834492+0000","last_fullsized":"2024-09-22T04:00:28.834492+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"76'1305","reported_seq":1341,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:01:01.180336+0000","last_change":"2024-09-22T03:59:10.359896+0000","last_active":"2024-09-22T04:01:01.180336+0000","last_peered":"2024-09-22T04:01:01.180336+0000","last_clean":"2024-09-22T04:01:01.180336+0000","last_became_active":"2024-09-22T03:59:10.342929+0000","last_became_peered":"2024-09-22T03:59:10.342929+0000","last_unstale":"2024-09-22T04:01:01.180336+0000","last_undegraded":"2024-09-22T04:01:01.180336+0000","last_fullsized":"2024-09-22T04:01:01.180336+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":1305,"log_dups_size":0,"ondisk_log_size":1305,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53805056,"num_objects":821,"num_object_clones":0,"num_object_copies":2463,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1305,"num_write_kb":68032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":198,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:28.839096+0000","last_change":"2024-09-22T03:49:17.031466+0000","last_active":"2024-09-22T04:00:28.839096+0000","last_peered":"2024-09-22T04:00:28.839096+0000","last_clean":"2024-09-22T04:00:28.839096+0000","last_became_active":"2024-09-22T03:49:15.098420+0000","last_became_peered":"2024-09-22T03:49:15.098420+0000","last_unstale":"2024-09-22T04:00:28.839096+0000","last_undegraded":"2024-09-22T04:00:28.839096+0000","last_fullsized":"2024-09-22T04:00:28.839096+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.0","version":"76'1262","reported_seq":1298,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:59.964633+0000","last_change":"2024-09-22T03:59:10.339795+0000","last_active":"2024-09-22T04:00:59.964633+0000","last_peered":"2024-09-22T04:00:59.964633+0000","last_clean":"2024-09-22T04:00:59.964633+0000","last_became_active":"2024-09-22T03:59:10.325306+0000","last_became_peered":"2024-09-22T03:59:10.325306+0000","last_unstale":"2024-09-22T04:00:59.964633+0000","last_undegraded":"2024-09-22T04:00:59.964633+0000","last_fullsized":"2024-09-22T04:00:59.964633+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":1262,"log_dups_size":0,"ondisk_log_size":1262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54788096,"num_objects":836,"num_object_clones":0,"num_object_copies":2508,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1262,"num_write_kb":67136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:28.846177+0000","last_change":"2024-09-22T03:49:17.036954+0000","last_active":"2024-09-22T04:00:28.846177+0000","last_peered":"2024-09-22T04:00:28.846177+0000","last_clean":"2024-09-22T04:00:28.846177+0000","last_became_active":"2024-09-22T03:49:15.110506+0000","last_became_peered":"2024-09-22T03:49:15.110506+0000","last_unstale":"2024-09-22T04:00:28.846177+0000","last_undegraded":"2024-09-22T04:00:28.846177+0000","last_fullsized":"2024-09-22T04:00:28.846177+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"76'1290","reported_seq":1326,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:01:01.231757+0000","last_change":"2024-09-22T03:59:10.361108+0000","last_active":"2024-09-22T04:01:01.231757+0000","last_peered":"2024-09-22T04:01:01.231757+0000","last_clean":"2024-09-22T04:01:01.231757+0000","last_became_active":"2024-09-22T03:59:10.347213+0000","last_became_peered":"2024-09-22T03:59:10.347213+0000","last_unstale":"2024-09-22T04:01:01.231757+0000","last_undegraded":"2024-09-22T04:01:01.231757+0000","last_fullsized":"2024-09-22T04:01:01.231757+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":1290,"log_dups_size":0,"ondisk_log_size":1290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56098816,"num_objects":856,"num_object_clones":0,"num_object_copies":2568,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1290,"num_write_kb":68672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:28.844399+0000","last_change":"2024-09-22T03:49:17.032989+0000","last_active":"2024-09-22T04:00:28.844399+0000","last_peered":"2024-09-22T04:00:28.844399+0000","last_clean":"2024-09-22T04:00:28.844399+0000","last_became_active":"2024-09-22T03:49:15.079260+0000","last_became_peered":"2024-09-22T03:49:15.079260+0000","last_unstale":"2024-09-22T04:00:28.844399+0000","last_undegraded":"2024-09-22T04:00:28.844399+0000","last_fullsized":"2024-09-22T04:00:28.844399+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2","version":"76'1228","reported_seq":1264,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:01:00.039225+0000","last_change":"2024-09-22T03:59:10.318033+0000","last_active":"2024-09-22T04:01:00.039225+0000","last_peered":"2024-09-22T04:01:00.039225+0000","last_clean":"2024-09-22T04:01:00.039225+0000","last_became_active":"2024-09-22T03:59:10.308707+0000","last_became_peered":"2024-09-22T03:59:10.308707+0000","last_unstale":"2024-09-22T04:01:00.039225+0000","last_undegraded":"2024-09-22T04:01:00.039225+0000","last_fullsized":"2024-09-22T04:01:00.039225+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":1228,"log_dups_size":0,"ondisk_log_size":1228,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54657024,"num_objects":834,"num_object_clones":0,"num_object_copies":2502,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1228,"num_write_kb":65984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:28.849513+0000","last_change":"2024-09-22T03:49:17.036402+0000","last_active":"2024-09-22T04:00:28.849513+0000","last_peered":"2024-09-22T04:00:28.849513+0000","last_clean":"2024-09-22T04:00:28.849513+0000","last_became_active":"2024-09-22T03:49:15.108430+0000","last_became_peered":"2024-09-22T03:49:15.108430+0000","last_unstale":"2024-09-22T04:00:28.849513+0000","last_undegraded":"2024-09-22T04:00:28.849513+0000","last_fullsized":"2024-09-22T04:00:28.849513+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"76'1335","reported_seq":1371,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:01:00.087996+0000","last_change":"2024-09-22T03:59:10.277817+0000","last_active":"2024-09-22T04:01:00.087996+0000","last_peered":"2024-09-22T04:01:00.087996+0000","last_clean":"2024-09-22T04:01:00.087996+0000","last_became_active":"2024-09-22T03:59:10.263119+0000","last_became_peered":"2024-09-22T03:59:10.263119+0000","last_unstale":"2024-09-22T04:01:00.087996+0000","last_undegraded":"2024-09-22T04:01:00.087996+0000","last_fullsized":"2024-09-22T04:01:00.087996+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":1335,"log_dups_size":0,"ondisk_log_size":1335,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55508992,"num_objects":847,"num_object_clones":0,"num_object_copies":2541,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1335,"num_write_kb":69824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:28.833568+0000","last_change":"2024-09-22T03:49:17.029128+0000","last_active":"2024-09-22T04:00:28.833568+0000","last_peered":"2024-09-22T04:00:28.833568+0000","last_clean":"2024-09-22T04:00:28.833568+0000","last_became_active":"2024-09-22T03:49:15.113396+0000","last_became_peered":"2024-09-22T03:49:15.113396+0000","last_unstale":"2024-09-22T04:00:28.833568+0000","last_undegraded":"2024-09-22T04:00:28.833568+0000","last_fullsized":"2024-09-22T04:00:28.833568+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":890765336,"num_objects":13593,"num_object_clones":0,"num_object_copies":40779,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20465,"num_write_kb":1089793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":167157760,"data_stored":2674327624,"data_compressed":126991381,"data_compressed_allocated":167145472,"data_compressed_original":2674327552,"omap_allocated":0,"internal_metadata":0},"log_size":20465,"ondisk_log_size":20465,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949673668,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":148948,"kb_used_data":41600,"kb_used_omap":0,"kb_used_meta":107328,"kb_avail":94222892,"statfs":{"total":96636764160,"available":96484241408,"internally_reserved":0,"allocated":42598400,"data_stored":671064135,"data_compressed":31856479,"data_compressed_allocated":41930752,"data_compressed_original":670810112,"omap_allocated":0,"internal_metadata":109903872},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654706372,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":171712,"kb_used_data":42156,"kb_used_omap":0,"kb_used_meta":129536,"kb_avail":94200128,"statfs":{"total":96636764160,"available":96460931072,"internally_reserved":0,"allocated":43167744,"data_stored":680631823,"data_compressed":32308783,"data_compressed_allocated":42524672,"data_compressed_original":680394752,"omap_allocated":0,"internal_metadata":132644864},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706372,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":162448,"kb_used_data":45376,"kb_used_omap":0,"kb_used_meta":117056,"kb_avail":94209392,"statfs":{"total":96636764160,"available":96470417408,"internally_reserved":0,"allocated":46465024,"data_stored":732930119,"data_compressed":34794208,"data_compressed_allocated":45797376,"data_compressed_original":732676096,"omap_allocated":0,"internal_metadata":119865344},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706372,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":141240,"kb_used_data":38052,"kb_used_omap":0,"kb_used_meta":103168,"kb_avail":94230600,"statfs":{"total":96636764160,"available":96492134400,"internally_reserved":0,"allocated":38965248,"data_stored":612999220,"data_compressed":29099247,"data_compressed_allocated":38301696,"data_compressed_original":612745216,"omap_allocated":0,"internal_metadata":105644032},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":38019072,"data_stored":608239640,"data_compressed":28882471,"data_compressed_allocated":38014976,"data_compressed_original":608239616,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":41586688,"data_stored":665321496,"data_compressed":31593023,"data_compressed_allocated":41582592,"data_compressed_original":665321472,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45522944,"data_stored":728301592,"data_compressed":34583656,"data_compressed_allocated":45518848,"data_compressed_original":728301568,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":42029056,"data_stored":672464896,"data_compressed":31932231,"data_compressed_allocated":42029056,"data_compressed_original":672464896,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T04:01:06.565 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T04:01:06.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:01:06.710+0000 7fb80cf48640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:01:06.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:01:06.723+0000 7fb80cf48640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:01:09.291 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T04:01:09.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:01:09.437+0000 7fdbde111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:01:09.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:01:09.444+0000 7fdbde111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:01:10.781 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T04:01:10.781 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T04:01:10.782 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T04:01:10.782 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T04:01:10.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:01:10.954+0000 7f289db91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:01:10.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:01:10.967+0000 7f289db91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:01:11.023 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:01:11.023 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:01:11.023 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:01:11.023 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:01:11.024 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:01:11.024 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:01:11.024 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:01:11.024 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:01:11.024 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:01:11.024 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:01:11.024 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:01:11.024 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:01:11.026 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:01:11.027 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:01:11.027 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T04:01:11.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:01:11.175+0000 7f8ac0e74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:01:11.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:01:11.188+0000 7f8ac0e74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:01:11.428 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:01:11.428 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:01:11.428 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:01:11.428 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:01:11.428 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:01:11.428 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:01:11.428 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:01:11.428 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:01:11.428 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:01:11.428 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:01:11.429 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:01:11.429 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:01:11.431 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:01:11.432 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:01:11.432 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T04:01:11.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:01:11.610+0000 7fbbb4191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:01:11.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:01:11.625+0000 7fbbb4191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:01:11.685 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:01:11.685 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:01:11.685 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:01:11.685 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:01:11.685 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:01:11.685 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:01:11.685 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:01:11.685 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:01:11.685 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:01:11.685 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:01:11.685 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:01:11.686 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:01:11.688 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:01:11.688 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:01:11.689 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T04:01:11.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:01:11.844+0000 7fb527a74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:01:11.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:01:11.862+0000 7fb527a74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:01:11.945 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:01:11.945 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:01:11.946 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:01:11.946 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:01:11.946 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:01:11.946 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:01:11.946 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:01:11.946 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:01:11.946 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:01:11.946 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:01:11.946 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:01:11.946 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:01:11.949 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:01:11.950 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:01:12.180 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T04:01:12.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:01:12.342+0000 7fbbb3f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:01:12.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:01:12.350+0000 7fbbb3f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:01:14.684 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T04:01:14.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:01:14.845+0000 7f233a591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:01:14.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:01:14.856+0000 7f233a591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:01:16.950 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T04:01:16.950 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T04:01:16.950 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T04:01:16.950 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T04:01:17.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:01:17.107+0000 7f04e3591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:01:17.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:01:17.124+0000 7f04e3591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:01:17.290 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:01:17.290 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:01:17.290 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:01:17.290 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:01:17.291 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:01:17.291 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:01:17.291 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:01:17.291 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:01:17.291 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:01:17.291 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:01:17.291 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:01:17.292 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:01:17.294 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:01:17.294 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:01:17.295 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T04:01:17.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:01:17.466+0000 7f16eb991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:01:17.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:01:17.482+0000 7f16eb991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:01:17.631 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T04:01:17.715 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:01:17.715 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:01:17.715 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:01:17.715 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:01:17.715 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:01:17.715 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:01:17.716 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:01:17.716 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:01:17.716 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:01:17.716 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:01:17.716 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:01:17.716 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:01:17.719 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:01:17.719 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:01:17.720 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T04:01:17.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:01:17.797+0000 7f1583c46640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:01:17.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:01:17.806+0000 7f1583c46640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:01:17.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:01:17.892+0000 7f5f1127d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:01:17.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:01:17.908+0000 7f5f1127d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:01:17.934 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:01:17.934 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:01:17.934 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:01:17.934 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:01:17.934 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:01:17.934 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:01:17.935 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:01:17.935 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:01:17.935 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:01:17.935 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:01:17.935 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:01:17.935 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:01:17.940 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:01:17.940 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:01:17.940 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T04:01:18.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:01:18.086+0000 7f95f5591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:01:18.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:01:18.106+0000 7f95f5591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:01:18.132 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:01:18.132 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:01:18.132 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:01:18.132 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:01:18.132 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:01:18.132 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:01:18.132 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:01:18.133 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:01:18.133 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:01:18.133 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:01:18.133 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:01:18.133 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:01:18.137 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:01:18.137 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:01:20.242 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T04:01:20.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:01:20.398+0000 7f61f7191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:01:20.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:01:20.407+0000 7f61f7191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:01:23.094 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T04:01:23.138 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T04:01:23.138 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T04:01:23.138 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T04:01:23.138 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T04:01:23.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:01:23.237+0000 7f2842151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:01:23.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:01:23.249+0000 7f2842151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:01:23.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:01:23.293+0000 7fb6fb791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:01:23.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:01:23.308+0000 7fb6fb791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:01:23.382 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:01:23.382 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:01:23.382 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:01:23.382 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:01:23.382 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:01:23.382 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:01:23.382 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:01:23.383 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:01:23.383 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:01:23.383 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:01:23.383 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:01:23.383 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:01:23.386 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:01:23.386 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:01:23.386 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T04:01:23.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:01:23.535+0000 7f3842d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:01:23.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:01:23.555+0000 7f3842d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:01:23.835 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:01:23.835 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:01:23.835 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:01:23.835 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:01:23.835 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:01:23.835 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:01:23.836 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:01:23.836 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:01:23.836 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:01:23.836 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:01:23.836 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:01:23.836 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:01:23.840 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:01:23.840 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:01:23.840 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T04:01:24.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:01:24.021+0000 7f82f367d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:01:24.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:01:24.040+0000 7f82f367d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:01:24.094 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:01:24.094 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:01:24.094 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:01:24.095 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:01:24.095 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:01:24.095 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:01:24.095 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:01:24.095 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:01:24.095 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:01:24.095 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:01:24.095 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:01:24.095 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:01:24.099 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:01:24.099 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:01:24.099 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T04:01:24.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:01:24.275+0000 7f04f3863640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:01:24.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:01:24.303+0000 7f04f3863640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:01:24.363 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:01:24.363 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:01:24.363 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:01:24.363 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:01:24.363 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:01:24.363 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:01:24.363 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:01:24.363 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:01:24.363 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:01:24.363 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:01:24.363 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:01:24.363 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:01:24.366 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:01:24.367 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:01:25.749 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T04:01:25.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:01:25.907+0000 7f9c8f4d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:01:25.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:01:25.917+0000 7f9c8f4d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:01:28.537 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T04:01:28.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:01:28.687+0000 7f50e7951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:01:28.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:01:28.699+0000 7f50e7951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:01:29.368 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T04:01:29.368 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T04:01:29.368 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T04:01:29.368 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T04:01:29.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:01:29.492+0000 7fd2ee191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:01:29.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:01:29.506+0000 7fd2ee191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:01:29.586 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:01:29.586 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:01:29.586 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:01:29.586 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:01:29.586 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:01:29.586 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:01:29.586 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:01:29.586 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:01:29.586 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:01:29.586 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:01:29.586 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:01:29.587 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:01:29.589 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:01:29.589 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:01:29.589 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T04:01:29.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:01:29.723+0000 7fd2798ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:01:29.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:01:29.739+0000 7fd2798ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:01:29.849 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:01:29.849 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:01:29.849 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:01:29.849 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:01:29.849 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:01:29.850 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:01:29.850 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:01:29.850 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:01:29.850 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:01:29.850 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:01:29.850 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:01:29.850 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:01:29.853 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:01:29.853 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:01:29.853 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T04:01:30.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:01:30.014+0000 7ff404191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:01:30.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:01:30.028+0000 7ff404191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:01:30.108 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:01:30.108 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:01:30.108 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:01:30.108 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:01:30.108 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:01:30.108 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:01:30.108 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:01:30.108 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:01:30.108 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:01:30.108 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:01:30.109 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:01:30.109 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:01:30.113 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:01:30.113 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:01:30.114 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T04:01:30.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:01:30.266+0000 7f9c29511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:01:30.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:01:30.285+0000 7f9c29511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:01:30.380 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:01:30.380 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:01:30.380 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:01:30.380 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:01:30.380 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:01:30.380 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:01:30.380 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:01:30.380 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:01:30.380 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:01:30.380 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:01:30.380 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:01:30.381 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:01:30.383 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:01:30.384 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:01:31.329 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T04:01:31.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:01:31.473+0000 7f863aa23640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:01:31.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:01:31.482+0000 7f863aa23640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:01:34.102 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T04:01:34.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:01:34.249+0000 7f4c35d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:01:34.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:01:34.259+0000 7f4c35d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:01:35.385 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T04:01:35.385 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T04:01:35.385 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T04:01:35.386 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T04:01:35.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:01:35.537+0000 7f8ae6111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:01:35.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:01:35.552+0000 7f8ae6111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:01:35.732 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:01:35.732 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:01:35.732 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:01:35.733 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:01:35.733 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:01:35.733 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:01:35.733 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:01:35.733 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:01:35.733 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:01:35.733 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:01:35.733 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:01:35.733 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:01:35.737 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:01:35.737 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:01:35.737 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T04:01:35.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:01:35.884+0000 7fcb6f191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:01:35.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:01:35.906+0000 7fcb6f191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:01:36.071 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:01:36.071 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:01:36.071 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:01:36.071 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:01:36.071 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:01:36.071 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:01:36.071 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:01:36.071 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:01:36.071 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:01:36.071 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:01:36.071 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:01:36.072 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:01:36.074 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:01:36.074 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:01:36.075 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T04:01:36.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:01:36.238+0000 7f62ab46c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:01:36.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:01:36.254+0000 7f62ab46c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:01:36.281 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:01:36.281 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:01:36.281 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:01:36.281 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:01:36.282 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:01:36.282 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:01:36.282 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:01:36.282 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:01:36.282 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:01:36.282 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:01:36.282 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:01:36.282 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:01:36.284 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:01:36.285 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:01:36.285 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T04:01:36.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:01:36.430+0000 7f691bb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:01:36.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:01:36.452+0000 7f691bb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:01:36.504 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:01:36.504 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:01:36.504 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:01:36.504 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:01:36.504 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:01:36.504 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:01:36.505 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:01:36.505 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:01:36.505 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:01:36.505 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:01:36.505 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:01:36.505 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:01:36.508 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:01:36.509 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:01:36.977 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T04:01:37.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:01:37.126+0000 7f9272a7d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:01:37.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:01:37.133+0000 7f9272a7d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:01:39.630 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T04:01:39.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:01:39.770+0000 7fbb63151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:01:39.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:01:39.780+0000 7fbb63151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:01:41.509 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T04:01:41.509 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T04:01:41.510 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T04:01:41.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:01:41.670+0000 7f4758311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:01:41.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:01:41.681+0000 7f4758311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:01:42.007 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T04:01:42.008 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-22T04:01:42.028 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":445,"stamp":"2024-09-22T04:01:41.121049+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":444990027,"num_objects":6786,"num_object_clones":0,"num_object_copies":20358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":27357,"num_write_kb":1090901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":27331,"ondisk_log_size":27331,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":559772,"kb_used_data":84556,"kb_used_omap":0,"kb_used_meta":475136,"kb_avail":376927588,"statfs":{"total":386547056640,"available":385973850112,"internally_reserved":0,"allocated":86585344,"data_stored":1343848145,"data_compressed":63774133,"data_compressed_allocated":83943424,"data_compressed_original":1342849024,"omap_allocated":0,"internal_metadata":486539264},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-149749760,"num_objects":-2285,"num_object_clones":0,"num_object_copies":-6855,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2285,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002406"},"pg_stats":[{"pgid":"6.f","version":"76'1749","reported_seq":1785,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:01:36.132022+0000","last_change":"2024-09-22T03:59:10.330036+0000","last_active":"2024-09-22T04:01:36.132022+0000","last_peered":"2024-09-22T04:01:36.132022+0000","last_clean":"2024-09-22T04:01:36.132022+0000","last_became_active":"2024-09-22T03:59:10.319097+0000","last_became_peered":"2024-09-22T03:59:10.319097+0000","last_unstale":"2024-09-22T04:01:36.132022+0000","last_undegraded":"2024-09-22T04:01:36.132022+0000","last_fullsized":"2024-09-22T04:01:36.132022+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":1749,"log_dups_size":0,"ondisk_log_size":1749,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29294592,"num_objects":447,"num_object_clones":0,"num_object_copies":1341,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1749,"num_write_kb":70272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"76'1745","reported_seq":1781,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:01:40.073695+0000","last_change":"2024-09-22T03:59:10.321450+0000","last_active":"2024-09-22T04:01:40.073695+0000","last_peered":"2024-09-22T04:01:40.073695+0000","last_clean":"2024-09-22T04:01:40.073695+0000","last_became_active":"2024-09-22T03:59:10.311447+0000","last_became_peered":"2024-09-22T03:59:10.311447+0000","last_unstale":"2024-09-22T04:01:40.073695+0000","last_undegraded":"2024-09-22T04:01:40.073695+0000","last_fullsized":"2024-09-22T04:01:40.073695+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":1745,"log_dups_size":0,"ondisk_log_size":1745,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25362432,"num_objects":387,"num_object_clones":0,"num_object_copies":1161,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1745,"num_write_kb":68224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"76'1713","reported_seq":1750,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:01:39.997464+0000","last_change":"2024-09-22T03:59:10.349259+0000","last_active":"2024-09-22T04:01:39.997464+0000","last_peered":"2024-09-22T04:01:39.997464+0000","last_clean":"2024-09-22T04:01:39.997464+0000","last_became_active":"2024-09-22T03:59:10.341464+0000","last_became_peered":"2024-09-22T03:59:10.341464+0000","last_unstale":"2024-09-22T04:01:39.997464+0000","last_undegraded":"2024-09-22T04:01:39.997464+0000","last_fullsized":"2024-09-22T04:01:39.997464+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":1713,"log_dups_size":0,"ondisk_log_size":1713,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28704792,"num_objects":439,"num_object_clones":0,"num_object_copies":1317,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1713,"num_write_kb":68801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"76'1611","reported_seq":1647,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:01:35.776682+0000","last_change":"2024-09-22T03:59:10.365539+0000","last_active":"2024-09-22T04:01:35.776682+0000","last_peered":"2024-09-22T04:01:35.776682+0000","last_clean":"2024-09-22T04:01:35.776682+0000","last_became_active":"2024-09-22T03:59:10.339689+0000","last_became_peered":"2024-09-22T03:59:10.339689+0000","last_unstale":"2024-09-22T04:01:35.776682+0000","last_undegraded":"2024-09-22T04:01:35.776682+0000","last_fullsized":"2024-09-22T04:01:35.776682+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":1611,"log_dups_size":0,"ondisk_log_size":1611,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30736384,"num_objects":469,"num_object_clones":0,"num_object_copies":1407,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1611,"num_write_kb":66560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"76'1716","reported_seq":1752,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:01:39.912120+0000","last_change":"2024-09-22T03:59:10.331496+0000","last_active":"2024-09-22T04:01:39.912120+0000","last_peered":"2024-09-22T04:01:39.912120+0000","last_clean":"2024-09-22T04:01:39.912120+0000","last_became_active":"2024-09-22T03:59:10.322922+0000","last_became_peered":"2024-09-22T03:59:10.322922+0000","last_unstale":"2024-09-22T04:01:39.912120+0000","last_undegraded":"2024-09-22T04:01:39.912120+0000","last_fullsized":"2024-09-22T04:01:39.912120+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":1716,"log_dups_size":0,"ondisk_log_size":1716,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30277632,"num_objects":462,"num_object_clones":0,"num_object_copies":1386,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1716,"num_write_kb":69696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.a","version":"76'1634","reported_seq":1670,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:01:40.189318+0000","last_change":"2024-09-22T03:59:10.268812+0000","last_active":"2024-09-22T04:01:40.189318+0000","last_peered":"2024-09-22T04:01:40.189318+0000","last_clean":"2024-09-22T04:01:40.189318+0000","last_became_active":"2024-09-22T03:59:10.261529+0000","last_became_peered":"2024-09-22T03:59:10.261529+0000","last_unstale":"2024-09-22T04:01:40.189318+0000","last_undegraded":"2024-09-22T04:01:40.189318+0000","last_fullsized":"2024-09-22T04:01:40.189318+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":1634,"log_dups_size":0,"ondisk_log_size":1634,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":416,"num_object_clones":0,"num_object_copies":1248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1634,"num_write_kb":65600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"76'1743","reported_seq":1779,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:01:39.993611+0000","last_change":"2024-09-22T03:59:10.357775+0000","last_active":"2024-09-22T04:01:39.993611+0000","last_peered":"2024-09-22T04:01:39.993611+0000","last_clean":"2024-09-22T04:01:39.993611+0000","last_became_active":"2024-09-22T03:59:10.350219+0000","last_became_peered":"2024-09-22T03:59:10.350219+0000","last_unstale":"2024-09-22T04:01:39.993611+0000","last_undegraded":"2024-09-22T04:01:39.993611+0000","last_fullsized":"2024-09-22T04:01:39.993611+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":1743,"log_dups_size":0,"ondisk_log_size":1743,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27983872,"num_objects":427,"num_object_clones":0,"num_object_copies":1281,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1743,"num_write_kb":69440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"76'1653","reported_seq":1689,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:01:40.005110+0000","last_change":"2024-09-22T03:59:10.302834+0000","last_active":"2024-09-22T04:01:40.005110+0000","last_peered":"2024-09-22T04:01:40.005110+0000","last_clean":"2024-09-22T04:01:40.005110+0000","last_became_active":"2024-09-22T03:59:10.294403+0000","last_became_peered":"2024-09-22T03:59:10.294403+0000","last_unstale":"2024-09-22T04:01:40.005110+0000","last_undegraded":"2024-09-22T04:01:40.005110+0000","last_fullsized":"2024-09-22T04:01:40.005110+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":1653,"log_dups_size":0,"ondisk_log_size":1653,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24969216,"num_objects":381,"num_object_clones":0,"num_object_copies":1143,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1653,"num_write_kb":65088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"76'1764","reported_seq":1800,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:01:40.062706+0000","last_change":"2024-09-22T03:59:10.311620+0000","last_active":"2024-09-22T04:01:40.062706+0000","last_peered":"2024-09-22T04:01:40.062706+0000","last_clean":"2024-09-22T04:01:40.062706+0000","last_became_active":"2024-09-22T03:59:10.304722+0000","last_became_peered":"2024-09-22T03:59:10.304722+0000","last_unstale":"2024-09-22T04:01:40.062706+0000","last_undegraded":"2024-09-22T04:01:40.062706+0000","last_fullsized":"2024-09-22T04:01:40.062706+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":1764,"log_dups_size":0,"ondisk_log_size":1764,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25690112,"num_objects":392,"num_object_clones":0,"num_object_copies":1176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1764,"num_write_kb":68992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":271,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:28.843226+0000","last_change":"2024-09-22T03:49:12.034704+0000","last_active":"2024-09-22T04:00:28.843226+0000","last_peered":"2024-09-22T04:00:28.843226+0000","last_clean":"2024-09-22T04:00:28.843226+0000","last_became_active":"2024-09-22T03:49:12.027470+0000","last_became_peered":"2024-09-22T03:49:12.027470+0000","last_unstale":"2024-09-22T04:00:28.843226+0000","last_undegraded":"2024-09-22T04:00:28.843226+0000","last_fullsized":"2024-09-22T04:00:28.843226+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_clean_scrub_stamp":"2024-09-22T03:49:10.979949+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":197,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:28.847103+0000","last_change":"2024-09-22T03:49:17.031458+0000","last_active":"2024-09-22T04:00:28.847103+0000","last_peered":"2024-09-22T04:00:28.847103+0000","last_clean":"2024-09-22T04:00:28.847103+0000","last_became_active":"2024-09-22T03:49:15.125490+0000","last_became_peered":"2024-09-22T03:49:15.125490+0000","last_unstale":"2024-09-22T04:00:28.847103+0000","last_undegraded":"2024-09-22T04:00:28.847103+0000","last_fullsized":"2024-09-22T04:00:28.847103+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"76'1726","reported_seq":1762,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:01:36.181260+0000","last_change":"2024-09-22T03:59:10.355702+0000","last_active":"2024-09-22T04:01:36.181260+0000","last_peered":"2024-09-22T04:01:36.181260+0000","last_clean":"2024-09-22T04:01:36.181260+0000","last_became_active":"2024-09-22T03:59:10.330418+0000","last_became_peered":"2024-09-22T03:59:10.330418+0000","last_unstale":"2024-09-22T04:01:36.181260+0000","last_undegraded":"2024-09-22T04:01:36.181260+0000","last_fullsized":"2024-09-22T04:01:36.181260+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":1726,"log_dups_size":0,"ondisk_log_size":1726,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28442624,"num_objects":434,"num_object_clones":0,"num_object_copies":1302,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1726,"num_write_kb":69120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:28.835971+0000","last_change":"2024-09-22T03:49:17.029339+0000","last_active":"2024-09-22T04:00:28.835971+0000","last_peered":"2024-09-22T04:00:28.835971+0000","last_clean":"2024-09-22T04:00:28.835971+0000","last_became_active":"2024-09-22T03:49:15.097304+0000","last_became_peered":"2024-09-22T03:49:15.097304+0000","last_unstale":"2024-09-22T04:00:28.835971+0000","last_undegraded":"2024-09-22T04:00:28.835971+0000","last_fullsized":"2024-09-22T04:00:28.835971+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.5","version":"76'1738","reported_seq":1774,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:01:39.937394+0000","last_change":"2024-09-22T03:59:10.300610+0000","last_active":"2024-09-22T04:01:39.937394+0000","last_peered":"2024-09-22T04:01:39.937394+0000","last_clean":"2024-09-22T04:01:39.937394+0000","last_became_active":"2024-09-22T03:59:10.293587+0000","last_became_peered":"2024-09-22T03:59:10.293587+0000","last_unstale":"2024-09-22T04:01:39.937394+0000","last_undegraded":"2024-09-22T04:01:39.937394+0000","last_fullsized":"2024-09-22T04:01:39.937394+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":1738,"log_dups_size":0,"ondisk_log_size":1738,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26083328,"num_objects":398,"num_object_clones":0,"num_object_copies":1194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1738,"num_write_kb":68352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:28.834492+0000","last_change":"2024-09-22T03:49:17.029349+0000","last_active":"2024-09-22T04:00:28.834492+0000","last_peered":"2024-09-22T04:00:28.834492+0000","last_clean":"2024-09-22T04:00:28.834492+0000","last_became_active":"2024-09-22T03:49:15.094890+0000","last_became_peered":"2024-09-22T03:49:15.094890+0000","last_unstale":"2024-09-22T04:00:28.834492+0000","last_undegraded":"2024-09-22T04:00:28.834492+0000","last_fullsized":"2024-09-22T04:00:28.834492+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"76'1686","reported_seq":1722,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:01:36.197961+0000","last_change":"2024-09-22T03:59:10.359896+0000","last_active":"2024-09-22T04:01:36.197961+0000","last_peered":"2024-09-22T04:01:36.197961+0000","last_clean":"2024-09-22T04:01:36.197961+0000","last_became_active":"2024-09-22T03:59:10.342929+0000","last_became_peered":"2024-09-22T03:59:10.342929+0000","last_unstale":"2024-09-22T04:01:36.197961+0000","last_undegraded":"2024-09-22T04:01:36.197961+0000","last_fullsized":"2024-09-22T04:01:36.197961+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":1686,"log_dups_size":0,"ondisk_log_size":1686,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28835840,"num_objects":440,"num_object_clones":0,"num_object_copies":1320,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1686,"num_write_kb":68032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":198,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:28.839096+0000","last_change":"2024-09-22T03:49:17.031466+0000","last_active":"2024-09-22T04:00:28.839096+0000","last_peered":"2024-09-22T04:00:28.839096+0000","last_clean":"2024-09-22T04:00:28.839096+0000","last_became_active":"2024-09-22T03:49:15.098420+0000","last_became_peered":"2024-09-22T03:49:15.098420+0000","last_unstale":"2024-09-22T04:00:28.839096+0000","last_undegraded":"2024-09-22T04:00:28.839096+0000","last_fullsized":"2024-09-22T04:00:28.839096+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.0","version":"76'1710","reported_seq":1746,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:01:40.200129+0000","last_change":"2024-09-22T03:59:10.339795+0000","last_active":"2024-09-22T04:01:40.200129+0000","last_peered":"2024-09-22T04:01:40.200129+0000","last_clean":"2024-09-22T04:01:40.200129+0000","last_became_active":"2024-09-22T03:59:10.325306+0000","last_became_peered":"2024-09-22T03:59:10.325306+0000","last_unstale":"2024-09-22T04:01:40.200129+0000","last_undegraded":"2024-09-22T04:01:40.200129+0000","last_fullsized":"2024-09-22T04:01:40.200129+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":1710,"log_dups_size":0,"ondisk_log_size":1710,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25427968,"num_objects":388,"num_object_clones":0,"num_object_copies":1164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1710,"num_write_kb":67136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:28.846177+0000","last_change":"2024-09-22T03:49:17.036954+0000","last_active":"2024-09-22T04:00:28.846177+0000","last_peered":"2024-09-22T04:00:28.846177+0000","last_clean":"2024-09-22T04:00:28.846177+0000","last_became_active":"2024-09-22T03:49:15.110506+0000","last_became_peered":"2024-09-22T03:49:15.110506+0000","last_unstale":"2024-09-22T04:00:28.846177+0000","last_undegraded":"2024-09-22T04:00:28.846177+0000","last_fullsized":"2024-09-22T04:00:28.846177+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"76'1682","reported_seq":1718,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:01:36.194042+0000","last_change":"2024-09-22T03:59:10.361108+0000","last_active":"2024-09-22T04:01:36.194042+0000","last_peered":"2024-09-22T04:01:36.194042+0000","last_clean":"2024-09-22T04:01:36.194042+0000","last_became_active":"2024-09-22T03:59:10.347213+0000","last_became_peered":"2024-09-22T03:59:10.347213+0000","last_unstale":"2024-09-22T04:01:36.194042+0000","last_undegraded":"2024-09-22T04:01:36.194042+0000","last_fullsized":"2024-09-22T04:01:36.194042+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":1682,"log_dups_size":0,"ondisk_log_size":1682,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30408704,"num_objects":464,"num_object_clones":0,"num_object_copies":1392,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1682,"num_write_kb":68672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:28.844399+0000","last_change":"2024-09-22T03:49:17.032989+0000","last_active":"2024-09-22T04:00:28.844399+0000","last_peered":"2024-09-22T04:00:28.844399+0000","last_clean":"2024-09-22T04:00:28.844399+0000","last_became_active":"2024-09-22T03:49:15.079260+0000","last_became_peered":"2024-09-22T03:49:15.079260+0000","last_unstale":"2024-09-22T04:00:28.844399+0000","last_undegraded":"2024-09-22T04:00:28.844399+0000","last_fullsized":"2024-09-22T04:00:28.844399+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2","version":"76'1652","reported_seq":1688,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:01:39.982117+0000","last_change":"2024-09-22T03:59:10.318033+0000","last_active":"2024-09-22T04:01:39.982117+0000","last_peered":"2024-09-22T04:01:39.982117+0000","last_clean":"2024-09-22T04:01:39.982117+0000","last_became_active":"2024-09-22T03:59:10.308707+0000","last_became_peered":"2024-09-22T03:59:10.308707+0000","last_unstale":"2024-09-22T04:01:39.982117+0000","last_undegraded":"2024-09-22T04:01:39.982117+0000","last_fullsized":"2024-09-22T04:01:39.982117+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":1652,"log_dups_size":0,"ondisk_log_size":1652,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26869760,"num_objects":410,"num_object_clones":0,"num_object_copies":1230,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1652,"num_write_kb":65984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:28.849513+0000","last_change":"2024-09-22T03:49:17.036402+0000","last_active":"2024-09-22T04:00:28.849513+0000","last_peered":"2024-09-22T04:00:28.849513+0000","last_clean":"2024-09-22T04:00:28.849513+0000","last_became_active":"2024-09-22T03:49:15.108430+0000","last_became_peered":"2024-09-22T03:49:15.108430+0000","last_unstale":"2024-09-22T04:00:28.849513+0000","last_undegraded":"2024-09-22T04:00:28.849513+0000","last_fullsized":"2024-09-22T04:00:28.849513+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"76'1754","reported_seq":1790,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:01:39.615649+0000","last_change":"2024-09-22T03:59:10.277817+0000","last_active":"2024-09-22T04:01:39.615649+0000","last_peered":"2024-09-22T04:01:39.615649+0000","last_clean":"2024-09-22T04:01:39.615649+0000","last_became_active":"2024-09-22T03:59:10.263119+0000","last_became_peered":"2024-09-22T03:59:10.263119+0000","last_unstale":"2024-09-22T04:01:39.615649+0000","last_undegraded":"2024-09-22T04:01:39.615649+0000","last_fullsized":"2024-09-22T04:01:39.615649+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":1754,"log_dups_size":0,"ondisk_log_size":1754,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28049408,"num_objects":428,"num_object_clones":0,"num_object_copies":1284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1754,"num_write_kb":69824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:28.833568+0000","last_change":"2024-09-22T03:49:17.029128+0000","last_active":"2024-09-22T04:00:28.833568+0000","last_peered":"2024-09-22T04:00:28.833568+0000","last_clean":"2024-09-22T04:00:28.833568+0000","last_became_active":"2024-09-22T03:49:15.113396+0000","last_became_peered":"2024-09-22T03:49:15.113396+0000","last_unstale":"2024-09-22T04:00:28.833568+0000","last_undegraded":"2024-09-22T04:00:28.833568+0000","last_fullsized":"2024-09-22T04:00:28.833568+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":444399640,"num_objects":6782,"num_object_clones":0,"num_object_copies":20346,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":27276,"num_write_kb":1089793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":82911232,"data_stored":1326383176,"data_compressed":62983765,"data_compressed_allocated":82898944,"data_compressed_original":1326383104,"omap_allocated":0,"internal_metadata":0},"log_size":27276,"ondisk_log_size":27276,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949673703,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":134184,"kb_used_data":22672,"kb_used_omap":0,"kb_used_meta":111488,"kb_avail":94237656,"statfs":{"total":96636764160,"available":96499359744,"internally_reserved":0,"allocated":23216128,"data_stored":360947783,"data_compressed":17130495,"data_compressed_allocated":22548480,"data_compressed_original":360693760,"omap_allocated":0,"internal_metadata":114163712},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654706412,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":137852,"kb_used_data":20780,"kb_used_omap":0,"kb_used_meta":117056,"kb_avail":94233988,"statfs":{"total":96636764160,"available":96495603712,"internally_reserved":0,"allocated":21278720,"data_stored":330407439,"data_compressed":15678255,"data_compressed_allocated":20635648,"data_compressed_original":330170368,"omap_allocated":0,"internal_metadata":119865344},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706412,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":143524,"kb_used_data":22292,"kb_used_omap":0,"kb_used_meta":121216,"kb_avail":94228316,"statfs":{"total":96636764160,"available":96489795584,"internally_reserved":0,"allocated":22827008,"data_stored":354721863,"data_compressed":16834856,"data_compressed_allocated":22159360,"data_compressed_original":354467840,"omap_allocated":0,"internal_metadata":124125184},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706412,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":144212,"kb_used_data":18812,"kb_used_omap":0,"kb_used_meta":125376,"kb_avail":94227628,"statfs":{"total":96636764160,"available":96489091072,"internally_reserved":0,"allocated":19263488,"data_stored":297771060,"data_compressed":14130527,"data_compressed_allocated":18599936,"data_compressed_original":297517056,"omap_allocated":0,"internal_metadata":128385024},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":18436096,"data_stored":294912024,"data_compressed":14003999,"data_compressed_allocated":18432000,"data_compressed_original":294912000,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":22261760,"data_stored":356122648,"data_compressed":16910607,"data_compressed_allocated":22257664,"data_compressed_original":356122624,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":21950464,"data_stored":351141912,"data_compressed":16674096,"data_compressed_allocated":21946368,"data_compressed_original":351141888,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20262912,"data_stored":324206592,"data_compressed":15395063,"data_compressed_allocated":20262912,"data_compressed_original":324206592,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T04:01:42.328 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T04:01:42.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:01:42.480+0000 7fe25927f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:01:42.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:01:42.491+0000 7fe25927f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:01:45.174 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T04:01:45.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:01:45.345+0000 7f76a5efd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:01:45.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:01:45.354+0000 7f76a5efd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:01:47.031 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T04:01:47.031 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T04:01:47.031 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T04:01:47.031 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T04:01:47.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:01:47.160+0000 7f82a2846640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:01:47.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:01:47.177+0000 7f82a2846640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:01:47.422 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:01:47.422 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:01:47.422 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:01:47.422 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:01:47.422 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:01:47.423 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:01:47.423 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:01:47.423 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:01:47.423 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:01:47.423 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:01:47.423 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:01:47.423 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:01:47.427 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:01:47.427 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:01:47.427 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T04:01:47.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:01:47.601+0000 7ff151888640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:01:47.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:01:47.618+0000 7ff151888640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:01:47.853 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T04:01:47.860 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:01:47.861 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:01:47.861 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:01:47.861 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:01:47.861 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:01:47.861 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:01:47.861 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:01:47.861 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:01:47.861 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:01:47.861 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:01:47.861 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:01:47.862 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:01:47.864 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:01:47.865 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:01:47.865 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T04:01:48.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:01:48.010+0000 7f01dc551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:01:48.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:01:48.019+0000 7f01dc551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:01:48.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:01:48.077+0000 7fae35111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:01:48.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:01:48.090+0000 7fae35111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:01:48.118 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:01:48.118 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:01:48.118 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:01:48.118 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:01:48.119 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:01:48.119 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:01:48.119 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:01:48.119 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:01:48.119 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:01:48.119 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:01:48.119 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:01:48.119 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:01:48.122 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:01:48.123 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:01:48.123 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T04:01:48.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:01:48.261+0000 7f263d791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:01:48.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:01:48.275+0000 7f263d791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:01:48.305 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:01:48.305 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:01:48.305 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:01:48.306 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:01:48.306 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:01:48.306 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:01:48.306 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:01:48.306 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:01:48.306 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:01:48.306 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:01:48.306 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:01:48.306 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:01:48.311 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:01:48.311 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:01:50.494 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T04:01:50.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:01:50.631+0000 7f6b2ca23640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:01:50.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:01:50.640+0000 7f6b2ca23640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:01:53.212 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T04:01:53.312 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T04:01:53.312 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T04:01:53.312 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T04:01:53.312 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T04:01:53.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:01:53.391+0000 7fdd26ad1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:01:53.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:01:53.406+0000 7fdd26ad1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:01:53.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:01:53.470+0000 7f4653f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:01:53.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:01:53.483+0000 7f4653f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:01:53.596 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:01:53.596 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:01:53.596 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:01:53.596 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:01:53.597 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:01:53.597 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:01:53.597 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:01:53.597 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:01:53.597 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:01:53.597 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:01:53.597 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:01:53.597 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:01:53.599 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:01:53.600 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:01:53.600 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T04:01:53.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:01:53.759+0000 7f6ec3f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:01:53.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:01:53.776+0000 7f6ec3f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:01:53.938 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:01:53.938 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:01:53.938 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:01:53.938 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:01:53.938 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:01:53.938 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:01:53.938 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:01:53.939 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:01:53.939 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:01:53.939 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:01:53.939 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:01:53.939 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:01:53.941 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:01:53.942 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:01:53.942 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T04:01:54.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:01:54.121+0000 7feb364bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:01:54.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:01:54.139+0000 7feb364bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:01:54.174 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:01:54.174 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:01:54.174 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:01:54.174 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:01:54.174 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:01:54.174 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:01:54.175 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:01:54.175 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:01:54.175 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:01:54.175 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:01:54.175 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:01:54.175 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:01:54.179 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:01:54.179 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:01:54.179 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T04:01:54.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:01:54.346+0000 7f1fd6551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:01:54.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:01:54.363+0000 7f1fd6551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:01:54.480 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:01:54.481 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:01:54.481 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:01:54.481 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:01:54.481 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:01:54.481 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:01:54.481 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:01:54.481 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:01:54.481 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:01:54.481 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:01:54.481 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:01:54.481 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:01:54.484 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:01:54.484 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:01:55.768 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T04:01:55.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:01:55.942+0000 7f096eb51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:01:55.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:01:55.952+0000 7f096eb51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:01:58.779 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T04:01:58.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:01:58.916+0000 7fe8d62d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:01:58.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:01:58.926+0000 7fe8d62d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:01:59.485 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T04:01:59.485 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T04:01:59.486 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T04:01:59.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:01:59.655+0000 7f9a00f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:01:59.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:01:59.669+0000 7f9a00f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:02:00.022 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T04:02:00.023 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-22T04:02:00.044 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":454,"stamp":"2024-09-22T04:01:59.124851+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":265683531,"num_objects":4050,"num_object_clones":0,"num_object_copies":12150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":30093,"num_write_kb":1090901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30067,"ondisk_log_size":30067,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":558004,"kb_used_data":52272,"kb_used_omap":0,"kb_used_meta":505664,"kb_avail":376929356,"statfs":{"total":386547056640,"available":385975660544,"internally_reserved":0,"allocated":53526528,"data_stored":814907089,"data_compressed":38657184,"data_compressed_allocated":50884608,"data_compressed_original":813907968,"omap_allocated":0,"internal_metadata":517799936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-107872256,"num_objects":-1646,"num_object_clones":0,"num_object_copies":-4938,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1646,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002577"},"pg_stats":[{"pgid":"6.f","version":"76'1954","reported_seq":1990,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:01:56.228499+0000","last_change":"2024-09-22T03:59:10.330036+0000","last_active":"2024-09-22T04:01:56.228499+0000","last_peered":"2024-09-22T04:01:56.228499+0000","last_clean":"2024-09-22T04:01:56.228499+0000","last_became_active":"2024-09-22T03:59:10.319097+0000","last_became_peered":"2024-09-22T03:59:10.319097+0000","last_unstale":"2024-09-22T04:01:56.228499+0000","last_undegraded":"2024-09-22T04:01:56.228499+0000","last_fullsized":"2024-09-22T04:01:56.228499+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":1954,"log_dups_size":0,"ondisk_log_size":1954,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15859712,"num_objects":242,"num_object_clones":0,"num_object_copies":726,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1954,"num_write_kb":70272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"76'1884","reported_seq":1920,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:01:55.124701+0000","last_change":"2024-09-22T03:59:10.321450+0000","last_active":"2024-09-22T04:01:55.124701+0000","last_peered":"2024-09-22T04:01:55.124701+0000","last_clean":"2024-09-22T04:01:55.124701+0000","last_became_active":"2024-09-22T03:59:10.311447+0000","last_became_peered":"2024-09-22T03:59:10.311447+0000","last_unstale":"2024-09-22T04:01:55.124701+0000","last_undegraded":"2024-09-22T04:01:55.124701+0000","last_fullsized":"2024-09-22T04:01:55.124701+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":1884,"log_dups_size":0,"ondisk_log_size":1884,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16252928,"num_objects":248,"num_object_clones":0,"num_object_copies":744,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1884,"num_write_kb":68224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"76'1867","reported_seq":1904,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:01:55.051106+0000","last_change":"2024-09-22T03:59:10.349259+0000","last_active":"2024-09-22T04:01:55.051106+0000","last_peered":"2024-09-22T04:01:55.051106+0000","last_clean":"2024-09-22T04:01:55.051106+0000","last_became_active":"2024-09-22T03:59:10.341464+0000","last_became_peered":"2024-09-22T03:59:10.341464+0000","last_unstale":"2024-09-22T04:01:55.051106+0000","last_undegraded":"2024-09-22T04:01:55.051106+0000","last_fullsized":"2024-09-22T04:01:55.051106+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":1867,"log_dups_size":0,"ondisk_log_size":1867,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18612248,"num_objects":285,"num_object_clones":0,"num_object_copies":855,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1867,"num_write_kb":68801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"76'1830","reported_seq":1866,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:01:56.146790+0000","last_change":"2024-09-22T03:59:10.365539+0000","last_active":"2024-09-22T04:01:56.146790+0000","last_peered":"2024-09-22T04:01:56.146790+0000","last_clean":"2024-09-22T04:01:56.146790+0000","last_became_active":"2024-09-22T03:59:10.339689+0000","last_became_peered":"2024-09-22T03:59:10.339689+0000","last_unstale":"2024-09-22T04:01:56.146790+0000","last_undegraded":"2024-09-22T04:01:56.146790+0000","last_fullsized":"2024-09-22T04:01:56.146790+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":1830,"log_dups_size":0,"ondisk_log_size":1830,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16384000,"num_objects":250,"num_object_clones":0,"num_object_copies":750,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1830,"num_write_kb":66560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"76'1892","reported_seq":1928,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:01:54.980426+0000","last_change":"2024-09-22T03:59:10.331496+0000","last_active":"2024-09-22T04:01:54.980426+0000","last_peered":"2024-09-22T04:01:54.980426+0000","last_clean":"2024-09-22T04:01:54.980426+0000","last_became_active":"2024-09-22T03:59:10.322922+0000","last_became_peered":"2024-09-22T03:59:10.322922+0000","last_unstale":"2024-09-22T04:01:54.980426+0000","last_undegraded":"2024-09-22T04:01:54.980426+0000","last_fullsized":"2024-09-22T04:01:54.980426+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":1892,"log_dups_size":0,"ondisk_log_size":1892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18743296,"num_objects":286,"num_object_clones":0,"num_object_copies":858,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1892,"num_write_kb":69696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.a","version":"76'1801","reported_seq":1837,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:01:55.151574+0000","last_change":"2024-09-22T03:59:10.268812+0000","last_active":"2024-09-22T04:01:55.151574+0000","last_peered":"2024-09-22T04:01:55.151574+0000","last_clean":"2024-09-22T04:01:55.151574+0000","last_became_active":"2024-09-22T03:59:10.261529+0000","last_became_peered":"2024-09-22T03:59:10.261529+0000","last_unstale":"2024-09-22T04:01:55.151574+0000","last_undegraded":"2024-09-22T04:01:55.151574+0000","last_fullsized":"2024-09-22T04:01:55.151574+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":1801,"log_dups_size":0,"ondisk_log_size":1801,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16318464,"num_objects":249,"num_object_clones":0,"num_object_copies":747,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1801,"num_write_kb":65600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"76'1890","reported_seq":1926,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:01:55.084775+0000","last_change":"2024-09-22T03:59:10.357775+0000","last_active":"2024-09-22T04:01:55.084775+0000","last_peered":"2024-09-22T04:01:55.084775+0000","last_clean":"2024-09-22T04:01:55.084775+0000","last_became_active":"2024-09-22T03:59:10.350219+0000","last_became_peered":"2024-09-22T03:59:10.350219+0000","last_unstale":"2024-09-22T04:01:55.084775+0000","last_undegraded":"2024-09-22T04:01:55.084775+0000","last_fullsized":"2024-09-22T04:01:55.084775+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":1890,"log_dups_size":0,"ondisk_log_size":1890,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18350080,"num_objects":280,"num_object_clones":0,"num_object_copies":840,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1890,"num_write_kb":69440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"76'1794","reported_seq":1830,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:01:54.919494+0000","last_change":"2024-09-22T03:59:10.302834+0000","last_active":"2024-09-22T04:01:54.919494+0000","last_peered":"2024-09-22T04:01:54.919494+0000","last_clean":"2024-09-22T04:01:54.919494+0000","last_became_active":"2024-09-22T03:59:10.294403+0000","last_became_peered":"2024-09-22T03:59:10.294403+0000","last_unstale":"2024-09-22T04:01:54.919494+0000","last_undegraded":"2024-09-22T04:01:54.919494+0000","last_fullsized":"2024-09-22T04:01:54.919494+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":1794,"log_dups_size":0,"ondisk_log_size":1794,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15728640,"num_objects":240,"num_object_clones":0,"num_object_copies":720,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1794,"num_write_kb":65088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"76'1908","reported_seq":1944,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:01:54.964330+0000","last_change":"2024-09-22T03:59:10.311620+0000","last_active":"2024-09-22T04:01:54.964330+0000","last_peered":"2024-09-22T04:01:54.964330+0000","last_clean":"2024-09-22T04:01:54.964330+0000","last_became_active":"2024-09-22T03:59:10.304722+0000","last_became_peered":"2024-09-22T03:59:10.304722+0000","last_unstale":"2024-09-22T04:01:54.964330+0000","last_undegraded":"2024-09-22T04:01:54.964330+0000","last_fullsized":"2024-09-22T04:01:54.964330+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":1908,"log_dups_size":0,"ondisk_log_size":1908,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16252928,"num_objects":248,"num_object_clones":0,"num_object_copies":744,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1908,"num_write_kb":68992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":271,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:28.843226+0000","last_change":"2024-09-22T03:49:12.034704+0000","last_active":"2024-09-22T04:00:28.843226+0000","last_peered":"2024-09-22T04:00:28.843226+0000","last_clean":"2024-09-22T04:00:28.843226+0000","last_became_active":"2024-09-22T03:49:12.027470+0000","last_became_peered":"2024-09-22T03:49:12.027470+0000","last_unstale":"2024-09-22T04:00:28.843226+0000","last_undegraded":"2024-09-22T04:00:28.843226+0000","last_fullsized":"2024-09-22T04:00:28.843226+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_clean_scrub_stamp":"2024-09-22T03:49:10.979949+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":197,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:28.847103+0000","last_change":"2024-09-22T03:49:17.031458+0000","last_active":"2024-09-22T04:00:28.847103+0000","last_peered":"2024-09-22T04:00:28.847103+0000","last_clean":"2024-09-22T04:00:28.847103+0000","last_became_active":"2024-09-22T03:49:15.125490+0000","last_became_peered":"2024-09-22T03:49:15.125490+0000","last_unstale":"2024-09-22T04:00:28.847103+0000","last_undegraded":"2024-09-22T04:00:28.847103+0000","last_fullsized":"2024-09-22T04:00:28.847103+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"76'1906","reported_seq":1942,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:01:56.207368+0000","last_change":"2024-09-22T03:59:10.355702+0000","last_active":"2024-09-22T04:01:56.207368+0000","last_peered":"2024-09-22T04:01:56.207368+0000","last_clean":"2024-09-22T04:01:56.207368+0000","last_became_active":"2024-09-22T03:59:10.330418+0000","last_became_peered":"2024-09-22T03:59:10.330418+0000","last_unstale":"2024-09-22T04:01:56.207368+0000","last_undegraded":"2024-09-22T04:01:56.207368+0000","last_fullsized":"2024-09-22T04:01:56.207368+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":1906,"log_dups_size":0,"ondisk_log_size":1906,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16646144,"num_objects":254,"num_object_clones":0,"num_object_copies":762,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1906,"num_write_kb":69120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:28.835971+0000","last_change":"2024-09-22T03:49:17.029339+0000","last_active":"2024-09-22T04:00:28.835971+0000","last_peered":"2024-09-22T04:00:28.835971+0000","last_clean":"2024-09-22T04:00:28.835971+0000","last_became_active":"2024-09-22T03:49:15.097304+0000","last_became_peered":"2024-09-22T03:49:15.097304+0000","last_unstale":"2024-09-22T04:00:28.835971+0000","last_undegraded":"2024-09-22T04:00:28.835971+0000","last_fullsized":"2024-09-22T04:00:28.835971+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.5","version":"76'1886","reported_seq":1922,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:01:55.224914+0000","last_change":"2024-09-22T03:59:10.300610+0000","last_active":"2024-09-22T04:01:55.224914+0000","last_peered":"2024-09-22T04:01:55.224914+0000","last_clean":"2024-09-22T04:01:55.224914+0000","last_became_active":"2024-09-22T03:59:10.293587+0000","last_became_peered":"2024-09-22T03:59:10.293587+0000","last_unstale":"2024-09-22T04:01:55.224914+0000","last_undegraded":"2024-09-22T04:01:55.224914+0000","last_fullsized":"2024-09-22T04:01:55.224914+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":1886,"log_dups_size":0,"ondisk_log_size":1886,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16384000,"num_objects":250,"num_object_clones":0,"num_object_copies":750,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1886,"num_write_kb":68352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:28.834492+0000","last_change":"2024-09-22T03:49:17.029349+0000","last_active":"2024-09-22T04:00:28.834492+0000","last_peered":"2024-09-22T04:00:28.834492+0000","last_clean":"2024-09-22T04:00:28.834492+0000","last_became_active":"2024-09-22T03:49:15.094890+0000","last_became_peered":"2024-09-22T03:49:15.094890+0000","last_unstale":"2024-09-22T04:00:28.834492+0000","last_undegraded":"2024-09-22T04:00:28.834492+0000","last_fullsized":"2024-09-22T04:00:28.834492+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"76'1890","reported_seq":1926,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:01:56.191388+0000","last_change":"2024-09-22T03:59:10.359896+0000","last_active":"2024-09-22T04:01:56.191388+0000","last_peered":"2024-09-22T04:01:56.191388+0000","last_clean":"2024-09-22T04:01:56.191388+0000","last_became_active":"2024-09-22T03:59:10.342929+0000","last_became_peered":"2024-09-22T03:59:10.342929+0000","last_unstale":"2024-09-22T04:01:56.191388+0000","last_undegraded":"2024-09-22T04:01:56.191388+0000","last_fullsized":"2024-09-22T04:01:56.191388+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":1890,"log_dups_size":0,"ondisk_log_size":1890,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15466496,"num_objects":236,"num_object_clones":0,"num_object_copies":708,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1890,"num_write_kb":68032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":198,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:28.839096+0000","last_change":"2024-09-22T03:49:17.031466+0000","last_active":"2024-09-22T04:00:28.839096+0000","last_peered":"2024-09-22T04:00:28.839096+0000","last_clean":"2024-09-22T04:00:28.839096+0000","last_became_active":"2024-09-22T03:49:15.098420+0000","last_became_peered":"2024-09-22T03:49:15.098420+0000","last_unstale":"2024-09-22T04:00:28.839096+0000","last_undegraded":"2024-09-22T04:00:28.839096+0000","last_fullsized":"2024-09-22T04:00:28.839096+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.0","version":"76'1867","reported_seq":1903,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:01:54.961732+0000","last_change":"2024-09-22T03:59:10.339795+0000","last_active":"2024-09-22T04:01:54.961732+0000","last_peered":"2024-09-22T04:01:54.961732+0000","last_clean":"2024-09-22T04:01:54.961732+0000","last_became_active":"2024-09-22T03:59:10.325306+0000","last_became_peered":"2024-09-22T03:59:10.325306+0000","last_unstale":"2024-09-22T04:01:54.961732+0000","last_undegraded":"2024-09-22T04:01:54.961732+0000","last_fullsized":"2024-09-22T04:01:54.961732+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":1867,"log_dups_size":0,"ondisk_log_size":1867,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15138816,"num_objects":231,"num_object_clones":0,"num_object_copies":693,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1867,"num_write_kb":67136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:28.846177+0000","last_change":"2024-09-22T03:49:17.036954+0000","last_active":"2024-09-22T04:00:28.846177+0000","last_peered":"2024-09-22T04:00:28.846177+0000","last_clean":"2024-09-22T04:00:28.846177+0000","last_became_active":"2024-09-22T03:49:15.110506+0000","last_became_peered":"2024-09-22T03:49:15.110506+0000","last_unstale":"2024-09-22T04:00:28.846177+0000","last_undegraded":"2024-09-22T04:00:28.846177+0000","last_fullsized":"2024-09-22T04:00:28.846177+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"76'1895","reported_seq":1931,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:01:56.222295+0000","last_change":"2024-09-22T03:59:10.361108+0000","last_active":"2024-09-22T04:01:56.222295+0000","last_peered":"2024-09-22T04:01:56.222295+0000","last_clean":"2024-09-22T04:01:56.222295+0000","last_became_active":"2024-09-22T03:59:10.347213+0000","last_became_peered":"2024-09-22T03:59:10.347213+0000","last_unstale":"2024-09-22T04:01:56.222295+0000","last_undegraded":"2024-09-22T04:01:56.222295+0000","last_fullsized":"2024-09-22T04:01:56.222295+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":1895,"log_dups_size":0,"ondisk_log_size":1895,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16449536,"num_objects":251,"num_object_clones":0,"num_object_copies":753,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1895,"num_write_kb":68672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:28.844399+0000","last_change":"2024-09-22T03:49:17.032989+0000","last_active":"2024-09-22T04:00:28.844399+0000","last_peered":"2024-09-22T04:00:28.844399+0000","last_clean":"2024-09-22T04:00:28.844399+0000","last_became_active":"2024-09-22T03:49:15.079260+0000","last_became_peered":"2024-09-22T03:49:15.079260+0000","last_unstale":"2024-09-22T04:00:28.844399+0000","last_undegraded":"2024-09-22T04:00:28.844399+0000","last_fullsized":"2024-09-22T04:00:28.844399+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2","version":"76'1806","reported_seq":1842,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:01:54.776359+0000","last_change":"2024-09-22T03:59:10.318033+0000","last_active":"2024-09-22T04:01:54.776359+0000","last_peered":"2024-09-22T04:01:54.776359+0000","last_clean":"2024-09-22T04:01:54.776359+0000","last_became_active":"2024-09-22T03:59:10.308707+0000","last_became_peered":"2024-09-22T03:59:10.308707+0000","last_unstale":"2024-09-22T04:01:54.776359+0000","last_undegraded":"2024-09-22T04:01:54.776359+0000","last_fullsized":"2024-09-22T04:01:54.776359+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":1806,"log_dups_size":0,"ondisk_log_size":1806,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":256,"num_object_clones":0,"num_object_copies":768,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1806,"num_write_kb":65984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:28.849513+0000","last_change":"2024-09-22T03:49:17.036402+0000","last_active":"2024-09-22T04:00:28.849513+0000","last_peered":"2024-09-22T04:00:28.849513+0000","last_clean":"2024-09-22T04:00:28.849513+0000","last_became_active":"2024-09-22T03:49:15.108430+0000","last_became_peered":"2024-09-22T03:49:15.108430+0000","last_unstale":"2024-09-22T04:00:28.849513+0000","last_undegraded":"2024-09-22T04:00:28.849513+0000","last_fullsized":"2024-09-22T04:00:28.849513+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"76'1942","reported_seq":1978,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:01:55.113495+0000","last_change":"2024-09-22T03:59:10.277817+0000","last_active":"2024-09-22T04:01:55.113495+0000","last_peered":"2024-09-22T04:01:55.113495+0000","last_clean":"2024-09-22T04:01:55.113495+0000","last_became_active":"2024-09-22T03:59:10.263119+0000","last_became_peered":"2024-09-22T03:59:10.263119+0000","last_unstale":"2024-09-22T04:01:55.113495+0000","last_undegraded":"2024-09-22T04:01:55.113495+0000","last_fullsized":"2024-09-22T04:01:55.113495+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":1942,"log_dups_size":0,"ondisk_log_size":1942,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15728640,"num_objects":240,"num_object_clones":0,"num_object_copies":720,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1942,"num_write_kb":69824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:28.833568+0000","last_change":"2024-09-22T03:49:17.029128+0000","last_active":"2024-09-22T04:00:28.833568+0000","last_peered":"2024-09-22T04:00:28.833568+0000","last_clean":"2024-09-22T04:00:28.833568+0000","last_became_active":"2024-09-22T03:49:15.113396+0000","last_became_peered":"2024-09-22T03:49:15.113396+0000","last_unstale":"2024-09-22T04:00:28.833568+0000","last_undegraded":"2024-09-22T04:00:28.833568+0000","last_fullsized":"2024-09-22T04:00:28.833568+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":265093144,"num_objects":4046,"num_object_clones":0,"num_object_copies":12138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":30012,"num_write_kb":1089793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49917952,"data_stored":798490696,"data_compressed":37916608,"data_compressed_allocated":49905664,"data_compressed_original":798490624,"omap_allocated":0,"internal_metadata":0},"log_size":30012,"ondisk_log_size":30012,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949673723,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":134088,"kb_used_data":12856,"kb_used_omap":0,"kb_used_meta":121216,"kb_avail":94237752,"statfs":{"total":96636764160,"available":96499458048,"internally_reserved":0,"allocated":13164544,"data_stored":200122439,"data_compressed":9493648,"data_compressed_allocated":12496896,"data_compressed_original":199868416,"omap_allocated":0,"internal_metadata":124125184},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654706427,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":138760,"kb_used_data":13364,"kb_used_omap":0,"kb_used_meta":125376,"kb_avail":94233080,"statfs":{"total":96636764160,"available":96494673920,"internally_reserved":0,"allocated":13684736,"data_stored":208903695,"data_compressed":9908608,"data_compressed_allocated":13041664,"data_compressed_original":208666624,"omap_allocated":0,"internal_metadata":128385024},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706427,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":143660,"kb_used_data":14108,"kb_used_omap":0,"kb_used_meta":129536,"kb_avail":94228180,"statfs":{"total":96636764160,"available":96489656320,"internally_reserved":0,"allocated":14446592,"data_stored":220635207,"data_compressed":10467704,"data_compressed_allocated":13778944,"data_compressed_original":220381184,"omap_allocated":0,"internal_metadata":132644864},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706427,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":141496,"kb_used_data":11944,"kb_used_omap":0,"kb_used_meta":129536,"kb_avail":94230344,"statfs":{"total":96636764160,"available":96491872256,"internally_reserved":0,"allocated":12230656,"data_stored":185245748,"data_compressed":8787224,"data_compressed_allocated":11567104,"data_compressed_original":184991744,"omap_allocated":0,"internal_metadata":132644864},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":11399168,"data_stored":182321176,"data_compressed":8657584,"data_compressed_allocated":11395072,"data_compressed_original":182321152,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12230656,"data_stored":195624984,"data_compressed":9289320,"data_compressed_allocated":12226560,"data_compressed_original":195624960,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":13643776,"data_stored":218234904,"data_compressed":10362960,"data_compressed_allocated":13639680,"data_compressed_original":218234880,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12644352,"data_stored":202309632,"data_compressed":9606744,"data_compressed_allocated":12644352,"data_compressed_original":202309632,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T04:02:01.369 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T04:02:01.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:02:01.535+0000 7faad6a4f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:02:01.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:02:01.545+0000 7faad6a4f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:02:03.900 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T04:02:04.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:02:04.052+0000 7fa6ae591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:02:04.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:02:04.065+0000 7fa6ae591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:02:05.046 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T04:02:05.046 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T04:02:05.047 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T04:02:05.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:02:05.207+0000 7fccc1aac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:02:05.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:02:05.219+0000 7fccc1aac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:02:05.571 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T04:02:05.571 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-22T04:02:05.588 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":457,"stamp":"2024-09-22T04:02:05.126145+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":212795979,"num_objects":3243,"num_object_clones":0,"num_object_copies":9729,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":30900,"num_write_kb":1090901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30874,"ondisk_log_size":30874,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":527360,"kb_used_data":42428,"kb_used_omap":0,"kb_used_meta":484864,"kb_avail":376960000,"statfs":{"total":386547056640,"available":386007040000,"internally_reserved":0,"allocated":43446272,"data_stored":653622993,"data_compressed":30998552,"data_compressed_allocated":40804352,"data_compressed_original":652623872,"omap_allocated":0,"internal_metadata":496500736},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-107806720,"num_objects":-1645,"num_object_clones":0,"num_object_copies":-4935,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1645,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002500"},"pg_stats":[{"pgid":"6.f","version":"76'1990","reported_seq":2026,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:02:01.174373+0000","last_change":"2024-09-22T03:59:10.330036+0000","last_active":"2024-09-22T04:02:01.174373+0000","last_peered":"2024-09-22T04:02:01.174373+0000","last_clean":"2024-09-22T04:02:01.174373+0000","last_became_active":"2024-09-22T03:59:10.319097+0000","last_became_peered":"2024-09-22T03:59:10.319097+0000","last_unstale":"2024-09-22T04:02:01.174373+0000","last_undegraded":"2024-09-22T04:02:01.174373+0000","last_fullsized":"2024-09-22T04:02:01.174373+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":1990,"log_dups_size":0,"ondisk_log_size":1990,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13500416,"num_objects":206,"num_object_clones":0,"num_object_copies":618,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1990,"num_write_kb":70272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"76'1931","reported_seq":1967,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:02:00.091123+0000","last_change":"2024-09-22T03:59:10.321450+0000","last_active":"2024-09-22T04:02:00.091123+0000","last_peered":"2024-09-22T04:02:00.091123+0000","last_clean":"2024-09-22T04:02:00.091123+0000","last_became_active":"2024-09-22T03:59:10.311447+0000","last_became_peered":"2024-09-22T03:59:10.311447+0000","last_unstale":"2024-09-22T04:02:00.091123+0000","last_undegraded":"2024-09-22T04:02:00.091123+0000","last_fullsized":"2024-09-22T04:02:00.091123+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":1931,"log_dups_size":0,"ondisk_log_size":1931,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13172736,"num_objects":201,"num_object_clones":0,"num_object_copies":603,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1931,"num_write_kb":68224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"76'1930","reported_seq":1967,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:02:00.160677+0000","last_change":"2024-09-22T03:59:10.349259+0000","last_active":"2024-09-22T04:02:00.160677+0000","last_peered":"2024-09-22T04:02:00.160677+0000","last_clean":"2024-09-22T04:02:00.160677+0000","last_became_active":"2024-09-22T03:59:10.341464+0000","last_became_peered":"2024-09-22T03:59:10.341464+0000","last_unstale":"2024-09-22T04:02:00.160677+0000","last_undegraded":"2024-09-22T04:02:00.160677+0000","last_fullsized":"2024-09-22T04:02:00.160677+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":1930,"log_dups_size":0,"ondisk_log_size":1930,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14483480,"num_objects":222,"num_object_clones":0,"num_object_copies":666,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1930,"num_write_kb":68801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"76'1880","reported_seq":1916,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:02:01.209901+0000","last_change":"2024-09-22T03:59:10.365539+0000","last_active":"2024-09-22T04:02:01.209901+0000","last_peered":"2024-09-22T04:02:01.209901+0000","last_clean":"2024-09-22T04:02:01.209901+0000","last_became_active":"2024-09-22T03:59:10.339689+0000","last_became_peered":"2024-09-22T03:59:10.339689+0000","last_unstale":"2024-09-22T04:02:01.209901+0000","last_undegraded":"2024-09-22T04:02:01.209901+0000","last_fullsized":"2024-09-22T04:02:01.209901+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":1880,"log_dups_size":0,"ondisk_log_size":1880,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13107200,"num_objects":200,"num_object_clones":0,"num_object_copies":600,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1880,"num_write_kb":66560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"76'1946","reported_seq":1982,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:02:00.115976+0000","last_change":"2024-09-22T03:59:10.331496+0000","last_active":"2024-09-22T04:02:00.115976+0000","last_peered":"2024-09-22T04:02:00.115976+0000","last_clean":"2024-09-22T04:02:00.115976+0000","last_became_active":"2024-09-22T03:59:10.322922+0000","last_became_peered":"2024-09-22T03:59:10.322922+0000","last_unstale":"2024-09-22T04:02:00.115976+0000","last_undegraded":"2024-09-22T04:02:00.115976+0000","last_fullsized":"2024-09-22T04:02:00.115976+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":1946,"log_dups_size":0,"ondisk_log_size":1946,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15204352,"num_objects":232,"num_object_clones":0,"num_object_copies":696,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1946,"num_write_kb":69696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.a","version":"76'1845","reported_seq":1881,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:01:59.892246+0000","last_change":"2024-09-22T03:59:10.268812+0000","last_active":"2024-09-22T04:01:59.892246+0000","last_peered":"2024-09-22T04:01:59.892246+0000","last_clean":"2024-09-22T04:01:59.892246+0000","last_became_active":"2024-09-22T03:59:10.261529+0000","last_became_peered":"2024-09-22T03:59:10.261529+0000","last_unstale":"2024-09-22T04:01:59.892246+0000","last_undegraded":"2024-09-22T04:01:59.892246+0000","last_fullsized":"2024-09-22T04:01:59.892246+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":1845,"log_dups_size":0,"ondisk_log_size":1845,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13434880,"num_objects":205,"num_object_clones":0,"num_object_copies":615,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1845,"num_write_kb":65600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"76'1952","reported_seq":1988,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:02:00.062171+0000","last_change":"2024-09-22T03:59:10.357775+0000","last_active":"2024-09-22T04:02:00.062171+0000","last_peered":"2024-09-22T04:02:00.062171+0000","last_clean":"2024-09-22T04:02:00.062171+0000","last_became_active":"2024-09-22T03:59:10.350219+0000","last_became_peered":"2024-09-22T03:59:10.350219+0000","last_unstale":"2024-09-22T04:02:00.062171+0000","last_undegraded":"2024-09-22T04:02:00.062171+0000","last_fullsized":"2024-09-22T04:02:00.062171+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":1952,"log_dups_size":0,"ondisk_log_size":1952,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14286848,"num_objects":218,"num_object_clones":0,"num_object_copies":654,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1952,"num_write_kb":69440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"76'1845","reported_seq":1881,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:02:00.085833+0000","last_change":"2024-09-22T03:59:10.302834+0000","last_active":"2024-09-22T04:02:00.085833+0000","last_peered":"2024-09-22T04:02:00.085833+0000","last_clean":"2024-09-22T04:02:00.085833+0000","last_became_active":"2024-09-22T03:59:10.294403+0000","last_became_peered":"2024-09-22T03:59:10.294403+0000","last_unstale":"2024-09-22T04:02:00.085833+0000","last_undegraded":"2024-09-22T04:02:00.085833+0000","last_fullsized":"2024-09-22T04:02:00.085833+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":1845,"log_dups_size":0,"ondisk_log_size":1845,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12386304,"num_objects":189,"num_object_clones":0,"num_object_copies":567,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1845,"num_write_kb":65088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"76'1952","reported_seq":1988,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:02:00.043828+0000","last_change":"2024-09-22T03:59:10.311620+0000","last_active":"2024-09-22T04:02:00.043828+0000","last_peered":"2024-09-22T04:02:00.043828+0000","last_clean":"2024-09-22T04:02:00.043828+0000","last_became_active":"2024-09-22T03:59:10.304722+0000","last_became_peered":"2024-09-22T03:59:10.304722+0000","last_unstale":"2024-09-22T04:02:00.043828+0000","last_undegraded":"2024-09-22T04:02:00.043828+0000","last_fullsized":"2024-09-22T04:02:00.043828+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":1952,"log_dups_size":0,"ondisk_log_size":1952,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13369344,"num_objects":204,"num_object_clones":0,"num_object_copies":612,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1952,"num_write_kb":68992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":271,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:28.843226+0000","last_change":"2024-09-22T03:49:12.034704+0000","last_active":"2024-09-22T04:00:28.843226+0000","last_peered":"2024-09-22T04:00:28.843226+0000","last_clean":"2024-09-22T04:00:28.843226+0000","last_became_active":"2024-09-22T03:49:12.027470+0000","last_became_peered":"2024-09-22T03:49:12.027470+0000","last_unstale":"2024-09-22T04:00:28.843226+0000","last_undegraded":"2024-09-22T04:00:28.843226+0000","last_fullsized":"2024-09-22T04:00:28.843226+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_clean_scrub_stamp":"2024-09-22T03:49:10.979949+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":197,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:28.847103+0000","last_change":"2024-09-22T03:49:17.031458+0000","last_active":"2024-09-22T04:00:28.847103+0000","last_peered":"2024-09-22T04:00:28.847103+0000","last_clean":"2024-09-22T04:00:28.847103+0000","last_became_active":"2024-09-22T03:49:15.125490+0000","last_became_peered":"2024-09-22T03:49:15.125490+0000","last_unstale":"2024-09-22T04:00:28.847103+0000","last_undegraded":"2024-09-22T04:00:28.847103+0000","last_fullsized":"2024-09-22T04:00:28.847103+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"76'1960","reported_seq":1996,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:02:01.169502+0000","last_change":"2024-09-22T03:59:10.355702+0000","last_active":"2024-09-22T04:02:01.169502+0000","last_peered":"2024-09-22T04:02:01.169502+0000","last_clean":"2024-09-22T04:02:01.169502+0000","last_became_active":"2024-09-22T03:59:10.330418+0000","last_became_peered":"2024-09-22T03:59:10.330418+0000","last_unstale":"2024-09-22T04:02:01.169502+0000","last_undegraded":"2024-09-22T04:02:01.169502+0000","last_fullsized":"2024-09-22T04:02:01.169502+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":1960,"log_dups_size":0,"ondisk_log_size":1960,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13107200,"num_objects":200,"num_object_clones":0,"num_object_copies":600,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1960,"num_write_kb":69120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:28.835971+0000","last_change":"2024-09-22T03:49:17.029339+0000","last_active":"2024-09-22T04:00:28.835971+0000","last_peered":"2024-09-22T04:00:28.835971+0000","last_clean":"2024-09-22T04:00:28.835971+0000","last_became_active":"2024-09-22T03:49:15.097304+0000","last_became_peered":"2024-09-22T03:49:15.097304+0000","last_unstale":"2024-09-22T04:00:28.835971+0000","last_undegraded":"2024-09-22T04:00:28.835971+0000","last_fullsized":"2024-09-22T04:00:28.835971+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.5","version":"76'1933","reported_seq":1969,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:02:00.139193+0000","last_change":"2024-09-22T03:59:10.300610+0000","last_active":"2024-09-22T04:02:00.139193+0000","last_peered":"2024-09-22T04:02:00.139193+0000","last_clean":"2024-09-22T04:02:00.139193+0000","last_became_active":"2024-09-22T03:59:10.293587+0000","last_became_peered":"2024-09-22T03:59:10.293587+0000","last_unstale":"2024-09-22T04:02:00.139193+0000","last_undegraded":"2024-09-22T04:02:00.139193+0000","last_fullsized":"2024-09-22T04:02:00.139193+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":1933,"log_dups_size":0,"ondisk_log_size":1933,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13303808,"num_objects":203,"num_object_clones":0,"num_object_copies":609,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1933,"num_write_kb":68352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:28.834492+0000","last_change":"2024-09-22T03:49:17.029349+0000","last_active":"2024-09-22T04:00:28.834492+0000","last_peered":"2024-09-22T04:00:28.834492+0000","last_clean":"2024-09-22T04:00:28.834492+0000","last_became_active":"2024-09-22T03:49:15.094890+0000","last_became_peered":"2024-09-22T03:49:15.094890+0000","last_unstale":"2024-09-22T04:00:28.834492+0000","last_undegraded":"2024-09-22T04:00:28.834492+0000","last_fullsized":"2024-09-22T04:00:28.834492+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"76'1942","reported_seq":1978,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:02:01.105706+0000","last_change":"2024-09-22T03:59:10.359896+0000","last_active":"2024-09-22T04:02:01.105706+0000","last_peered":"2024-09-22T04:02:01.105706+0000","last_clean":"2024-09-22T04:02:01.105706+0000","last_became_active":"2024-09-22T03:59:10.342929+0000","last_became_peered":"2024-09-22T03:59:10.342929+0000","last_unstale":"2024-09-22T04:02:01.105706+0000","last_undegraded":"2024-09-22T04:02:01.105706+0000","last_fullsized":"2024-09-22T04:02:01.105706+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":1942,"log_dups_size":0,"ondisk_log_size":1942,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12058624,"num_objects":184,"num_object_clones":0,"num_object_copies":552,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1942,"num_write_kb":68032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":198,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:28.839096+0000","last_change":"2024-09-22T03:49:17.031466+0000","last_active":"2024-09-22T04:00:28.839096+0000","last_peered":"2024-09-22T04:00:28.839096+0000","last_clean":"2024-09-22T04:00:28.839096+0000","last_became_active":"2024-09-22T03:49:15.098420+0000","last_became_peered":"2024-09-22T03:49:15.098420+0000","last_unstale":"2024-09-22T04:00:28.839096+0000","last_undegraded":"2024-09-22T04:00:28.839096+0000","last_fullsized":"2024-09-22T04:00:28.839096+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.0","version":"76'1917","reported_seq":1953,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:01:59.930757+0000","last_change":"2024-09-22T03:59:10.339795+0000","last_active":"2024-09-22T04:01:59.930757+0000","last_peered":"2024-09-22T04:01:59.930757+0000","last_clean":"2024-09-22T04:01:59.930757+0000","last_became_active":"2024-09-22T03:59:10.325306+0000","last_became_peered":"2024-09-22T03:59:10.325306+0000","last_unstale":"2024-09-22T04:01:59.930757+0000","last_undegraded":"2024-09-22T04:01:59.930757+0000","last_fullsized":"2024-09-22T04:01:59.930757+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":1917,"log_dups_size":0,"ondisk_log_size":1917,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11862016,"num_objects":181,"num_object_clones":0,"num_object_copies":543,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1917,"num_write_kb":67136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:28.846177+0000","last_change":"2024-09-22T03:49:17.036954+0000","last_active":"2024-09-22T04:00:28.846177+0000","last_peered":"2024-09-22T04:00:28.846177+0000","last_clean":"2024-09-22T04:00:28.846177+0000","last_became_active":"2024-09-22T03:49:15.110506+0000","last_became_peered":"2024-09-22T03:49:15.110506+0000","last_unstale":"2024-09-22T04:00:28.846177+0000","last_undegraded":"2024-09-22T04:00:28.846177+0000","last_fullsized":"2024-09-22T04:00:28.846177+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"76'1947","reported_seq":1983,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:02:00.982960+0000","last_change":"2024-09-22T03:59:10.361108+0000","last_active":"2024-09-22T04:02:00.982960+0000","last_peered":"2024-09-22T04:02:00.982960+0000","last_clean":"2024-09-22T04:02:00.982960+0000","last_became_active":"2024-09-22T03:59:10.347213+0000","last_became_peered":"2024-09-22T03:59:10.347213+0000","last_unstale":"2024-09-22T04:02:00.982960+0000","last_undegraded":"2024-09-22T04:02:00.982960+0000","last_fullsized":"2024-09-22T04:02:00.982960+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":1947,"log_dups_size":0,"ondisk_log_size":1947,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13041664,"num_objects":199,"num_object_clones":0,"num_object_copies":597,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1947,"num_write_kb":68672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:28.844399+0000","last_change":"2024-09-22T03:49:17.032989+0000","last_active":"2024-09-22T04:00:28.844399+0000","last_peered":"2024-09-22T04:00:28.844399+0000","last_clean":"2024-09-22T04:00:28.844399+0000","last_became_active":"2024-09-22T03:49:15.079260+0000","last_became_peered":"2024-09-22T03:49:15.079260+0000","last_unstale":"2024-09-22T04:00:28.844399+0000","last_undegraded":"2024-09-22T04:00:28.844399+0000","last_fullsized":"2024-09-22T04:00:28.844399+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2","version":"76'1860","reported_seq":1896,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:02:00.112077+0000","last_change":"2024-09-22T03:59:10.318033+0000","last_active":"2024-09-22T04:02:00.112077+0000","last_peered":"2024-09-22T04:02:00.112077+0000","last_clean":"2024-09-22T04:02:00.112077+0000","last_became_active":"2024-09-22T03:59:10.308707+0000","last_became_peered":"2024-09-22T03:59:10.308707+0000","last_unstale":"2024-09-22T04:02:00.112077+0000","last_undegraded":"2024-09-22T04:02:00.112077+0000","last_fullsized":"2024-09-22T04:02:00.112077+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":1860,"log_dups_size":0,"ondisk_log_size":1860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13238272,"num_objects":202,"num_object_clones":0,"num_object_copies":606,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1860,"num_write_kb":65984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:28.849513+0000","last_change":"2024-09-22T03:49:17.036402+0000","last_active":"2024-09-22T04:00:28.849513+0000","last_peered":"2024-09-22T04:00:28.849513+0000","last_clean":"2024-09-22T04:00:28.849513+0000","last_became_active":"2024-09-22T03:49:15.108430+0000","last_became_peered":"2024-09-22T03:49:15.108430+0000","last_unstale":"2024-09-22T04:00:28.849513+0000","last_undegraded":"2024-09-22T04:00:28.849513+0000","last_fullsized":"2024-09-22T04:00:28.849513+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"76'1989","reported_seq":2025,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:01:59.844300+0000","last_change":"2024-09-22T03:59:10.277817+0000","last_active":"2024-09-22T04:01:59.844300+0000","last_peered":"2024-09-22T04:01:59.844300+0000","last_clean":"2024-09-22T04:01:59.844300+0000","last_became_active":"2024-09-22T03:59:10.263119+0000","last_became_peered":"2024-09-22T03:59:10.263119+0000","last_unstale":"2024-09-22T04:01:59.844300+0000","last_undegraded":"2024-09-22T04:01:59.844300+0000","last_fullsized":"2024-09-22T04:01:59.844300+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":1989,"log_dups_size":0,"ondisk_log_size":1989,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12648448,"num_objects":193,"num_object_clones":0,"num_object_copies":579,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1989,"num_write_kb":69824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:28.833568+0000","last_change":"2024-09-22T03:49:17.029128+0000","last_active":"2024-09-22T04:00:28.833568+0000","last_peered":"2024-09-22T04:00:28.833568+0000","last_clean":"2024-09-22T04:00:28.833568+0000","last_became_active":"2024-09-22T03:49:15.113396+0000","last_became_peered":"2024-09-22T03:49:15.113396+0000","last_unstale":"2024-09-22T04:00:28.833568+0000","last_undegraded":"2024-09-22T04:00:28.833568+0000","last_fullsized":"2024-09-22T04:00:28.833568+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":212205592,"num_objects":3239,"num_object_clones":0,"num_object_copies":9717,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":30819,"num_write_kb":1089793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":39919616,"data_stored":638517320,"data_compressed":30320216,"data_compressed_allocated":39907328,"data_compressed_original":638517248,"omap_allocated":0,"internal_metadata":0},"log_size":30819,"ondisk_log_size":30819,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949673728,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":135760,"kb_used_data":10368,"kb_used_omap":0,"kb_used_meta":125376,"kb_avail":94236080,"statfs":{"total":96636764160,"available":96497745920,"internally_reserved":0,"allocated":10616832,"data_stored":159359047,"data_compressed":7557984,"data_compressed_allocated":9949184,"data_compressed_original":159105024,"omap_allocated":0,"internal_metadata":128385024},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654706432,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":136296,"kb_used_data":10904,"kb_used_omap":0,"kb_used_meta":125376,"kb_avail":94235544,"statfs":{"total":96636764160,"available":96497197056,"internally_reserved":0,"allocated":11165696,"data_stored":168599055,"data_compressed":7994728,"data_compressed_allocated":10522624,"data_compressed_original":168361984,"omap_allocated":0,"internal_metadata":128385024},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706432,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":128568,"kb_used_data":11496,"kb_used_omap":0,"kb_used_meta":117056,"kb_avail":94243272,"statfs":{"total":96636764160,"available":96505110528,"internally_reserved":0,"allocated":11771904,"data_stored":177840199,"data_compressed":8435568,"data_compressed_allocated":11104256,"data_compressed_original":177586176,"omap_allocated":0,"internal_metadata":119865344},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706432,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":126736,"kb_used_data":9660,"kb_used_omap":0,"kb_used_meta":117056,"kb_avail":94245104,"statfs":{"total":96636764160,"available":96506986496,"internally_reserved":0,"allocated":9891840,"data_stored":147824692,"data_compressed":7010272,"data_compressed_allocated":9228288,"data_compressed_original":147570688,"omap_allocated":0,"internal_metadata":119865344},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":9064448,"data_stored":144965656,"data_compressed":6883744,"data_compressed_allocated":9060352,"data_compressed_original":144965632,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9728000,"data_stored":155582488,"data_compressed":7387888,"data_compressed_allocated":9723904,"data_compressed_original":155582464,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":10973184,"data_stored":175505432,"data_compressed":8333936,"data_compressed_allocated":10969088,"data_compressed_original":175505408,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":10153984,"data_stored":162463744,"data_compressed":7714648,"data_compressed_allocated":10153984,"data_compressed_original":162463744,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T04:02:06.719 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T04:02:06.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:02:06.874+0000 7fc7f9751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:02:06.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:02:06.891+0000 7fc7f9751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:02:09.519 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T04:02:09.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:02:09.667+0000 7fd2d82bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:02:09.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:02:09.678+0000 7fd2d82bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:02:10.590 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T04:02:10.591 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T04:02:10.591 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T04:02:10.591 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T04:02:10.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:02:10.747+0000 7f5555151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:02:10.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:02:10.761+0000 7f5555151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:02:10.872 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:02:10.872 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:02:10.872 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:02:10.872 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:02:10.872 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:02:10.872 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:02:10.872 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:02:10.872 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:02:10.872 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:02:10.872 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:02:10.872 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:02:10.872 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:02:10.876 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:02:10.876 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:02:10.877 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T04:02:11.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:02:11.035+0000 7f120044f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:02:11.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:02:11.055+0000 7f120044f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:02:11.241 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:02:11.241 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:02:11.241 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:02:11.241 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:02:11.241 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:02:11.241 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:02:11.241 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:02:11.242 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:02:11.242 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:02:11.242 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:02:11.242 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:02:11.242 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:02:11.244 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:02:11.244 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:02:11.245 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T04:02:11.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:02:11.404+0000 7f6f322ec640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:02:11.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:02:11.416+0000 7f6f322ec640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:02:11.440 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:02:11.440 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:02:11.441 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:02:11.441 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:02:11.441 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:02:11.441 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:02:11.441 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:02:11.441 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:02:11.441 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:02:11.441 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:02:11.441 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:02:11.441 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:02:11.445 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:02:11.445 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:02:11.445 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T04:02:11.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:02:11.588+0000 7fef5ec88640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:02:11.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:02:11.607+0000 7fef5ec88640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:02:11.756 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:02:11.756 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:02:11.757 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:02:11.757 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:02:11.757 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:02:11.757 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:02:11.757 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:02:11.757 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:02:11.757 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:02:11.757 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:02:11.757 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:02:11.757 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:02:11.761 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:02:11.761 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:02:12.283 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T04:02:12.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:02:12.429+0000 7fd881c74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:02:12.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:02:12.442+0000 7fd881c74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:02:15.091 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T04:02:15.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:02:15.240+0000 7fbf8a223640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:02:15.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:02:15.249+0000 7fbf8a223640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:02:16.762 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T04:02:16.762 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T04:02:16.762 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T04:02:16.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:02:16.914+0000 7f4d6e951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:02:16.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:02:16.926+0000 7f4d6e951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:02:17.292 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T04:02:17.292 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-22T04:02:17.312 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":463,"stamp":"2024-09-22T04:02:17.128544+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":56164939,"num_objects":853,"num_object_clones":0,"num_object_copies":2559,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":33290,"num_write_kb":1090901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33264,"ondisk_log_size":33264,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":511092,"kb_used_data":13680,"kb_used_omap":0,"kb_used_meta":497344,"kb_avail":376976268,"statfs":{"total":386547056640,"available":386023698432,"internally_reserved":0,"allocated":14008320,"data_stored":182615761,"data_compressed":8632608,"data_compressed_allocated":11366400,"data_compressed_original":181616640,"omap_allocated":0,"internal_metadata":509280256},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-156631040,"num_objects":-2390,"num_object_clones":0,"num_object_copies":-7170,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2390,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002399"},"pg_stats":[{"pgid":"6.f","version":"76'2146","reported_seq":2182,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:02:16.191299+0000","last_change":"2024-09-22T03:59:10.330036+0000","last_active":"2024-09-22T04:02:16.191299+0000","last_peered":"2024-09-22T04:02:16.191299+0000","last_clean":"2024-09-22T04:02:16.191299+0000","last_became_active":"2024-09-22T03:59:10.319097+0000","last_became_peered":"2024-09-22T03:59:10.319097+0000","last_unstale":"2024-09-22T04:02:16.191299+0000","last_undegraded":"2024-09-22T04:02:16.191299+0000","last_fullsized":"2024-09-22T04:02:16.191299+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":2146,"log_dups_size":0,"ondisk_log_size":2146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3276800,"num_objects":50,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2146,"num_write_kb":70272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"76'2076","reported_seq":2112,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:02:15.075565+0000","last_change":"2024-09-22T03:59:10.321450+0000","last_active":"2024-09-22T04:02:15.075565+0000","last_peered":"2024-09-22T04:02:15.075565+0000","last_clean":"2024-09-22T04:02:15.075565+0000","last_became_active":"2024-09-22T03:59:10.311447+0000","last_became_peered":"2024-09-22T03:59:10.311447+0000","last_unstale":"2024-09-22T04:02:15.075565+0000","last_undegraded":"2024-09-22T04:02:15.075565+0000","last_fullsized":"2024-09-22T04:02:15.075565+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":2076,"log_dups_size":0,"ondisk_log_size":2076,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3670016,"num_objects":56,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2076,"num_write_kb":68224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"76'2086","reported_seq":2123,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:02:14.958395+0000","last_change":"2024-09-22T03:59:10.349259+0000","last_active":"2024-09-22T04:02:14.958395+0000","last_peered":"2024-09-22T04:02:14.958395+0000","last_clean":"2024-09-22T04:02:14.958395+0000","last_became_active":"2024-09-22T03:59:10.341464+0000","last_became_peered":"2024-09-22T03:59:10.341464+0000","last_unstale":"2024-09-22T04:02:14.958395+0000","last_undegraded":"2024-09-22T04:02:14.958395+0000","last_fullsized":"2024-09-22T04:02:14.958395+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":2086,"log_dups_size":0,"ondisk_log_size":2086,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4259864,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2086,"num_write_kb":68801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"76'2035","reported_seq":2071,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:02:16.222582+0000","last_change":"2024-09-22T03:59:10.365539+0000","last_active":"2024-09-22T04:02:16.222582+0000","last_peered":"2024-09-22T04:02:16.222582+0000","last_clean":"2024-09-22T04:02:16.222582+0000","last_became_active":"2024-09-22T03:59:10.339689+0000","last_became_peered":"2024-09-22T03:59:10.339689+0000","last_unstale":"2024-09-22T04:02:16.222582+0000","last_undegraded":"2024-09-22T04:02:16.222582+0000","last_fullsized":"2024-09-22T04:02:16.222582+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":2035,"log_dups_size":0,"ondisk_log_size":2035,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2949120,"num_objects":45,"num_object_clones":0,"num_object_copies":135,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2035,"num_write_kb":66560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"76'2108","reported_seq":2144,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:02:15.075229+0000","last_change":"2024-09-22T03:59:10.331496+0000","last_active":"2024-09-22T04:02:15.075229+0000","last_peered":"2024-09-22T04:02:15.075229+0000","last_clean":"2024-09-22T04:02:15.075229+0000","last_became_active":"2024-09-22T03:59:10.322922+0000","last_became_peered":"2024-09-22T03:59:10.322922+0000","last_unstale":"2024-09-22T04:02:15.075229+0000","last_undegraded":"2024-09-22T04:02:15.075229+0000","last_fullsized":"2024-09-22T04:02:15.075229+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":2108,"log_dups_size":0,"ondisk_log_size":2108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4587520,"num_objects":70,"num_object_clones":0,"num_object_copies":210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2108,"num_write_kb":69696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.a","version":"76'1997","reported_seq":2033,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:02:15.230444+0000","last_change":"2024-09-22T03:59:10.268812+0000","last_active":"2024-09-22T04:02:15.230444+0000","last_peered":"2024-09-22T04:02:15.230444+0000","last_clean":"2024-09-22T04:02:15.230444+0000","last_became_active":"2024-09-22T03:59:10.261529+0000","last_became_peered":"2024-09-22T03:59:10.261529+0000","last_unstale":"2024-09-22T04:02:15.230444+0000","last_undegraded":"2024-09-22T04:02:15.230444+0000","last_fullsized":"2024-09-22T04:02:15.230444+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":1997,"log_dups_size":0,"ondisk_log_size":1997,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3473408,"num_objects":53,"num_object_clones":0,"num_object_copies":159,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1997,"num_write_kb":65600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"76'2117","reported_seq":2153,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:02:15.054986+0000","last_change":"2024-09-22T03:59:10.357775+0000","last_active":"2024-09-22T04:02:15.054986+0000","last_peered":"2024-09-22T04:02:15.054986+0000","last_clean":"2024-09-22T04:02:15.054986+0000","last_became_active":"2024-09-22T03:59:10.350219+0000","last_became_peered":"2024-09-22T03:59:10.350219+0000","last_unstale":"2024-09-22T04:02:15.054986+0000","last_undegraded":"2024-09-22T04:02:15.054986+0000","last_fullsized":"2024-09-22T04:02:15.054986+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":2117,"log_dups_size":0,"ondisk_log_size":2117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3473408,"num_objects":53,"num_object_clones":0,"num_object_copies":159,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2117,"num_write_kb":69440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"76'1987","reported_seq":2023,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:02:15.110448+0000","last_change":"2024-09-22T03:59:10.302834+0000","last_active":"2024-09-22T04:02:15.110448+0000","last_peered":"2024-09-22T04:02:15.110448+0000","last_clean":"2024-09-22T04:02:15.110448+0000","last_became_active":"2024-09-22T03:59:10.294403+0000","last_became_peered":"2024-09-22T03:59:10.294403+0000","last_unstale":"2024-09-22T04:02:15.110448+0000","last_undegraded":"2024-09-22T04:02:15.110448+0000","last_fullsized":"2024-09-22T04:02:15.110448+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":1987,"log_dups_size":0,"ondisk_log_size":1987,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3080192,"num_objects":47,"num_object_clones":0,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1987,"num_write_kb":65088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"76'2106","reported_seq":2142,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:02:14.879406+0000","last_change":"2024-09-22T03:59:10.311620+0000","last_active":"2024-09-22T04:02:14.879406+0000","last_peered":"2024-09-22T04:02:14.879406+0000","last_clean":"2024-09-22T04:02:14.879406+0000","last_became_active":"2024-09-22T03:59:10.304722+0000","last_became_peered":"2024-09-22T03:59:10.304722+0000","last_unstale":"2024-09-22T04:02:14.879406+0000","last_undegraded":"2024-09-22T04:02:14.879406+0000","last_fullsized":"2024-09-22T04:02:14.879406+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":2106,"log_dups_size":0,"ondisk_log_size":2106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3276800,"num_objects":50,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2106,"num_write_kb":68992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":271,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:28.843226+0000","last_change":"2024-09-22T03:49:12.034704+0000","last_active":"2024-09-22T04:00:28.843226+0000","last_peered":"2024-09-22T04:00:28.843226+0000","last_clean":"2024-09-22T04:00:28.843226+0000","last_became_active":"2024-09-22T03:49:12.027470+0000","last_became_peered":"2024-09-22T03:49:12.027470+0000","last_unstale":"2024-09-22T04:00:28.843226+0000","last_undegraded":"2024-09-22T04:00:28.843226+0000","last_fullsized":"2024-09-22T04:00:28.843226+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_clean_scrub_stamp":"2024-09-22T03:49:10.979949+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":197,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:28.847103+0000","last_change":"2024-09-22T03:49:17.031458+0000","last_active":"2024-09-22T04:00:28.847103+0000","last_peered":"2024-09-22T04:00:28.847103+0000","last_clean":"2024-09-22T04:00:28.847103+0000","last_became_active":"2024-09-22T03:49:15.125490+0000","last_became_peered":"2024-09-22T03:49:15.125490+0000","last_unstale":"2024-09-22T04:00:28.847103+0000","last_undegraded":"2024-09-22T04:00:28.847103+0000","last_fullsized":"2024-09-22T04:00:28.847103+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"76'2107","reported_seq":2143,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:02:16.081700+0000","last_change":"2024-09-22T03:59:10.355702+0000","last_active":"2024-09-22T04:02:16.081700+0000","last_peered":"2024-09-22T04:02:16.081700+0000","last_clean":"2024-09-22T04:02:16.081700+0000","last_became_active":"2024-09-22T03:59:10.330418+0000","last_became_peered":"2024-09-22T03:59:10.330418+0000","last_unstale":"2024-09-22T04:02:16.081700+0000","last_undegraded":"2024-09-22T04:02:16.081700+0000","last_fullsized":"2024-09-22T04:02:16.081700+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":2107,"log_dups_size":0,"ondisk_log_size":2107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3473408,"num_objects":53,"num_object_clones":0,"num_object_copies":159,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2107,"num_write_kb":69120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:28.835971+0000","last_change":"2024-09-22T03:49:17.029339+0000","last_active":"2024-09-22T04:00:28.835971+0000","last_peered":"2024-09-22T04:00:28.835971+0000","last_clean":"2024-09-22T04:00:28.835971+0000","last_became_active":"2024-09-22T03:49:15.097304+0000","last_became_peered":"2024-09-22T03:49:15.097304+0000","last_unstale":"2024-09-22T04:00:28.835971+0000","last_undegraded":"2024-09-22T04:00:28.835971+0000","last_fullsized":"2024-09-22T04:00:28.835971+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.5","version":"76'2074","reported_seq":2110,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:02:14.772575+0000","last_change":"2024-09-22T03:59:10.300610+0000","last_active":"2024-09-22T04:02:14.772575+0000","last_peered":"2024-09-22T04:02:14.772575+0000","last_clean":"2024-09-22T04:02:14.772575+0000","last_became_active":"2024-09-22T03:59:10.293587+0000","last_became_peered":"2024-09-22T03:59:10.293587+0000","last_unstale":"2024-09-22T04:02:14.772575+0000","last_undegraded":"2024-09-22T04:02:14.772575+0000","last_fullsized":"2024-09-22T04:02:14.772575+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":2074,"log_dups_size":0,"ondisk_log_size":2074,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4063232,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2074,"num_write_kb":68352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:28.834492+0000","last_change":"2024-09-22T03:49:17.029349+0000","last_active":"2024-09-22T04:00:28.834492+0000","last_peered":"2024-09-22T04:00:28.834492+0000","last_clean":"2024-09-22T04:00:28.834492+0000","last_became_active":"2024-09-22T03:49:15.094890+0000","last_became_peered":"2024-09-22T03:49:15.094890+0000","last_unstale":"2024-09-22T04:00:28.834492+0000","last_undegraded":"2024-09-22T04:00:28.834492+0000","last_fullsized":"2024-09-22T04:00:28.834492+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"76'2072","reported_seq":2108,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:02:15.889279+0000","last_change":"2024-09-22T03:59:10.359896+0000","last_active":"2024-09-22T04:02:15.889279+0000","last_peered":"2024-09-22T04:02:15.889279+0000","last_clean":"2024-09-22T04:02:15.889279+0000","last_became_active":"2024-09-22T03:59:10.342929+0000","last_became_peered":"2024-09-22T03:59:10.342929+0000","last_unstale":"2024-09-22T04:02:15.889279+0000","last_undegraded":"2024-09-22T04:02:15.889279+0000","last_fullsized":"2024-09-22T04:02:15.889279+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":2072,"log_dups_size":0,"ondisk_log_size":2072,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3538944,"num_objects":54,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2072,"num_write_kb":68032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":198,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:28.839096+0000","last_change":"2024-09-22T03:49:17.031466+0000","last_active":"2024-09-22T04:00:28.839096+0000","last_peered":"2024-09-22T04:00:28.839096+0000","last_clean":"2024-09-22T04:00:28.839096+0000","last_became_active":"2024-09-22T03:49:15.098420+0000","last_became_peered":"2024-09-22T03:49:15.098420+0000","last_unstale":"2024-09-22T04:00:28.839096+0000","last_undegraded":"2024-09-22T04:00:28.839096+0000","last_fullsized":"2024-09-22T04:00:28.839096+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.0","version":"76'2049","reported_seq":2085,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:02:15.084530+0000","last_change":"2024-09-22T03:59:10.339795+0000","last_active":"2024-09-22T04:02:15.084530+0000","last_peered":"2024-09-22T04:02:15.084530+0000","last_clean":"2024-09-22T04:02:15.084530+0000","last_became_active":"2024-09-22T03:59:10.325306+0000","last_became_peered":"2024-09-22T03:59:10.325306+0000","last_unstale":"2024-09-22T04:02:15.084530+0000","last_undegraded":"2024-09-22T04:02:15.084530+0000","last_fullsized":"2024-09-22T04:02:15.084530+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":2049,"log_dups_size":0,"ondisk_log_size":2049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3211264,"num_objects":49,"num_object_clones":0,"num_object_copies":147,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2049,"num_write_kb":67136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:28.846177+0000","last_change":"2024-09-22T03:49:17.036954+0000","last_active":"2024-09-22T04:00:28.846177+0000","last_peered":"2024-09-22T04:00:28.846177+0000","last_clean":"2024-09-22T04:00:28.846177+0000","last_became_active":"2024-09-22T03:49:15.110506+0000","last_became_peered":"2024-09-22T03:49:15.110506+0000","last_unstale":"2024-09-22T04:00:28.846177+0000","last_undegraded":"2024-09-22T04:00:28.846177+0000","last_fullsized":"2024-09-22T04:00:28.846177+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"76'2099","reported_seq":2135,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:02:16.212602+0000","last_change":"2024-09-22T03:59:10.361108+0000","last_active":"2024-09-22T04:02:16.212602+0000","last_peered":"2024-09-22T04:02:16.212602+0000","last_clean":"2024-09-22T04:02:16.212602+0000","last_became_active":"2024-09-22T03:59:10.347213+0000","last_became_peered":"2024-09-22T03:59:10.347213+0000","last_unstale":"2024-09-22T04:02:16.212602+0000","last_undegraded":"2024-09-22T04:02:16.212602+0000","last_fullsized":"2024-09-22T04:02:16.212602+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":2099,"log_dups_size":0,"ondisk_log_size":2099,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3080192,"num_objects":47,"num_object_clones":0,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2099,"num_write_kb":68672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:28.844399+0000","last_change":"2024-09-22T03:49:17.032989+0000","last_active":"2024-09-22T04:00:28.844399+0000","last_peered":"2024-09-22T04:00:28.844399+0000","last_clean":"2024-09-22T04:00:28.844399+0000","last_became_active":"2024-09-22T03:49:15.079260+0000","last_became_peered":"2024-09-22T03:49:15.079260+0000","last_unstale":"2024-09-22T04:00:28.844399+0000","last_undegraded":"2024-09-22T04:00:28.844399+0000","last_fullsized":"2024-09-22T04:00:28.844399+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2","version":"76'2015","reported_seq":2051,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:02:15.094983+0000","last_change":"2024-09-22T03:59:10.318033+0000","last_active":"2024-09-22T04:02:15.094983+0000","last_peered":"2024-09-22T04:02:15.094983+0000","last_clean":"2024-09-22T04:02:15.094983+0000","last_became_active":"2024-09-22T03:59:10.308707+0000","last_became_peered":"2024-09-22T03:59:10.308707+0000","last_unstale":"2024-09-22T04:02:15.094983+0000","last_undegraded":"2024-09-22T04:02:15.094983+0000","last_fullsized":"2024-09-22T04:02:15.094983+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":2015,"log_dups_size":0,"ondisk_log_size":2015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3080192,"num_objects":47,"num_object_clones":0,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2015,"num_write_kb":65984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:28.849513+0000","last_change":"2024-09-22T03:49:17.036402+0000","last_active":"2024-09-22T04:00:28.849513+0000","last_peered":"2024-09-22T04:00:28.849513+0000","last_clean":"2024-09-22T04:00:28.849513+0000","last_became_active":"2024-09-22T03:49:15.108430+0000","last_became_peered":"2024-09-22T03:49:15.108430+0000","last_unstale":"2024-09-22T04:00:28.849513+0000","last_undegraded":"2024-09-22T04:00:28.849513+0000","last_fullsized":"2024-09-22T04:00:28.849513+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"76'2135","reported_seq":2171,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:02:14.873335+0000","last_change":"2024-09-22T03:59:10.277817+0000","last_active":"2024-09-22T04:02:14.873335+0000","last_peered":"2024-09-22T04:02:14.873335+0000","last_clean":"2024-09-22T04:02:14.873335+0000","last_became_active":"2024-09-22T03:59:10.263119+0000","last_became_peered":"2024-09-22T03:59:10.263119+0000","last_unstale":"2024-09-22T04:02:14.873335+0000","last_undegraded":"2024-09-22T04:02:14.873335+0000","last_fullsized":"2024-09-22T04:02:14.873335+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":2135,"log_dups_size":0,"ondisk_log_size":2135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3080192,"num_objects":47,"num_object_clones":0,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2135,"num_write_kb":69824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:28.833568+0000","last_change":"2024-09-22T03:49:17.029128+0000","last_active":"2024-09-22T04:00:28.833568+0000","last_peered":"2024-09-22T04:00:28.833568+0000","last_clean":"2024-09-22T04:00:28.833568+0000","last_became_active":"2024-09-22T03:49:15.113396+0000","last_became_peered":"2024-09-22T03:49:15.113396+0000","last_unstale":"2024-09-22T04:00:28.833568+0000","last_undegraded":"2024-09-22T04:00:28.833568+0000","last_fullsized":"2024-09-22T04:00:28.833568+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":55574552,"num_objects":849,"num_object_clones":0,"num_object_copies":2547,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":33209,"num_write_kb":1089793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":10612736,"data_stored":169607240,"data_compressed":8053856,"data_compressed_allocated":10600448,"data_compressed_original":169607168,"omap_allocated":0,"internal_metadata":0},"log_size":33209,"ondisk_log_size":33209,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949673743,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":136892,"kb_used_data":3180,"kb_used_omap":0,"kb_used_meta":133696,"kb_avail":94234948,"statfs":{"total":96636764160,"available":96496586752,"internally_reserved":0,"allocated":3256320,"data_stored":41590855,"data_compressed":1965720,"data_compressed_allocated":2588672,"data_compressed_original":41336832,"omap_allocated":0,"internal_metadata":136904704},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654706447,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":120744,"kb_used_data":3672,"kb_used_omap":0,"kb_used_meta":117056,"kb_avail":94251096,"statfs":{"total":96636764160,"available":96513122304,"internally_reserved":0,"allocated":3760128,"data_stored":50109967,"data_compressed":2368232,"data_compressed_allocated":3117056,"data_compressed_original":49872896,"omap_allocated":0,"internal_metadata":119865344},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706447,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":129072,"kb_used_data":3680,"kb_used_omap":0,"kb_used_meta":125376,"kb_avail":94242768,"statfs":{"total":96636764160,"available":96504594432,"internally_reserved":0,"allocated":3768320,"data_stored":49782855,"data_compressed":2354720,"data_compressed_allocated":3100672,"data_compressed_original":49528832,"omap_allocated":0,"internal_metadata":128385024},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706447,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":124384,"kb_used_data":3148,"kb_used_omap":0,"kb_used_meta":121216,"kb_avail":94247456,"statfs":{"total":96636764160,"available":96509394944,"internally_reserved":0,"allocated":3223552,"data_stored":41132084,"data_compressed":1943936,"data_compressed_allocated":2560000,"data_compressed_original":40878080,"omap_allocated":0,"internal_metadata":124125184},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2445312,"data_stored":39059480,"data_compressed":1854752,"data_compressed_allocated":2441216,"data_compressed_original":39059456,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2379776,"data_stored":38010904,"data_compressed":1804960,"data_compressed_allocated":2375680,"data_compressed_original":38010880,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2990080,"data_stored":47775768,"data_compressed":2268648,"data_compressed_allocated":2985984,"data_compressed_original":47775744,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":2797568,"data_stored":44761088,"data_compressed":2125496,"data_compressed_allocated":2797568,"data_compressed_original":44761088,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T04:02:17.807 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T04:02:17.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:02:17.958+0000 7f1f306c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:02:17.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:02:17.970+0000 7f1f306c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:02:20.674 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T04:02:20.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:02:20.831+0000 7f353fc6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:02:20.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:02:20.842+0000 7f353fc6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:02:21.136 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Removed 17028 objects 2024-09-22T04:02:21.137 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Clean up completed and total clean up time :98.832 2024-09-22T04:02:22.314 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T04:02:22.314 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T04:02:22.314 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T04:02:22.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:02:22.451+0000 7fdf396d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:02:22.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:02:22.461+0000 7fdf396d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:02:22.665 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T04:02:22.665 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-22T04:02:22.678 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":465,"stamp":"2024-09-22T04:02:21.129287+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":22741579,"num_objects":343,"num_object_clones":0,"num_object_copies":1029,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":33800,"num_write_kb":1090901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33774,"ondisk_log_size":33774,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":512524,"kb_used_data":6792,"kb_used_omap":0,"kb_used_meta":505664,"kb_avail":376974836,"statfs":{"total":386547056640,"available":386022232064,"internally_reserved":0,"allocated":6955008,"data_stored":69762769,"data_compressed":3273744,"data_compressed_allocated":4313088,"data_compressed_original":68763648,"omap_allocated":0,"internal_metadata":517799936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-138018816,"num_objects":-2106,"num_object_clones":0,"num_object_copies":-6318,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2106,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002221"},"pg_stats":[{"pgid":"6.f","version":"76'2146","reported_seq":2182,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:02:16.191299+0000","last_change":"2024-09-22T03:59:10.330036+0000","last_active":"2024-09-22T04:02:16.191299+0000","last_peered":"2024-09-22T04:02:16.191299+0000","last_clean":"2024-09-22T04:02:16.191299+0000","last_became_active":"2024-09-22T03:59:10.319097+0000","last_became_peered":"2024-09-22T03:59:10.319097+0000","last_unstale":"2024-09-22T04:02:16.191299+0000","last_undegraded":"2024-09-22T04:02:16.191299+0000","last_fullsized":"2024-09-22T04:02:16.191299+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":2146,"log_dups_size":0,"ondisk_log_size":2146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3276800,"num_objects":50,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2146,"num_write_kb":70272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"76'2122","reported_seq":2158,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:02:20.120197+0000","last_change":"2024-09-22T03:59:10.321450+0000","last_active":"2024-09-22T04:02:20.120197+0000","last_peered":"2024-09-22T04:02:20.120197+0000","last_clean":"2024-09-22T04:02:20.120197+0000","last_became_active":"2024-09-22T03:59:10.311447+0000","last_became_peered":"2024-09-22T03:59:10.311447+0000","last_unstale":"2024-09-22T04:02:20.120197+0000","last_undegraded":"2024-09-22T04:02:20.120197+0000","last_fullsized":"2024-09-22T04:02:20.120197+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":2122,"log_dups_size":0,"ondisk_log_size":2122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":655360,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2122,"num_write_kb":68224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"76'2139","reported_seq":2176,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:02:19.593726+0000","last_change":"2024-09-22T03:59:10.349259+0000","last_active":"2024-09-22T04:02:19.593726+0000","last_peered":"2024-09-22T04:02:19.593726+0000","last_clean":"2024-09-22T04:02:19.593726+0000","last_became_active":"2024-09-22T03:59:10.341464+0000","last_became_peered":"2024-09-22T03:59:10.341464+0000","last_unstale":"2024-09-22T04:02:19.593726+0000","last_undegraded":"2024-09-22T04:02:19.593726+0000","last_fullsized":"2024-09-22T04:02:19.593726+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":2139,"log_dups_size":0,"ondisk_log_size":2139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":786456,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2139,"num_write_kb":68801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"76'2035","reported_seq":2071,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:02:16.222582+0000","last_change":"2024-09-22T03:59:10.365539+0000","last_active":"2024-09-22T04:02:16.222582+0000","last_peered":"2024-09-22T04:02:16.222582+0000","last_clean":"2024-09-22T04:02:16.222582+0000","last_became_active":"2024-09-22T03:59:10.339689+0000","last_became_peered":"2024-09-22T03:59:10.339689+0000","last_unstale":"2024-09-22T04:02:16.222582+0000","last_undegraded":"2024-09-22T04:02:16.222582+0000","last_fullsized":"2024-09-22T04:02:16.222582+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":2035,"log_dups_size":0,"ondisk_log_size":2035,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2949120,"num_objects":45,"num_object_clones":0,"num_object_copies":135,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2035,"num_write_kb":66560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"76'2167","reported_seq":2203,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:02:19.553603+0000","last_change":"2024-09-22T03:59:10.331496+0000","last_active":"2024-09-22T04:02:19.553603+0000","last_peered":"2024-09-22T04:02:19.553603+0000","last_clean":"2024-09-22T04:02:19.553603+0000","last_became_active":"2024-09-22T03:59:10.322922+0000","last_became_peered":"2024-09-22T03:59:10.322922+0000","last_unstale":"2024-09-22T04:02:19.553603+0000","last_undegraded":"2024-09-22T04:02:19.553603+0000","last_fullsized":"2024-09-22T04:02:19.553603+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":2167,"log_dups_size":0,"ondisk_log_size":2167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":720896,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2167,"num_write_kb":69696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.a","version":"76'2040","reported_seq":2076,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:02:20.053605+0000","last_change":"2024-09-22T03:59:10.268812+0000","last_active":"2024-09-22T04:02:20.053605+0000","last_peered":"2024-09-22T04:02:20.053605+0000","last_clean":"2024-09-22T04:02:20.053605+0000","last_became_active":"2024-09-22T03:59:10.261529+0000","last_became_peered":"2024-09-22T03:59:10.261529+0000","last_unstale":"2024-09-22T04:02:20.053605+0000","last_undegraded":"2024-09-22T04:02:20.053605+0000","last_fullsized":"2024-09-22T04:02:20.053605+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":2040,"log_dups_size":0,"ondisk_log_size":2040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":655360,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2040,"num_write_kb":65600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"76'2162","reported_seq":2198,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:02:19.769021+0000","last_change":"2024-09-22T03:59:10.357775+0000","last_active":"2024-09-22T04:02:19.769021+0000","last_peered":"2024-09-22T04:02:19.769021+0000","last_clean":"2024-09-22T04:02:19.769021+0000","last_became_active":"2024-09-22T03:59:10.350219+0000","last_became_peered":"2024-09-22T03:59:10.350219+0000","last_unstale":"2024-09-22T04:02:19.769021+0000","last_undegraded":"2024-09-22T04:02:19.769021+0000","last_fullsized":"2024-09-22T04:02:19.769021+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":2162,"log_dups_size":0,"ondisk_log_size":2162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524288,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2162,"num_write_kb":69440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"76'2026","reported_seq":2062,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:02:19.397266+0000","last_change":"2024-09-22T03:59:10.302834+0000","last_active":"2024-09-22T04:02:19.397266+0000","last_peered":"2024-09-22T04:02:19.397266+0000","last_clean":"2024-09-22T04:02:19.397266+0000","last_became_active":"2024-09-22T03:59:10.294403+0000","last_became_peered":"2024-09-22T03:59:10.294403+0000","last_unstale":"2024-09-22T04:02:19.397266+0000","last_undegraded":"2024-09-22T04:02:19.397266+0000","last_fullsized":"2024-09-22T04:02:19.397266+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":2026,"log_dups_size":0,"ondisk_log_size":2026,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524288,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2026,"num_write_kb":65088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"76'2146","reported_seq":2182,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:02:19.428630+0000","last_change":"2024-09-22T03:59:10.311620+0000","last_active":"2024-09-22T04:02:19.428630+0000","last_peered":"2024-09-22T04:02:19.428630+0000","last_clean":"2024-09-22T04:02:19.428630+0000","last_became_active":"2024-09-22T03:59:10.304722+0000","last_became_peered":"2024-09-22T03:59:10.304722+0000","last_unstale":"2024-09-22T04:02:19.428630+0000","last_undegraded":"2024-09-22T04:02:19.428630+0000","last_fullsized":"2024-09-22T04:02:19.428630+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":2146,"log_dups_size":0,"ondisk_log_size":2146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":655360,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2146,"num_write_kb":68992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":271,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:28.843226+0000","last_change":"2024-09-22T03:49:12.034704+0000","last_active":"2024-09-22T04:00:28.843226+0000","last_peered":"2024-09-22T04:00:28.843226+0000","last_clean":"2024-09-22T04:00:28.843226+0000","last_became_active":"2024-09-22T03:49:12.027470+0000","last_became_peered":"2024-09-22T03:49:12.027470+0000","last_unstale":"2024-09-22T04:00:28.843226+0000","last_undegraded":"2024-09-22T04:00:28.843226+0000","last_fullsized":"2024-09-22T04:00:28.843226+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_clean_scrub_stamp":"2024-09-22T03:49:10.979949+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":197,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:28.847103+0000","last_change":"2024-09-22T03:49:17.031458+0000","last_active":"2024-09-22T04:00:28.847103+0000","last_peered":"2024-09-22T04:00:28.847103+0000","last_clean":"2024-09-22T04:00:28.847103+0000","last_became_active":"2024-09-22T03:49:15.125490+0000","last_became_peered":"2024-09-22T03:49:15.125490+0000","last_unstale":"2024-09-22T04:00:28.847103+0000","last_undegraded":"2024-09-22T04:00:28.847103+0000","last_fullsized":"2024-09-22T04:00:28.847103+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"76'2107","reported_seq":2143,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:02:16.081700+0000","last_change":"2024-09-22T03:59:10.355702+0000","last_active":"2024-09-22T04:02:16.081700+0000","last_peered":"2024-09-22T04:02:16.081700+0000","last_clean":"2024-09-22T04:02:16.081700+0000","last_became_active":"2024-09-22T03:59:10.330418+0000","last_became_peered":"2024-09-22T03:59:10.330418+0000","last_unstale":"2024-09-22T04:02:16.081700+0000","last_undegraded":"2024-09-22T04:02:16.081700+0000","last_fullsized":"2024-09-22T04:02:16.081700+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":2107,"log_dups_size":0,"ondisk_log_size":2107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3473408,"num_objects":53,"num_object_clones":0,"num_object_copies":159,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2107,"num_write_kb":69120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:28.835971+0000","last_change":"2024-09-22T03:49:17.029339+0000","last_active":"2024-09-22T04:00:28.835971+0000","last_peered":"2024-09-22T04:00:28.835971+0000","last_clean":"2024-09-22T04:00:28.835971+0000","last_became_active":"2024-09-22T03:49:15.097304+0000","last_became_peered":"2024-09-22T03:49:15.097304+0000","last_unstale":"2024-09-22T04:00:28.835971+0000","last_undegraded":"2024-09-22T04:00:28.835971+0000","last_fullsized":"2024-09-22T04:00:28.835971+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.5","version":"76'2130","reported_seq":2166,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:02:20.113982+0000","last_change":"2024-09-22T03:59:10.300610+0000","last_active":"2024-09-22T04:02:20.113982+0000","last_peered":"2024-09-22T04:02:20.113982+0000","last_clean":"2024-09-22T04:02:20.113982+0000","last_became_active":"2024-09-22T03:59:10.293587+0000","last_became_peered":"2024-09-22T03:59:10.293587+0000","last_unstale":"2024-09-22T04:02:20.113982+0000","last_undegraded":"2024-09-22T04:02:20.113982+0000","last_fullsized":"2024-09-22T04:02:20.113982+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":2130,"log_dups_size":0,"ondisk_log_size":2130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2130,"num_write_kb":68352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:28.834492+0000","last_change":"2024-09-22T03:49:17.029349+0000","last_active":"2024-09-22T04:00:28.834492+0000","last_peered":"2024-09-22T04:00:28.834492+0000","last_clean":"2024-09-22T04:00:28.834492+0000","last_became_active":"2024-09-22T03:49:15.094890+0000","last_became_peered":"2024-09-22T03:49:15.094890+0000","last_unstale":"2024-09-22T04:00:28.834492+0000","last_undegraded":"2024-09-22T04:00:28.834492+0000","last_fullsized":"2024-09-22T04:00:28.834492+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"76'2072","reported_seq":2108,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:02:15.889279+0000","last_change":"2024-09-22T03:59:10.359896+0000","last_active":"2024-09-22T04:02:15.889279+0000","last_peered":"2024-09-22T04:02:15.889279+0000","last_clean":"2024-09-22T04:02:15.889279+0000","last_became_active":"2024-09-22T03:59:10.342929+0000","last_became_peered":"2024-09-22T03:59:10.342929+0000","last_unstale":"2024-09-22T04:02:15.889279+0000","last_undegraded":"2024-09-22T04:02:15.889279+0000","last_fullsized":"2024-09-22T04:02:15.889279+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":2072,"log_dups_size":0,"ondisk_log_size":2072,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3538944,"num_objects":54,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2072,"num_write_kb":68032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":198,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:28.839096+0000","last_change":"2024-09-22T03:49:17.031466+0000","last_active":"2024-09-22T04:00:28.839096+0000","last_peered":"2024-09-22T04:00:28.839096+0000","last_clean":"2024-09-22T04:00:28.839096+0000","last_became_active":"2024-09-22T03:49:15.098420+0000","last_became_peered":"2024-09-22T03:49:15.098420+0000","last_unstale":"2024-09-22T04:00:28.839096+0000","last_undegraded":"2024-09-22T04:00:28.839096+0000","last_fullsized":"2024-09-22T04:00:28.839096+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.0","version":"76'2094","reported_seq":2130,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:02:20.256411+0000","last_change":"2024-09-22T03:59:10.339795+0000","last_active":"2024-09-22T04:02:20.256411+0000","last_peered":"2024-09-22T04:02:20.256411+0000","last_clean":"2024-09-22T04:02:20.256411+0000","last_became_active":"2024-09-22T03:59:10.325306+0000","last_became_peered":"2024-09-22T03:59:10.325306+0000","last_unstale":"2024-09-22T04:02:20.256411+0000","last_undegraded":"2024-09-22T04:02:20.256411+0000","last_fullsized":"2024-09-22T04:02:20.256411+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":2094,"log_dups_size":0,"ondisk_log_size":2094,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262144,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2094,"num_write_kb":67136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:28.846177+0000","last_change":"2024-09-22T03:49:17.036954+0000","last_active":"2024-09-22T04:00:28.846177+0000","last_peered":"2024-09-22T04:00:28.846177+0000","last_clean":"2024-09-22T04:00:28.846177+0000","last_became_active":"2024-09-22T03:49:15.110506+0000","last_became_peered":"2024-09-22T03:49:15.110506+0000","last_unstale":"2024-09-22T04:00:28.846177+0000","last_undegraded":"2024-09-22T04:00:28.846177+0000","last_fullsized":"2024-09-22T04:00:28.846177+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"76'2099","reported_seq":2135,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:02:16.212602+0000","last_change":"2024-09-22T03:59:10.361108+0000","last_active":"2024-09-22T04:02:16.212602+0000","last_peered":"2024-09-22T04:02:16.212602+0000","last_clean":"2024-09-22T04:02:16.212602+0000","last_became_active":"2024-09-22T03:59:10.347213+0000","last_became_peered":"2024-09-22T03:59:10.347213+0000","last_unstale":"2024-09-22T04:02:16.212602+0000","last_undegraded":"2024-09-22T04:02:16.212602+0000","last_fullsized":"2024-09-22T04:02:16.212602+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":2099,"log_dups_size":0,"ondisk_log_size":2099,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3080192,"num_objects":47,"num_object_clones":0,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2099,"num_write_kb":68672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:28.844399+0000","last_change":"2024-09-22T03:49:17.032989+0000","last_active":"2024-09-22T04:00:28.844399+0000","last_peered":"2024-09-22T04:00:28.844399+0000","last_clean":"2024-09-22T04:00:28.844399+0000","last_became_active":"2024-09-22T03:49:15.079260+0000","last_became_peered":"2024-09-22T03:49:15.079260+0000","last_unstale":"2024-09-22T04:00:28.844399+0000","last_undegraded":"2024-09-22T04:00:28.844399+0000","last_fullsized":"2024-09-22T04:00:28.844399+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2","version":"76'2055","reported_seq":2091,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:02:19.827632+0000","last_change":"2024-09-22T03:59:10.318033+0000","last_active":"2024-09-22T04:02:19.827632+0000","last_peered":"2024-09-22T04:02:19.827632+0000","last_clean":"2024-09-22T04:02:19.827632+0000","last_became_active":"2024-09-22T03:59:10.308707+0000","last_became_peered":"2024-09-22T03:59:10.308707+0000","last_unstale":"2024-09-22T04:02:19.827632+0000","last_undegraded":"2024-09-22T04:02:19.827632+0000","last_fullsized":"2024-09-22T04:02:19.827632+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":2055,"log_dups_size":0,"ondisk_log_size":2055,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":458752,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2055,"num_write_kb":65984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:28.849513+0000","last_change":"2024-09-22T03:49:17.036402+0000","last_active":"2024-09-22T04:00:28.849513+0000","last_peered":"2024-09-22T04:00:28.849513+0000","last_clean":"2024-09-22T04:00:28.849513+0000","last_became_active":"2024-09-22T03:49:15.108430+0000","last_became_peered":"2024-09-22T03:49:15.108430+0000","last_unstale":"2024-09-22T04:00:28.849513+0000","last_undegraded":"2024-09-22T04:00:28.849513+0000","last_fullsized":"2024-09-22T04:00:28.849513+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"76'2179","reported_seq":2215,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:02:20.109905+0000","last_change":"2024-09-22T03:59:10.277817+0000","last_active":"2024-09-22T04:02:20.109905+0000","last_peered":"2024-09-22T04:02:20.109905+0000","last_clean":"2024-09-22T04:02:20.109905+0000","last_became_active":"2024-09-22T03:59:10.263119+0000","last_became_peered":"2024-09-22T03:59:10.263119+0000","last_unstale":"2024-09-22T04:02:20.109905+0000","last_undegraded":"2024-09-22T04:02:20.109905+0000","last_fullsized":"2024-09-22T04:02:20.109905+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:59:09.150746+0000","last_clean_scrub_stamp":"2024-09-22T03:59:09.150746+0000","objects_scrubbed":0,"log_size":2179,"log_dups_size":0,"ondisk_log_size":2179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":196608,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2179,"num_write_kb":69824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":196,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-22T04:00:28.833568+0000","last_change":"2024-09-22T03:49:17.029128+0000","last_active":"2024-09-22T04:00:28.833568+0000","last_peered":"2024-09-22T04:00:28.833568+0000","last_clean":"2024-09-22T04:00:28.833568+0000","last_became_active":"2024-09-22T03:49:15.113396+0000","last_became_peered":"2024-09-22T03:49:15.113396+0000","last_unstale":"2024-09-22T04:00:28.833568+0000","last_undegraded":"2024-09-22T04:00:28.833568+0000","last_fullsized":"2024-09-22T04:00:28.833568+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":22151192,"num_objects":339,"num_object_clones":0,"num_object_copies":1017,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":33719,"num_write_kb":1089793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3624960,"data_stored":57802824,"data_compressed":2744784,"data_compressed_allocated":3612672,"data_compressed_original":57802752,"omap_allocated":0,"internal_metadata":0},"log_size":33719,"ondisk_log_size":33719,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949673743,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":136892,"kb_used_data":3180,"kb_used_omap":0,"kb_used_meta":133696,"kb_avail":94234948,"statfs":{"total":96636764160,"available":96496586752,"internally_reserved":0,"allocated":3256320,"data_stored":41590855,"data_compressed":1965720,"data_compressed_allocated":2588672,"data_compressed_original":41336832,"omap_allocated":0,"internal_metadata":136904704},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654706452,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":122572,"kb_used_data":1340,"kb_used_omap":0,"kb_used_meta":121216,"kb_avail":94249268,"statfs":{"total":96636764160,"available":96511250432,"internally_reserved":0,"allocated":1372160,"data_stored":11902479,"data_compressed":553936,"data_compressed_allocated":729088,"data_compressed_original":11665408,"omap_allocated":0,"internal_metadata":124125184},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706452,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":126600,"kb_used_data":1208,"kb_used_omap":0,"kb_used_meta":125376,"kb_avail":94245240,"statfs":{"total":96636764160,"available":96507125760,"internally_reserved":0,"allocated":1236992,"data_stored":9281607,"data_compressed":431504,"data_compressed_allocated":569344,"data_compressed_original":9027584,"omap_allocated":0,"internal_metadata":128385024},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706452,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":126460,"kb_used_data":1064,"kb_used_omap":0,"kb_used_meta":125376,"kb_avail":94245380,"statfs":{"total":96636764160,"available":96507269120,"internally_reserved":0,"allocated":1089536,"data_stored":6987828,"data_compressed":322584,"data_compressed_allocated":425984,"data_compressed_original":6733824,"omap_allocated":0,"internal_metadata":128385024},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":331776,"data_stored":5242904,"data_compressed":248960,"data_compressed_allocated":327680,"data_compressed_original":5242880,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2379776,"data_stored":38010904,"data_compressed":1804960,"data_compressed_allocated":2375680,"data_compressed_original":38010880,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":487424,"data_stored":7733272,"data_compressed":367216,"data_compressed_allocated":483328,"data_compressed_original":7733248,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":425984,"data_stored":6815744,"data_compressed":323648,"data_compressed_allocated":425984,"data_compressed_original":6815744,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T04:02:23.164 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T04:02:23.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:02:23.278+0000 7f195e991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:02:23.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:02:23.284+0000 7f195e991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:02:25.392 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T04:02:25.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:02:25.517+0000 7f1448711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:02:25.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:02:25.523+0000 7f1448711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:02:26.430 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_3 2024-09-22T04:02:26.430 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_3 unique_pool_3 --yes-i-really-really-mean-it 2024-09-22T04:02:26.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:02:26.553+0000 7fcd85ae3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:02:26.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:02:26.567+0000 7fcd85ae3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:02:26.786 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'unique_pool_3' removed 2024-09-22T04:02:26.805 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2024-09-22T04:02:26.806 INFO:tasks.radosbench:Beginning radosbench... 2024-09-22T04:02:26.806 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_4 2024-09-22T04:02:26.806 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_4 16 2024-09-22T04:02:26.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:02:26.944+0000 7f0d7a2bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:02:26.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:02:26.961+0000 7f0d7a2bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:02:27.630 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T04:02:27.680 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T04:02:27.680 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T04:02:27.680 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T04:02:27.680 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T04:02:27.761 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'unique_pool_4' created 2024-09-22T04:02:27.784 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_4 rados --yes-i-really-mean-it || true 2024-09-22T04:02:27.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:02:27.781+0000 7f7095991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:02:27.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:02:27.797+0000 7f7095991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:02:27.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:02:27.816+0000 7ff5f9551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:02:27.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:02:27.834+0000 7ff5f9551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:02:27.902 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:02:27.902 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:02:27.902 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:02:27.903 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:02:27.903 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:02:27.903 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:02:27.903 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:02:27.903 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:02:27.903 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:02:27.903 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:02:27.903 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:02:27.903 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:02:27.906 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:02:27.906 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:02:27.906 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T04:02:27.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:02:27.941+0000 7f8816591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:02:27.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:02:27.960+0000 7f8816591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:02:28.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:02:28.061+0000 7f0424274640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:02:28.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:02:28.071+0000 7f0424274640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:02:28.092 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:02:28.092 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:02:28.093 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:02:28.093 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:02:28.093 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:02:28.093 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:02:28.093 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:02:28.093 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:02:28.093 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:02:28.093 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:02:28.093 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:02:28.093 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:02:28.096 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:02:28.097 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:02:28.097 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T04:02:28.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:02:28.205+0000 7f721aad1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:02:28.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:02:28.215+0000 7f721aad1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:02:28.232 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:02:28.232 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:02:28.232 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:02:28.232 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:02:28.232 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:02:28.232 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:02:28.233 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:02:28.233 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:02:28.233 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:02:28.233 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:02:28.233 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:02:28.233 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:02:28.235 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:02:28.235 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:02:28.235 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T04:02:28.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:02:28.343+0000 7f9b2bb11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:02:28.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:02:28.353+0000 7f9b2bb11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:02:28.371 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:02:28.371 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:02:28.371 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:02:28.371 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:02:28.371 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:02:28.372 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:02:28.372 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:02:28.372 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:02:28.372 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:02:28.372 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:02:28.372 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:02:28.372 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:02:28.374 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:02:28.374 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:02:28.772 INFO:teuthology.orchestra.run.smithi037.stderr:enabled application 'rados' on pool 'unique_pool_4' 2024-09-22T04:02:29.793 DEBUG:teuthology.orchestra.run.smithi037:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -b 65536 --object-size 65536 -p unique_pool_4 bench 90 write' 2024-09-22T04:02:29.795 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2024-09-22T04:02:29.796 INFO:teuthology.orchestra.run:waiting for 3000 2024-09-22T04:02:29.878 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:hints = 1 2024-09-22T04:02:29.878 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Maintaining 16 concurrent writes of 65536 bytes to objects of size 65536 for up to 90 seconds or 0 objects 2024-09-22T04:02:29.878 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Object prefix: benchmark_data_smithi037_62398 2024-09-22T04:02:29.878 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-22T04:02:29.878 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 0 0 0 0 0 0 - 0 2024-09-22T04:02:30.013 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T04:02:30.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:02:30.185+0000 7f7125d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:02:30.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:02:30.196+0000 7f7125d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:02:30.878 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 1 16 193 177 11.0618 11.0625 0.0808933 0.0864693 2024-09-22T04:02:31.879 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 2 16 375 359 11.2179 11.375 0.0969198 0.0869868 2024-09-22T04:02:32.600 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T04:02:32.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:02:32.750+0000 7f9104046640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:02:32.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:02:32.761+0000 7f9104046640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:02:32.879 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 3 16 555 539 11.2282 11.25 0.107554 0.086944 2024-09-22T04:02:33.375 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T04:02:33.375 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T04:02:33.375 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T04:02:33.375 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T04:02:33.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:02:33.541+0000 7f2875046640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:02:33.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:02:33.559+0000 7f2875046640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:02:33.741 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:02:33.741 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:02:33.741 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:02:33.741 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:02:33.741 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:02:33.741 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:02:33.741 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:02:33.741 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:02:33.741 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:02:33.742 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:02:33.742 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:02:33.742 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:02:33.746 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:02:33.747 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:02:33.747 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T04:02:33.879 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 4 16 750 734 11.4678 12.1875 0.105196 0.0862092 2024-09-22T04:02:33.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:02:33.910+0000 7ff4bc191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:02:33.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:02:33.928+0000 7ff4bc191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:02:33.959 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:02:33.960 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:02:33.960 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:02:33.960 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:02:33.960 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:02:33.960 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:02:33.960 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:02:33.960 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:02:33.960 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:02:33.960 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:02:33.960 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:02:33.960 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:02:33.964 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:02:33.964 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:02:33.964 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T04:02:34.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:02:34.117+0000 7f40a72fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:02:34.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:02:34.134+0000 7f40a72fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:02:34.246 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:02:34.246 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:02:34.246 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:02:34.246 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:02:34.246 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:02:34.246 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:02:34.246 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:02:34.246 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:02:34.246 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:02:34.246 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:02:34.246 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:02:34.247 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:02:34.252 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:02:34.252 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:02:34.252 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T04:02:34.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:02:34.424+0000 7f6c226ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:02:34.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:02:34.442+0000 7f6c2144a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:02:34.557 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:02:34.557 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:02:34.557 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:02:34.557 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:02:34.557 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:02:34.557 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:02:34.557 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:02:34.557 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:02:34.557 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:02:34.557 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:02:34.557 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:02:34.557 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:02:34.563 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:02:34.563 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:02:34.879 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 5 16 947 931 11.6365 12.3125 0.0483664 0.0851613 2024-09-22T04:02:35.192 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T04:02:35.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:02:35.364+0000 7f89ab991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:02:35.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:02:35.374+0000 7f89ab991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:02:35.879 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 6 16 1146 1130 11.7699 12.4375 0.133684 0.084239 2024-09-22T04:02:36.879 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 7 16 1339 1323 11.8115 12.0625 0.146316 0.0836206 2024-09-22T04:02:37.749 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T04:02:37.879 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 8 16 1521 1505 11.7568 11.375 0.0369335 0.0845957 2024-09-22T04:02:37.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:02:37.909+0000 7fe326191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:02:37.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:02:37.920+0000 7fe326191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:02:38.879 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 9 16 1721 1705 11.8393 12.5 0.0558088 0.0841647 2024-09-22T04:02:39.564 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T04:02:39.564 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T04:02:39.564 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T04:02:39.564 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T04:02:39.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:02:39.740+0000 7f6c5a591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:02:39.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:02:39.752+0000 7f6c5a591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:02:39.879 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 10 16 1907 1891 11.8178 11.625 0.0233486 0.0841268 2024-09-22T04:02:39.917 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:02:39.917 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:02:39.917 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:02:39.917 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:02:39.917 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:02:39.917 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:02:39.917 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:02:39.917 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:02:39.917 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:02:39.917 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:02:39.917 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:02:39.917 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:02:39.920 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:02:39.921 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:02:39.921 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T04:02:40.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:02:40.092+0000 7f65766ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:02:40.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:02:40.107+0000 7f65766ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:02:40.142 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:02:40.142 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:02:40.142 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:02:40.142 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:02:40.143 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:02:40.143 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:02:40.143 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:02:40.143 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:02:40.143 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:02:40.143 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:02:40.143 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:02:40.143 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:02:40.147 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:02:40.147 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:02:40.147 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T04:02:40.286 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T04:02:40.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:02:40.298+0000 7f4ce3f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:02:40.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:02:40.318+0000 7f4ce3f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:02:40.398 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:02:40.398 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:02:40.398 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:02:40.398 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:02:40.398 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:02:40.398 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:02:40.398 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:02:40.398 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:02:40.398 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:02:40.398 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:02:40.399 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:02:40.399 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:02:40.402 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:02:40.403 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:02:40.403 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T04:02:40.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:02:40.440+0000 7fd79dd11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:02:40.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:02:40.451+0000 7fd79dd11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:02:40.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:02:40.597+0000 7fd357d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:02:40.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:02:40.612+0000 7fd357d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:02:40.644 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:02:40.645 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:02:40.645 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:02:40.645 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:02:40.645 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:02:40.645 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:02:40.645 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:02:40.645 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:02:40.645 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:02:40.645 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:02:40.645 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:02:40.645 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:02:40.649 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:02:40.649 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:02:40.879 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 11 16 2084 2068 11.749 11.0625 0.0666591 0.0847844 2024-09-22T04:02:41.879 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 12 16 2296 2280 11.874 13.25 0.0941467 0.0839758 2024-09-22T04:02:42.879 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 13 16 2475 2459 11.8211 11.1875 0.0882094 0.084331 2024-09-22T04:02:42.966 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T04:02:43.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:02:43.135+0000 7f828de4f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:02:43.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:02:43.144+0000 7f828de4f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:02:43.879 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 14 16 2657 2641 11.7892 11.375 0.0417605 0.0844824 2024-09-22T04:02:44.880 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 15 16 2841 2825 11.7698 11.5 0.0349242 0.0846579 2024-09-22T04:02:45.495 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T04:02:45.650 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T04:02:45.650 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T04:02:45.651 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T04:02:45.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:02:45.659+0000 7f22ba191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:02:45.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:02:45.671+0000 7f22b8f2f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:02:45.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:02:45.822+0000 7f491acf4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:02:45.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:02:45.835+0000 7f491acf4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:02:45.880 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 16 16 3018 3002 11.7256 11.0625 0.121669 0.0850437 2024-09-22T04:02:46.198 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T04:02:46.199 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-22T04:02:46.223 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":481,"stamp":"2024-09-22T04:02:45.134420+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":133300787,"num_objects":2029,"num_object_clones":0,"num_object_copies":6087,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":2106,"num_write_kb":130708,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2080,"ondisk_log_size":2080,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":523680,"kb_used_data":26272,"kb_used_omap":0,"kb_used_meta":497344,"kb_avail":376963680,"statfs":{"total":386547056640,"available":386010808320,"internally_reserved":0,"allocated":26902528,"data_stored":386816757,"data_compressed":18323158,"data_compressed_allocated":24125440,"data_compressed_original":385761280,"omap_allocated":0,"internal_metadata":509280256},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":124583936,"num_objects":1901,"num_object_clones":0,"num_object_copies":5703,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1901,"num_write_kb":121664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002491"},"pg_stats":[{"pgid":"7.f","version":"80'122","reported_seq":134,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:40.072981+0000","last_change":"2024-09-22T04:02:28.979477+0000","last_active":"2024-09-22T04:02:40.072981+0000","last_peered":"2024-09-22T04:02:40.072981+0000","last_clean":"2024-09-22T04:02:40.072981+0000","last_became_active":"2024-09-22T04:02:28.971367+0000","last_became_peered":"2024-09-22T04:02:28.971367+0000","last_unstale":"2024-09-22T04:02:40.072981+0000","last_undegraded":"2024-09-22T04:02:40.072981+0000","last_fullsized":"2024-09-22T04:02:40.072981+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7995392,"num_objects":122,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":122,"num_write_kb":7808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"80'112","reported_seq":124,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:40.112799+0000","last_change":"2024-09-22T04:02:28.872853+0000","last_active":"2024-09-22T04:02:40.112799+0000","last_peered":"2024-09-22T04:02:40.112799+0000","last_clean":"2024-09-22T04:02:40.112799+0000","last_became_active":"2024-09-22T04:02:28.865538+0000","last_became_peered":"2024-09-22T04:02:28.865538+0000","last_unstale":"2024-09-22T04:02:40.112799+0000","last_undegraded":"2024-09-22T04:02:40.112799+0000","last_fullsized":"2024-09-22T04:02:40.112799+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340032,"num_objects":112,"num_object_clones":0,"num_object_copies":336,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.d","version":"80'128","reported_seq":140,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:41.271089+0000","last_change":"2024-09-22T04:02:28.967443+0000","last_active":"2024-09-22T04:02:41.271089+0000","last_peered":"2024-09-22T04:02:41.271089+0000","last_clean":"2024-09-22T04:02:41.271089+0000","last_became_active":"2024-09-22T04:02:28.959444+0000","last_became_peered":"2024-09-22T04:02:28.959444+0000","last_unstale":"2024-09-22T04:02:41.271089+0000","last_undegraded":"2024-09-22T04:02:41.271089+0000","last_fullsized":"2024-09-22T04:02:41.271089+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":128,"num_object_clones":0,"num_object_copies":384,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"80'120","reported_seq":132,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:40.146623+0000","last_change":"2024-09-22T04:02:28.963918+0000","last_active":"2024-09-22T04:02:40.146623+0000","last_peered":"2024-09-22T04:02:40.146623+0000","last_clean":"2024-09-22T04:02:40.146623+0000","last_became_active":"2024-09-22T04:02:28.948540+0000","last_became_peered":"2024-09-22T04:02:28.948540+0000","last_unstale":"2024-09-22T04:02:40.146623+0000","last_undegraded":"2024-09-22T04:02:40.146623+0000","last_fullsized":"2024-09-22T04:02:40.146623+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7864320,"num_objects":120,"num_object_clones":0,"num_object_copies":360,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":7680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"80'141","reported_seq":153,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:41.061626+0000","last_change":"2024-09-22T04:02:28.971728+0000","last_active":"2024-09-22T04:02:41.061626+0000","last_peered":"2024-09-22T04:02:41.061626+0000","last_clean":"2024-09-22T04:02:41.061626+0000","last_became_active":"2024-09-22T04:02:28.960293+0000","last_became_peered":"2024-09-22T04:02:28.960293+0000","last_unstale":"2024-09-22T04:02:41.061626+0000","last_undegraded":"2024-09-22T04:02:41.061626+0000","last_fullsized":"2024-09-22T04:02:41.061626+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9240576,"num_objects":141,"num_object_clones":0,"num_object_copies":423,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":9024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"80'139","reported_seq":151,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:41.250245+0000","last_change":"2024-09-22T04:02:29.026441+0000","last_active":"2024-09-22T04:02:41.250245+0000","last_peered":"2024-09-22T04:02:41.250245+0000","last_clean":"2024-09-22T04:02:41.250245+0000","last_became_active":"2024-09-22T04:02:28.991656+0000","last_became_peered":"2024-09-22T04:02:28.991656+0000","last_unstale":"2024-09-22T04:02:41.250245+0000","last_undegraded":"2024-09-22T04:02:41.250245+0000","last_fullsized":"2024-09-22T04:02:41.250245+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9109504,"num_objects":139,"num_object_clones":0,"num_object_copies":417,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":8896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.9","version":"80'132","reported_seq":144,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:40.261042+0000","last_change":"2024-09-22T04:02:28.996162+0000","last_active":"2024-09-22T04:02:40.261042+0000","last_peered":"2024-09-22T04:02:40.261042+0000","last_clean":"2024-09-22T04:02:40.261042+0000","last_became_active":"2024-09-22T04:02:28.990154+0000","last_became_peered":"2024-09-22T04:02:28.990154+0000","last_unstale":"2024-09-22T04:02:40.261042+0000","last_undegraded":"2024-09-22T04:02:40.261042+0000","last_fullsized":"2024-09-22T04:02:40.261042+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8650752,"num_objects":132,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":8448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"80'143","reported_seq":155,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:39.920727+0000","last_change":"2024-09-22T04:02:28.902123+0000","last_active":"2024-09-22T04:02:39.920727+0000","last_peered":"2024-09-22T04:02:39.920727+0000","last_clean":"2024-09-22T04:02:39.920727+0000","last_became_active":"2024-09-22T04:02:28.895508+0000","last_became_peered":"2024-09-22T04:02:28.895508+0000","last_unstale":"2024-09-22T04:02:39.920727+0000","last_undegraded":"2024-09-22T04:02:39.920727+0000","last_fullsized":"2024-09-22T04:02:39.920727+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9371648,"num_objects":143,"num_object_clones":0,"num_object_copies":429,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":143,"num_write_kb":9152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.6","version":"80'132","reported_seq":144,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:40.051623+0000","last_change":"2024-09-22T04:02:29.024059+0000","last_active":"2024-09-22T04:02:40.051623+0000","last_peered":"2024-09-22T04:02:40.051623+0000","last_clean":"2024-09-22T04:02:40.051623+0000","last_became_active":"2024-09-22T04:02:29.013699+0000","last_became_peered":"2024-09-22T04:02:29.013699+0000","last_unstale":"2024-09-22T04:02:40.051623+0000","last_undegraded":"2024-09-22T04:02:40.051623+0000","last_fullsized":"2024-09-22T04:02:40.051623+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8650752,"num_objects":132,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":8448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":283,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:29.819502+0000","last_change":"2024-09-22T03:49:12.034704+0000","last_active":"2024-09-22T04:02:29.819502+0000","last_peered":"2024-09-22T04:02:29.819502+0000","last_clean":"2024-09-22T04:02:29.819502+0000","last_became_active":"2024-09-22T03:49:12.027470+0000","last_became_peered":"2024-09-22T03:49:12.027470+0000","last_unstale":"2024-09-22T04:02:29.819502+0000","last_undegraded":"2024-09-22T04:02:29.819502+0000","last_fullsized":"2024-09-22T04:02:29.819502+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_clean_scrub_stamp":"2024-09-22T03:49:10.979949+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":209,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:29.818606+0000","last_change":"2024-09-22T03:49:17.031458+0000","last_active":"2024-09-22T04:02:29.818606+0000","last_peered":"2024-09-22T04:02:29.818606+0000","last_clean":"2024-09-22T04:02:29.818606+0000","last_became_active":"2024-09-22T03:49:15.125490+0000","last_became_peered":"2024-09-22T03:49:15.125490+0000","last_unstale":"2024-09-22T04:02:29.818606+0000","last_undegraded":"2024-09-22T04:02:29.818606+0000","last_fullsized":"2024-09-22T04:02:29.818606+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"80'135","reported_seq":147,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:40.061992+0000","last_change":"2024-09-22T04:02:28.912870+0000","last_active":"2024-09-22T04:02:40.061992+0000","last_peered":"2024-09-22T04:02:40.061992+0000","last_clean":"2024-09-22T04:02:40.061992+0000","last_became_active":"2024-09-22T04:02:28.905573+0000","last_became_peered":"2024-09-22T04:02:28.905573+0000","last_unstale":"2024-09-22T04:02:40.061992+0000","last_undegraded":"2024-09-22T04:02:40.061992+0000","last_fullsized":"2024-09-22T04:02:40.061992+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8847360,"num_objects":135,"num_object_clones":0,"num_object_copies":405,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":8640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":208,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:29.815930+0000","last_change":"2024-09-22T03:49:17.029339+0000","last_active":"2024-09-22T04:02:29.815930+0000","last_peered":"2024-09-22T04:02:29.815930+0000","last_clean":"2024-09-22T04:02:29.815930+0000","last_became_active":"2024-09-22T03:49:15.097304+0000","last_became_peered":"2024-09-22T03:49:15.097304+0000","last_unstale":"2024-09-22T04:02:29.815930+0000","last_undegraded":"2024-09-22T04:02:29.815930+0000","last_fullsized":"2024-09-22T04:02:29.815930+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"80'112","reported_seq":124,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:40.178428+0000","last_change":"2024-09-22T04:02:28.928198+0000","last_active":"2024-09-22T04:02:40.178428+0000","last_peered":"2024-09-22T04:02:40.178428+0000","last_clean":"2024-09-22T04:02:40.178428+0000","last_became_active":"2024-09-22T04:02:28.909503+0000","last_became_peered":"2024-09-22T04:02:28.909503+0000","last_unstale":"2024-09-22T04:02:40.178428+0000","last_undegraded":"2024-09-22T04:02:40.178428+0000","last_fullsized":"2024-09-22T04:02:40.178428+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340032,"num_objects":112,"num_object_clones":0,"num_object_copies":336,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":208,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:29.822286+0000","last_change":"2024-09-22T03:49:17.029349+0000","last_active":"2024-09-22T04:02:29.822286+0000","last_peered":"2024-09-22T04:02:29.822286+0000","last_clean":"2024-09-22T04:02:29.822286+0000","last_became_active":"2024-09-22T03:49:15.094890+0000","last_became_peered":"2024-09-22T03:49:15.094890+0000","last_unstale":"2024-09-22T04:02:29.822286+0000","last_undegraded":"2024-09-22T04:02:29.822286+0000","last_fullsized":"2024-09-22T04:02:29.822286+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.7","version":"80'132","reported_seq":144,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:39.964320+0000","last_change":"2024-09-22T04:02:28.945388+0000","last_active":"2024-09-22T04:02:39.964320+0000","last_peered":"2024-09-22T04:02:39.964320+0000","last_clean":"2024-09-22T04:02:39.964320+0000","last_became_active":"2024-09-22T04:02:28.939479+0000","last_became_peered":"2024-09-22T04:02:28.939479+0000","last_unstale":"2024-09-22T04:02:39.964320+0000","last_undegraded":"2024-09-22T04:02:39.964320+0000","last_fullsized":"2024-09-22T04:02:39.964320+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8650752,"num_objects":132,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":8448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":210,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:29.820716+0000","last_change":"2024-09-22T03:49:17.031466+0000","last_active":"2024-09-22T04:02:29.820716+0000","last_peered":"2024-09-22T04:02:29.820716+0000","last_clean":"2024-09-22T04:02:29.820716+0000","last_became_active":"2024-09-22T03:49:15.098420+0000","last_became_peered":"2024-09-22T03:49:15.098420+0000","last_unstale":"2024-09-22T04:02:29.820716+0000","last_undegraded":"2024-09-22T04:02:29.820716+0000","last_fullsized":"2024-09-22T04:02:29.820716+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1","version":"80'124","reported_seq":136,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:40.144294+0000","last_change":"2024-09-22T04:02:28.927518+0000","last_active":"2024-09-22T04:02:40.144294+0000","last_peered":"2024-09-22T04:02:40.144294+0000","last_clean":"2024-09-22T04:02:40.144294+0000","last_became_active":"2024-09-22T04:02:28.919323+0000","last_became_peered":"2024-09-22T04:02:28.919323+0000","last_unstale":"2024-09-22T04:02:40.144294+0000","last_undegraded":"2024-09-22T04:02:40.144294+0000","last_fullsized":"2024-09-22T04:02:40.144294+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8126464,"num_objects":124,"num_object_clones":0,"num_object_copies":372,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":124,"num_write_kb":7936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":208,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:29.823311+0000","last_change":"2024-09-22T03:49:17.036954+0000","last_active":"2024-09-22T04:02:29.823311+0000","last_peered":"2024-09-22T04:02:29.823311+0000","last_clean":"2024-09-22T04:02:29.823311+0000","last_became_active":"2024-09-22T03:49:15.110506+0000","last_became_peered":"2024-09-22T03:49:15.110506+0000","last_unstale":"2024-09-22T04:02:29.823311+0000","last_undegraded":"2024-09-22T04:02:29.823311+0000","last_fullsized":"2024-09-22T04:02:29.823311+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"80'137","reported_seq":149,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:41.249586+0000","last_change":"2024-09-22T04:02:28.954190+0000","last_active":"2024-09-22T04:02:41.249586+0000","last_peered":"2024-09-22T04:02:41.249586+0000","last_clean":"2024-09-22T04:02:41.249586+0000","last_became_active":"2024-09-22T04:02:28.946807+0000","last_became_peered":"2024-09-22T04:02:28.946807+0000","last_unstale":"2024-09-22T04:02:41.249586+0000","last_undegraded":"2024-09-22T04:02:41.249586+0000","last_fullsized":"2024-09-22T04:02:41.249586+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8978432,"num_objects":137,"num_object_clones":0,"num_object_copies":411,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":8768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":208,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:29.820857+0000","last_change":"2024-09-22T03:49:17.032989+0000","last_active":"2024-09-22T04:02:29.820857+0000","last_peered":"2024-09-22T04:02:29.820857+0000","last_clean":"2024-09-22T04:02:29.820857+0000","last_became_active":"2024-09-22T03:49:15.079260+0000","last_became_peered":"2024-09-22T03:49:15.079260+0000","last_unstale":"2024-09-22T04:02:29.820857+0000","last_undegraded":"2024-09-22T04:02:29.820857+0000","last_fullsized":"2024-09-22T04:02:29.820857+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3","version":"80'112","reported_seq":124,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:39.985325+0000","last_change":"2024-09-22T04:02:28.924084+0000","last_active":"2024-09-22T04:02:39.985325+0000","last_peered":"2024-09-22T04:02:39.985325+0000","last_clean":"2024-09-22T04:02:39.985325+0000","last_became_active":"2024-09-22T04:02:28.898697+0000","last_became_peered":"2024-09-22T04:02:28.898697+0000","last_unstale":"2024-09-22T04:02:39.985325+0000","last_undegraded":"2024-09-22T04:02:39.985325+0000","last_fullsized":"2024-09-22T04:02:39.985325+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340032,"num_objects":112,"num_object_clones":0,"num_object_copies":336,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":208,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:29.823587+0000","last_change":"2024-09-22T03:49:17.036402+0000","last_active":"2024-09-22T04:02:29.823587+0000","last_peered":"2024-09-22T04:02:29.823587+0000","last_clean":"2024-09-22T04:02:29.823587+0000","last_became_active":"2024-09-22T03:49:15.108430+0000","last_became_peered":"2024-09-22T03:49:15.108430+0000","last_unstale":"2024-09-22T04:02:29.823587+0000","last_undegraded":"2024-09-22T04:02:29.823587+0000","last_fullsized":"2024-09-22T04:02:29.823587+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"80'104","reported_seq":116,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:40.071362+0000","last_change":"2024-09-22T04:02:29.018532+0000","last_active":"2024-09-22T04:02:40.071362+0000","last_peered":"2024-09-22T04:02:40.071362+0000","last_clean":"2024-09-22T04:02:40.071362+0000","last_became_active":"2024-09-22T04:02:29.006046+0000","last_became_peered":"2024-09-22T04:02:29.006046+0000","last_unstale":"2024-09-22T04:02:40.071362+0000","last_undegraded":"2024-09-22T04:02:40.071362+0000","last_fullsized":"2024-09-22T04:02:40.071362+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6815744,"num_objects":104,"num_object_clones":0,"num_object_copies":312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":6656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":208,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:29.815415+0000","last_change":"2024-09-22T03:49:17.029128+0000","last_active":"2024-09-22T04:02:29.815415+0000","last_peered":"2024-09-22T04:02:29.815415+0000","last_clean":"2024-09-22T04:02:29.815415+0000","last_became_active":"2024-09-22T03:49:15.113396+0000","last_became_peered":"2024-09-22T03:49:15.113396+0000","last_unstale":"2024-09-22T04:02:29.815415+0000","last_undegraded":"2024-09-22T04:02:29.815415+0000","last_fullsized":"2024-09-22T04:02:29.815415+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":132710400,"num_objects":2025,"num_object_clones":0,"num_object_copies":6075,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2025,"num_write_kb":129600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24674304,"data_stored":394788864,"data_compressed":18743358,"data_compressed_allocated":24674304,"data_compressed_original":394788864,"omap_allocated":0,"internal_metadata":0},"log_size":2025,"ondisk_log_size":2025,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949673768,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":126548,"kb_used_data":5316,"kb_used_omap":0,"kb_used_meta":121216,"kb_avail":94245292,"statfs":{"total":96636764160,"available":96507179008,"internally_reserved":0,"allocated":5443584,"data_stored":76076874,"data_compressed":3602027,"data_compressed_allocated":4743168,"data_compressed_original":75808768,"omap_allocated":0,"internal_metadata":124125184},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654706472,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":132112,"kb_used_data":6720,"kb_used_omap":0,"kb_used_meta":125376,"kb_avail":94239728,"statfs":{"total":96636764160,"available":96501481472,"internally_reserved":0,"allocated":6881280,"data_stored":99472682,"data_compressed":4710654,"data_compressed_allocated":6201344,"data_compressed_original":99221504,"omap_allocated":0,"internal_metadata":128385024},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706472,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":123188,"kb_used_data":6116,"kb_used_omap":0,"kb_used_meta":117056,"kb_avail":94248652,"statfs":{"total":96636764160,"available":96510619648,"internally_reserved":0,"allocated":6262784,"data_stored":89184074,"data_compressed":4224270,"data_compressed_allocated":5562368,"data_compressed_original":88915968,"omap_allocated":0,"internal_metadata":119865344},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706472,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":141832,"kb_used_data":8120,"kb_used_omap":0,"kb_used_meta":133696,"kb_avail":94230008,"statfs":{"total":96636764160,"available":96491528192,"internally_reserved":0,"allocated":8314880,"data_stored":122083127,"data_compressed":5786207,"data_compressed_allocated":7618560,"data_compressed_original":121815040,"omap_allocated":0,"internal_metadata":136904704},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":7643136,"data_stored":122290176,"data_compressed":5805943,"data_compressed_allocated":7643136,"data_compressed_original":122290176,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4857856,"data_stored":77725696,"data_compressed":3690227,"data_compressed_allocated":4857856,"data_compressed_original":77725696,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5562368,"data_stored":88997888,"data_compressed":4225334,"data_compressed_allocated":5562368,"data_compressed_original":88997888,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":6610944,"data_stored":105775104,"data_compressed":5021854,"data_compressed_allocated":6610944,"data_compressed_original":105775104,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T04:02:46.880 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 17 16 3213 3197 11.7527 12.1875 0.131098 0.0849172 2024-09-22T04:02:47.880 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 18 16 3394 3378 11.7282 11.3125 0.0810218 0.0850865 2024-09-22T04:02:48.157 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T04:02:48.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:02:48.308+0000 7f6f64391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:02:48.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:02:48.317+0000 7f6f64391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:02:48.880 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 19 16 3577 3561 11.7128 11.4375 0.101961 0.085153 2024-09-22T04:02:49.880 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:2024-09-22T04:02:49.880313+0000 min lat: 0.0182488 max lat: 0.205854 avg lat: 0.0854507 2024-09-22T04:02:49.880 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-22T04:02:49.880 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 20 16 3751 3735 11.6709 10.875 0.0833374 0.0854507 2024-09-22T04:02:50.678 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T04:02:50.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:02:50.829+0000 7fb00909c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:02:50.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:02:50.840+0000 7fb00909c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:02:50.880 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 21 16 3939 3923 11.6746 11.75 0.118653 0.0854171 2024-09-22T04:02:51.225 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T04:02:51.225 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T04:02:51.225 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T04:02:51.225 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T04:02:51.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:02:51.378+0000 7f7545951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:02:51.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:02:51.393+0000 7f7545951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:02:51.541 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:02:51.541 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:02:51.541 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:02:51.541 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:02:51.541 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:02:51.541 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:02:51.541 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:02:51.541 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:02:51.541 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:02:51.541 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:02:51.541 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:02:51.541 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:02:51.544 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:02:51.545 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:02:51.545 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T04:02:51.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:02:51.714+0000 7f5e78751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:02:51.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:02:51.730+0000 7f5e78751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:02:51.773 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:02:51.773 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:02:51.774 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:02:51.774 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:02:51.774 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:02:51.774 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:02:51.774 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:02:51.774 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:02:51.775 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:02:51.775 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:02:51.775 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:02:51.775 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:02:51.777 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:02:51.777 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:02:51.778 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T04:02:51.880 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 22 16 4118 4102 11.6524 11.1875 0.0917953 0.0856516 2024-09-22T04:02:51.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:02:51.955+0000 7fcf80751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:02:51.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:02:51.973+0000 7fcf80751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:02:52.001 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:02:52.001 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:02:52.002 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:02:52.002 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:02:52.002 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:02:52.002 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:02:52.002 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:02:52.002 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:02:52.002 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:02:52.003 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:02:52.003 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:02:52.003 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:02:52.005 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:02:52.006 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:02:52.006 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T04:02:52.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:02:52.144+0000 7fa2b9f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:02:52.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:02:52.159+0000 7fa2b9f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:02:52.293 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:02:52.293 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:02:52.293 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:02:52.293 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:02:52.293 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:02:52.293 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:02:52.294 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:02:52.294 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:02:52.294 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:02:52.294 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:02:52.294 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:02:52.294 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:02:52.298 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:02:52.298 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:02:52.880 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 23 16 4291 4275 11.6158 10.8125 0.0604441 0.0858472 2024-09-22T04:02:53.211 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T04:02:53.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:02:53.371+0000 7f59e62bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:02:53.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:02:53.381+0000 7f59e62bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:02:53.881 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 24 16 4460 4444 11.5719 10.5625 0.0593695 0.0862709 2024-09-22T04:02:54.881 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 25 16 4656 4640 11.599 12.25 0.0915493 0.0860167 2024-09-22T04:02:55.881 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 26 16 4842 4826 11.6 11.625 0.0372956 0.0859389 2024-09-22T04:02:55.931 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T04:02:56.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:02:56.086+0000 7f2765e63640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:02:56.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:02:56.095+0000 7f2765e63640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:02:56.881 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 27 16 5015 4999 11.5708 10.8125 0.08732 0.0862103 2024-09-22T04:02:57.298 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T04:02:57.299 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T04:02:57.299 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T04:02:57.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:02:57.456+0000 7f7e53791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:02:57.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:02:57.468+0000 7f7e53791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:02:57.795 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T04:02:57.795 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-22T04:02:57.815 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":487,"stamp":"2024-09-22T04:02:57.137174+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":313393715,"num_objects":4777,"num_object_clones":0,"num_object_copies":14331,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":4854,"num_write_kb":306580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4828,"ondisk_log_size":4828,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":560920,"kb_used_data":59352,"kb_used_omap":0,"kb_used_meta":501504,"kb_avail":376926440,"statfs":{"total":386547056640,"available":385972674560,"internally_reserved":0,"allocated":60776448,"data_stored":928799477,"data_compressed":44059398,"data_compressed_allocated":57999360,"data_compressed_original":927744000,"omap_allocated":0,"internal_metadata":513540096},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":180092928,"num_objects":2748,"num_object_clones":0,"num_object_copies":8244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2748,"num_write_kb":175872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002754"},"pg_stats":[{"pgid":"7.f","version":"80'282","reported_seq":294,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:54.854673+0000","last_change":"2024-09-22T04:02:28.979477+0000","last_active":"2024-09-22T04:02:54.854673+0000","last_peered":"2024-09-22T04:02:54.854673+0000","last_clean":"2024-09-22T04:02:54.854673+0000","last_became_active":"2024-09-22T04:02:28.971367+0000","last_became_peered":"2024-09-22T04:02:28.971367+0000","last_unstale":"2024-09-22T04:02:54.854673+0000","last_undegraded":"2024-09-22T04:02:54.854673+0000","last_fullsized":"2024-09-22T04:02:54.854673+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18481152,"num_objects":282,"num_object_clones":0,"num_object_copies":846,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":282,"num_write_kb":18048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"80'288","reported_seq":300,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:54.834149+0000","last_change":"2024-09-22T04:02:28.872853+0000","last_active":"2024-09-22T04:02:54.834149+0000","last_peered":"2024-09-22T04:02:54.834149+0000","last_clean":"2024-09-22T04:02:54.834149+0000","last_became_active":"2024-09-22T04:02:28.865538+0000","last_became_peered":"2024-09-22T04:02:28.865538+0000","last_unstale":"2024-09-22T04:02:54.834149+0000","last_undegraded":"2024-09-22T04:02:54.834149+0000","last_fullsized":"2024-09-22T04:02:54.834149+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":288,"log_dups_size":0,"ondisk_log_size":288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":288,"num_object_clones":0,"num_object_copies":864,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":288,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.d","version":"80'285","reported_seq":297,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:56.197266+0000","last_change":"2024-09-22T04:02:28.967443+0000","last_active":"2024-09-22T04:02:56.197266+0000","last_peered":"2024-09-22T04:02:56.197266+0000","last_clean":"2024-09-22T04:02:56.197266+0000","last_became_active":"2024-09-22T04:02:28.959444+0000","last_became_peered":"2024-09-22T04:02:28.959444+0000","last_unstale":"2024-09-22T04:02:56.197266+0000","last_undegraded":"2024-09-22T04:02:56.197266+0000","last_fullsized":"2024-09-22T04:02:56.197266+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18677760,"num_objects":285,"num_object_clones":0,"num_object_copies":855,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":285,"num_write_kb":18240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"80'299","reported_seq":311,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:55.183176+0000","last_change":"2024-09-22T04:02:28.963918+0000","last_active":"2024-09-22T04:02:55.183176+0000","last_peered":"2024-09-22T04:02:55.183176+0000","last_clean":"2024-09-22T04:02:55.183176+0000","last_became_active":"2024-09-22T04:02:28.948540+0000","last_became_peered":"2024-09-22T04:02:28.948540+0000","last_unstale":"2024-09-22T04:02:55.183176+0000","last_undegraded":"2024-09-22T04:02:55.183176+0000","last_fullsized":"2024-09-22T04:02:55.183176+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":299,"log_dups_size":0,"ondisk_log_size":299,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19595264,"num_objects":299,"num_object_clones":0,"num_object_copies":897,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":299,"num_write_kb":19136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"80'316","reported_seq":328,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:56.281707+0000","last_change":"2024-09-22T04:02:28.971728+0000","last_active":"2024-09-22T04:02:56.281707+0000","last_peered":"2024-09-22T04:02:56.281707+0000","last_clean":"2024-09-22T04:02:56.281707+0000","last_became_active":"2024-09-22T04:02:28.960293+0000","last_became_peered":"2024-09-22T04:02:28.960293+0000","last_unstale":"2024-09-22T04:02:56.281707+0000","last_undegraded":"2024-09-22T04:02:56.281707+0000","last_fullsized":"2024-09-22T04:02:56.281707+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":316,"log_dups_size":0,"ondisk_log_size":316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20709376,"num_objects":316,"num_object_clones":0,"num_object_copies":948,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":316,"num_write_kb":20224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"80'278","reported_seq":290,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:56.138598+0000","last_change":"2024-09-22T04:02:29.026441+0000","last_active":"2024-09-22T04:02:56.138598+0000","last_peered":"2024-09-22T04:02:56.138598+0000","last_clean":"2024-09-22T04:02:56.138598+0000","last_became_active":"2024-09-22T04:02:28.991656+0000","last_became_peered":"2024-09-22T04:02:28.991656+0000","last_unstale":"2024-09-22T04:02:56.138598+0000","last_undegraded":"2024-09-22T04:02:56.138598+0000","last_fullsized":"2024-09-22T04:02:56.138598+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":278,"log_dups_size":0,"ondisk_log_size":278,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18219008,"num_objects":278,"num_object_clones":0,"num_object_copies":834,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":278,"num_write_kb":17792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.9","version":"80'315","reported_seq":327,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:55.100446+0000","last_change":"2024-09-22T04:02:28.996162+0000","last_active":"2024-09-22T04:02:55.100446+0000","last_peered":"2024-09-22T04:02:55.100446+0000","last_clean":"2024-09-22T04:02:55.100446+0000","last_became_active":"2024-09-22T04:02:28.990154+0000","last_became_peered":"2024-09-22T04:02:28.990154+0000","last_unstale":"2024-09-22T04:02:55.100446+0000","last_undegraded":"2024-09-22T04:02:55.100446+0000","last_fullsized":"2024-09-22T04:02:55.100446+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":315,"log_dups_size":0,"ondisk_log_size":315,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20643840,"num_objects":315,"num_object_clones":0,"num_object_copies":945,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":315,"num_write_kb":20160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"80'318","reported_seq":330,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:55.164436+0000","last_change":"2024-09-22T04:02:28.902123+0000","last_active":"2024-09-22T04:02:55.164436+0000","last_peered":"2024-09-22T04:02:55.164436+0000","last_clean":"2024-09-22T04:02:55.164436+0000","last_became_active":"2024-09-22T04:02:28.895508+0000","last_became_peered":"2024-09-22T04:02:28.895508+0000","last_unstale":"2024-09-22T04:02:55.164436+0000","last_undegraded":"2024-09-22T04:02:55.164436+0000","last_fullsized":"2024-09-22T04:02:55.164436+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":318,"log_dups_size":0,"ondisk_log_size":318,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20840448,"num_objects":318,"num_object_clones":0,"num_object_copies":954,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":318,"num_write_kb":20352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.6","version":"80'298","reported_seq":310,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:55.296565+0000","last_change":"2024-09-22T04:02:29.024059+0000","last_active":"2024-09-22T04:02:55.296565+0000","last_peered":"2024-09-22T04:02:55.296565+0000","last_clean":"2024-09-22T04:02:55.296565+0000","last_became_active":"2024-09-22T04:02:29.013699+0000","last_became_peered":"2024-09-22T04:02:29.013699+0000","last_unstale":"2024-09-22T04:02:55.296565+0000","last_undegraded":"2024-09-22T04:02:55.296565+0000","last_fullsized":"2024-09-22T04:02:55.296565+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":298,"log_dups_size":0,"ondisk_log_size":298,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19529728,"num_objects":298,"num_object_clones":0,"num_object_copies":894,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":298,"num_write_kb":19072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":283,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:29.819502+0000","last_change":"2024-09-22T03:49:12.034704+0000","last_active":"2024-09-22T04:02:29.819502+0000","last_peered":"2024-09-22T04:02:29.819502+0000","last_clean":"2024-09-22T04:02:29.819502+0000","last_became_active":"2024-09-22T03:49:12.027470+0000","last_became_peered":"2024-09-22T03:49:12.027470+0000","last_unstale":"2024-09-22T04:02:29.819502+0000","last_undegraded":"2024-09-22T04:02:29.819502+0000","last_fullsized":"2024-09-22T04:02:29.819502+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_clean_scrub_stamp":"2024-09-22T03:49:10.979949+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":209,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:29.818606+0000","last_change":"2024-09-22T03:49:17.031458+0000","last_active":"2024-09-22T04:02:29.818606+0000","last_peered":"2024-09-22T04:02:29.818606+0000","last_clean":"2024-09-22T04:02:29.818606+0000","last_became_active":"2024-09-22T03:49:15.125490+0000","last_became_peered":"2024-09-22T03:49:15.125490+0000","last_unstale":"2024-09-22T04:02:29.818606+0000","last_undegraded":"2024-09-22T04:02:29.818606+0000","last_fullsized":"2024-09-22T04:02:29.818606+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"80'300","reported_seq":312,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:54.927242+0000","last_change":"2024-09-22T04:02:28.912870+0000","last_active":"2024-09-22T04:02:54.927242+0000","last_peered":"2024-09-22T04:02:54.927242+0000","last_clean":"2024-09-22T04:02:54.927242+0000","last_became_active":"2024-09-22T04:02:28.905573+0000","last_became_peered":"2024-09-22T04:02:28.905573+0000","last_unstale":"2024-09-22T04:02:54.927242+0000","last_undegraded":"2024-09-22T04:02:54.927242+0000","last_fullsized":"2024-09-22T04:02:54.927242+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":300,"log_dups_size":0,"ondisk_log_size":300,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19660800,"num_objects":300,"num_object_clones":0,"num_object_copies":900,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":300,"num_write_kb":19200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":208,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:29.815930+0000","last_change":"2024-09-22T03:49:17.029339+0000","last_active":"2024-09-22T04:02:29.815930+0000","last_peered":"2024-09-22T04:02:29.815930+0000","last_clean":"2024-09-22T04:02:29.815930+0000","last_became_active":"2024-09-22T03:49:15.097304+0000","last_became_peered":"2024-09-22T03:49:15.097304+0000","last_unstale":"2024-09-22T04:02:29.815930+0000","last_undegraded":"2024-09-22T04:02:29.815930+0000","last_fullsized":"2024-09-22T04:02:29.815930+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"80'300","reported_seq":312,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:54.945372+0000","last_change":"2024-09-22T04:02:28.928198+0000","last_active":"2024-09-22T04:02:54.945372+0000","last_peered":"2024-09-22T04:02:54.945372+0000","last_clean":"2024-09-22T04:02:54.945372+0000","last_became_active":"2024-09-22T04:02:28.909503+0000","last_became_peered":"2024-09-22T04:02:28.909503+0000","last_unstale":"2024-09-22T04:02:54.945372+0000","last_undegraded":"2024-09-22T04:02:54.945372+0000","last_fullsized":"2024-09-22T04:02:54.945372+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":300,"log_dups_size":0,"ondisk_log_size":300,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19660800,"num_objects":300,"num_object_clones":0,"num_object_copies":900,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":300,"num_write_kb":19200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":208,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:29.822286+0000","last_change":"2024-09-22T03:49:17.029349+0000","last_active":"2024-09-22T04:02:29.822286+0000","last_peered":"2024-09-22T04:02:29.822286+0000","last_clean":"2024-09-22T04:02:29.822286+0000","last_became_active":"2024-09-22T03:49:15.094890+0000","last_became_peered":"2024-09-22T03:49:15.094890+0000","last_unstale":"2024-09-22T04:02:29.822286+0000","last_undegraded":"2024-09-22T04:02:29.822286+0000","last_fullsized":"2024-09-22T04:02:29.822286+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.7","version":"80'311","reported_seq":323,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:54.956585+0000","last_change":"2024-09-22T04:02:28.945388+0000","last_active":"2024-09-22T04:02:54.956585+0000","last_peered":"2024-09-22T04:02:54.956585+0000","last_clean":"2024-09-22T04:02:54.956585+0000","last_became_active":"2024-09-22T04:02:28.939479+0000","last_became_peered":"2024-09-22T04:02:28.939479+0000","last_unstale":"2024-09-22T04:02:54.956585+0000","last_undegraded":"2024-09-22T04:02:54.956585+0000","last_fullsized":"2024-09-22T04:02:54.956585+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":311,"log_dups_size":0,"ondisk_log_size":311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20381696,"num_objects":311,"num_object_clones":0,"num_object_copies":933,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":311,"num_write_kb":19904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":210,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:29.820716+0000","last_change":"2024-09-22T03:49:17.031466+0000","last_active":"2024-09-22T04:02:29.820716+0000","last_peered":"2024-09-22T04:02:29.820716+0000","last_clean":"2024-09-22T04:02:29.820716+0000","last_became_active":"2024-09-22T03:49:15.098420+0000","last_became_peered":"2024-09-22T03:49:15.098420+0000","last_unstale":"2024-09-22T04:02:29.820716+0000","last_undegraded":"2024-09-22T04:02:29.820716+0000","last_fullsized":"2024-09-22T04:02:29.820716+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1","version":"80'299","reported_seq":311,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:55.079273+0000","last_change":"2024-09-22T04:02:28.927518+0000","last_active":"2024-09-22T04:02:55.079273+0000","last_peered":"2024-09-22T04:02:55.079273+0000","last_clean":"2024-09-22T04:02:55.079273+0000","last_became_active":"2024-09-22T04:02:28.919323+0000","last_became_peered":"2024-09-22T04:02:28.919323+0000","last_unstale":"2024-09-22T04:02:55.079273+0000","last_undegraded":"2024-09-22T04:02:55.079273+0000","last_fullsized":"2024-09-22T04:02:55.079273+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":299,"log_dups_size":0,"ondisk_log_size":299,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19595264,"num_objects":299,"num_object_clones":0,"num_object_copies":897,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":299,"num_write_kb":19136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":208,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:29.823311+0000","last_change":"2024-09-22T03:49:17.036954+0000","last_active":"2024-09-22T04:02:29.823311+0000","last_peered":"2024-09-22T04:02:29.823311+0000","last_clean":"2024-09-22T04:02:29.823311+0000","last_became_active":"2024-09-22T03:49:15.110506+0000","last_became_peered":"2024-09-22T03:49:15.110506+0000","last_unstale":"2024-09-22T04:02:29.823311+0000","last_undegraded":"2024-09-22T04:02:29.823311+0000","last_fullsized":"2024-09-22T04:02:29.823311+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"80'328","reported_seq":340,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:56.095082+0000","last_change":"2024-09-22T04:02:28.954190+0000","last_active":"2024-09-22T04:02:56.095082+0000","last_peered":"2024-09-22T04:02:56.095082+0000","last_clean":"2024-09-22T04:02:56.095082+0000","last_became_active":"2024-09-22T04:02:28.946807+0000","last_became_peered":"2024-09-22T04:02:28.946807+0000","last_unstale":"2024-09-22T04:02:56.095082+0000","last_undegraded":"2024-09-22T04:02:56.095082+0000","last_fullsized":"2024-09-22T04:02:56.095082+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21495808,"num_objects":328,"num_object_clones":0,"num_object_copies":984,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":328,"num_write_kb":20992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":208,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:29.820857+0000","last_change":"2024-09-22T03:49:17.032989+0000","last_active":"2024-09-22T04:02:29.820857+0000","last_peered":"2024-09-22T04:02:29.820857+0000","last_clean":"2024-09-22T04:02:29.820857+0000","last_became_active":"2024-09-22T03:49:15.079260+0000","last_became_peered":"2024-09-22T03:49:15.079260+0000","last_unstale":"2024-09-22T04:02:29.820857+0000","last_undegraded":"2024-09-22T04:02:29.820857+0000","last_fullsized":"2024-09-22T04:02:29.820857+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3","version":"80'264","reported_seq":276,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:55.142965+0000","last_change":"2024-09-22T04:02:28.924084+0000","last_active":"2024-09-22T04:02:55.142965+0000","last_peered":"2024-09-22T04:02:55.142965+0000","last_clean":"2024-09-22T04:02:55.142965+0000","last_became_active":"2024-09-22T04:02:28.898697+0000","last_became_peered":"2024-09-22T04:02:28.898697+0000","last_unstale":"2024-09-22T04:02:55.142965+0000","last_undegraded":"2024-09-22T04:02:55.142965+0000","last_fullsized":"2024-09-22T04:02:55.142965+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":264,"log_dups_size":0,"ondisk_log_size":264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17301504,"num_objects":264,"num_object_clones":0,"num_object_copies":792,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":264,"num_write_kb":16896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":208,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:29.823587+0000","last_change":"2024-09-22T03:49:17.036402+0000","last_active":"2024-09-22T04:02:29.823587+0000","last_peered":"2024-09-22T04:02:29.823587+0000","last_clean":"2024-09-22T04:02:29.823587+0000","last_became_active":"2024-09-22T03:49:15.108430+0000","last_became_peered":"2024-09-22T03:49:15.108430+0000","last_unstale":"2024-09-22T04:02:29.823587+0000","last_undegraded":"2024-09-22T04:02:29.823587+0000","last_fullsized":"2024-09-22T04:02:29.823587+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"80'292","reported_seq":304,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:55.224605+0000","last_change":"2024-09-22T04:02:29.018532+0000","last_active":"2024-09-22T04:02:55.224605+0000","last_peered":"2024-09-22T04:02:55.224605+0000","last_clean":"2024-09-22T04:02:55.224605+0000","last_became_active":"2024-09-22T04:02:29.006046+0000","last_became_peered":"2024-09-22T04:02:29.006046+0000","last_unstale":"2024-09-22T04:02:55.224605+0000","last_undegraded":"2024-09-22T04:02:55.224605+0000","last_fullsized":"2024-09-22T04:02:55.224605+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":292,"log_dups_size":0,"ondisk_log_size":292,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19136512,"num_objects":292,"num_object_clones":0,"num_object_copies":876,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":292,"num_write_kb":18688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":208,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:29.815415+0000","last_change":"2024-09-22T03:49:17.029128+0000","last_active":"2024-09-22T04:02:29.815415+0000","last_peered":"2024-09-22T04:02:29.815415+0000","last_clean":"2024-09-22T04:02:29.815415+0000","last_became_active":"2024-09-22T03:49:15.113396+0000","last_became_peered":"2024-09-22T03:49:15.113396+0000","last_unstale":"2024-09-22T04:02:29.815415+0000","last_undegraded":"2024-09-22T04:02:29.815415+0000","last_fullsized":"2024-09-22T04:02:29.815415+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":312803328,"num_objects":4773,"num_object_clones":0,"num_object_copies":14319,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4773,"num_write_kb":305472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":58437632,"data_stored":935002112,"data_compressed":44395574,"data_compressed_allocated":58437632,"data_compressed_original":935002112,"omap_allocated":0,"internal_metadata":0},"log_size":4773,"ondisk_log_size":4773,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949673783,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":140996,"kb_used_data":11444,"kb_used_omap":0,"kb_used_meta":129536,"kb_avail":94230844,"statfs":{"total":96636764160,"available":96492384256,"internally_reserved":0,"allocated":11718656,"data_stored":176478026,"data_compressed":8369611,"data_compressed_allocated":11018240,"data_compressed_original":176209920,"omap_allocated":0,"internal_metadata":132644864},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654706487,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":136864,"kb_used_data":15632,"kb_used_omap":0,"kb_used_meta":121216,"kb_avail":94234976,"statfs":{"total":96636764160,"available":96496615424,"internally_reserved":0,"allocated":16007168,"data_stored":245486890,"data_compressed":11644190,"data_compressed_allocated":15327232,"data_compressed_original":245235712,"omap_allocated":0,"internal_metadata":124125184},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706487,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":139236,"kb_used_data":13844,"kb_used_omap":0,"kb_used_meta":125376,"kb_avail":94232604,"statfs":{"total":96636764160,"available":96494186496,"internally_reserved":0,"allocated":14176256,"data_stored":215799626,"data_compressed":10236654,"data_compressed_allocated":13475840,"data_compressed_original":215531520,"omap_allocated":0,"internal_metadata":128385024},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706487,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":143824,"kb_used_data":18432,"kb_used_omap":0,"kb_used_meta":125376,"kb_avail":94228016,"statfs":{"total":96636764160,"available":96489488384,"internally_reserved":0,"allocated":18874368,"data_stored":291034935,"data_compressed":13808943,"data_compressed_allocated":18178048,"data_compressed_original":290766848,"omap_allocated":0,"internal_metadata":128385024},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":18182144,"data_stored":290914304,"data_compressed":13813119,"data_compressed_allocated":18182144,"data_compressed_original":290914304,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":11100160,"data_stored":177602560,"data_compressed":8432915,"data_compressed_allocated":11100160,"data_compressed_original":177602560,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":13443072,"data_stored":215089152,"data_compressed":10212822,"data_compressed_allocated":13443072,"data_compressed_original":215089152,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":15712256,"data_stored":251396096,"data_compressed":11936718,"data_compressed_allocated":15712256,"data_compressed_original":251396096,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T04:02:57.881 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 28 16 5198 5182 11.566 11.4375 0.121087 0.0863243 2024-09-22T04:02:58.467 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T04:02:58.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:02:58.623+0000 7fa3e8274640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:02:58.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:02:58.632+0000 7fa3e8274640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:02:58.881 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 29 15 5372 5357 11.5443 10.9375 0.0362048 0.0864183 2024-09-22T04:02:59.881 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 30 16 5548 5532 11.524 10.9375 0.11232 0.0866076 2024-09-22T04:03:00.881 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 31 16 5746 5730 11.5514 12.375 0.0698352 0.0864561 2024-09-22T04:03:01.027 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T04:03:01.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:03:01.270+0000 7f0f3a6ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:03:01.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:03:01.279+0000 7f0f3a6ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:03:01.881 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 32 16 5906 5890 11.5029 10 0.129472 0.0867373 2024-09-22T04:03:02.817 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T04:03:02.817 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T04:03:02.817 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T04:03:02.881 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 33 15 6091 6076 11.5066 11.625 0.0836649 0.0867724 2024-09-22T04:03:02.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:03:02.978+0000 7f0313991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:03:02.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:03:02.992+0000 7f0313991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:03:03.304 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T04:03:03.304 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-22T04:03:03.317 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":490,"stamp":"2024-09-22T04:03:03.138511+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":372048435,"num_objects":5672,"num_object_clones":0,"num_object_copies":17016,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":5749,"num_write_kb":363860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5723,"ondisk_log_size":5723,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":575780,"kb_used_data":70048,"kb_used_omap":0,"kb_used_meta":505664,"kb_avail":376911580,"statfs":{"total":386547056640,"available":385957457920,"internally_reserved":0,"allocated":71729152,"data_stored":1104042741,"data_compressed":52380886,"data_compressed_allocated":68952064,"data_compressed_original":1102987264,"omap_allocated":0,"internal_metadata":517799936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":131596288,"num_objects":2008,"num_object_clones":0,"num_object_copies":6024,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2008,"num_write_kb":128512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002645"},"pg_stats":[{"pgid":"7.f","version":"80'351","reported_seq":363,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:03:00.248477+0000","last_change":"2024-09-22T04:02:28.979477+0000","last_active":"2024-09-22T04:03:00.248477+0000","last_peered":"2024-09-22T04:03:00.248477+0000","last_clean":"2024-09-22T04:03:00.248477+0000","last_became_active":"2024-09-22T04:02:28.971367+0000","last_became_peered":"2024-09-22T04:02:28.971367+0000","last_unstale":"2024-09-22T04:03:00.248477+0000","last_undegraded":"2024-09-22T04:03:00.248477+0000","last_fullsized":"2024-09-22T04:03:00.248477+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23003136,"num_objects":351,"num_object_clones":0,"num_object_copies":1053,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":351,"num_write_kb":22464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"80'350","reported_seq":362,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:03:00.149232+0000","last_change":"2024-09-22T04:02:28.872853+0000","last_active":"2024-09-22T04:03:00.149232+0000","last_peered":"2024-09-22T04:03:00.149232+0000","last_clean":"2024-09-22T04:03:00.149232+0000","last_became_active":"2024-09-22T04:02:28.865538+0000","last_became_peered":"2024-09-22T04:02:28.865538+0000","last_unstale":"2024-09-22T04:03:00.149232+0000","last_undegraded":"2024-09-22T04:03:00.149232+0000","last_fullsized":"2024-09-22T04:03:00.149232+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":350,"log_dups_size":0,"ondisk_log_size":350,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22937600,"num_objects":350,"num_object_clones":0,"num_object_copies":1050,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":350,"num_write_kb":22400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.d","version":"80'347","reported_seq":359,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:03:00.887256+0000","last_change":"2024-09-22T04:02:28.967443+0000","last_active":"2024-09-22T04:03:00.887256+0000","last_peered":"2024-09-22T04:03:00.887256+0000","last_clean":"2024-09-22T04:03:00.887256+0000","last_became_active":"2024-09-22T04:02:28.959444+0000","last_became_peered":"2024-09-22T04:02:28.959444+0000","last_unstale":"2024-09-22T04:03:00.887256+0000","last_undegraded":"2024-09-22T04:03:00.887256+0000","last_fullsized":"2024-09-22T04:03:00.887256+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":347,"log_dups_size":0,"ondisk_log_size":347,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22740992,"num_objects":347,"num_object_clones":0,"num_object_copies":1041,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":347,"num_write_kb":22208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"80'362","reported_seq":374,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:03:00.208984+0000","last_change":"2024-09-22T04:02:28.963918+0000","last_active":"2024-09-22T04:03:00.208984+0000","last_peered":"2024-09-22T04:03:00.208984+0000","last_clean":"2024-09-22T04:03:00.208984+0000","last_became_active":"2024-09-22T04:02:28.948540+0000","last_became_peered":"2024-09-22T04:02:28.948540+0000","last_unstale":"2024-09-22T04:03:00.208984+0000","last_undegraded":"2024-09-22T04:03:00.208984+0000","last_fullsized":"2024-09-22T04:03:00.208984+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23724032,"num_objects":362,"num_object_clones":0,"num_object_copies":1086,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":362,"num_write_kb":23168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"80'376","reported_seq":388,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:03:01.200158+0000","last_change":"2024-09-22T04:02:28.971728+0000","last_active":"2024-09-22T04:03:01.200158+0000","last_peered":"2024-09-22T04:03:01.200158+0000","last_clean":"2024-09-22T04:03:01.200158+0000","last_became_active":"2024-09-22T04:02:28.960293+0000","last_became_peered":"2024-09-22T04:02:28.960293+0000","last_unstale":"2024-09-22T04:03:01.200158+0000","last_undegraded":"2024-09-22T04:03:01.200158+0000","last_fullsized":"2024-09-22T04:03:01.200158+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24641536,"num_objects":376,"num_object_clones":0,"num_object_copies":1128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":376,"num_write_kb":24064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"80'331","reported_seq":343,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:03:01.149909+0000","last_change":"2024-09-22T04:02:29.026441+0000","last_active":"2024-09-22T04:03:01.149909+0000","last_peered":"2024-09-22T04:03:01.149909+0000","last_clean":"2024-09-22T04:03:01.149909+0000","last_became_active":"2024-09-22T04:02:28.991656+0000","last_became_peered":"2024-09-22T04:02:28.991656+0000","last_unstale":"2024-09-22T04:03:01.149909+0000","last_undegraded":"2024-09-22T04:03:01.149909+0000","last_fullsized":"2024-09-22T04:03:01.149909+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":331,"log_dups_size":0,"ondisk_log_size":331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21692416,"num_objects":331,"num_object_clones":0,"num_object_copies":993,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":331,"num_write_kb":21184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.9","version":"80'371","reported_seq":383,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:03:00.126764+0000","last_change":"2024-09-22T04:02:28.996162+0000","last_active":"2024-09-22T04:03:00.126764+0000","last_peered":"2024-09-22T04:03:00.126764+0000","last_clean":"2024-09-22T04:03:00.126764+0000","last_became_active":"2024-09-22T04:02:28.990154+0000","last_became_peered":"2024-09-22T04:02:28.990154+0000","last_unstale":"2024-09-22T04:03:00.126764+0000","last_undegraded":"2024-09-22T04:03:00.126764+0000","last_fullsized":"2024-09-22T04:03:00.126764+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24313856,"num_objects":371,"num_object_clones":0,"num_object_copies":1113,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":371,"num_write_kb":23744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"80'382","reported_seq":394,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:59.910903+0000","last_change":"2024-09-22T04:02:28.902123+0000","last_active":"2024-09-22T04:02:59.910903+0000","last_peered":"2024-09-22T04:02:59.910903+0000","last_clean":"2024-09-22T04:02:59.910903+0000","last_became_active":"2024-09-22T04:02:28.895508+0000","last_became_peered":"2024-09-22T04:02:28.895508+0000","last_unstale":"2024-09-22T04:02:59.910903+0000","last_undegraded":"2024-09-22T04:02:59.910903+0000","last_fullsized":"2024-09-22T04:02:59.910903+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25034752,"num_objects":382,"num_object_clones":0,"num_object_copies":1146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":382,"num_write_kb":24448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.6","version":"80'346","reported_seq":358,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:03:00.152355+0000","last_change":"2024-09-22T04:02:29.024059+0000","last_active":"2024-09-22T04:03:00.152355+0000","last_peered":"2024-09-22T04:03:00.152355+0000","last_clean":"2024-09-22T04:03:00.152355+0000","last_became_active":"2024-09-22T04:02:29.013699+0000","last_became_peered":"2024-09-22T04:02:29.013699+0000","last_unstale":"2024-09-22T04:03:00.152355+0000","last_undegraded":"2024-09-22T04:03:00.152355+0000","last_fullsized":"2024-09-22T04:03:00.152355+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":346,"log_dups_size":0,"ondisk_log_size":346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22675456,"num_objects":346,"num_object_clones":0,"num_object_copies":1038,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":346,"num_write_kb":22144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":283,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:29.819502+0000","last_change":"2024-09-22T03:49:12.034704+0000","last_active":"2024-09-22T04:02:29.819502+0000","last_peered":"2024-09-22T04:02:29.819502+0000","last_clean":"2024-09-22T04:02:29.819502+0000","last_became_active":"2024-09-22T03:49:12.027470+0000","last_became_peered":"2024-09-22T03:49:12.027470+0000","last_unstale":"2024-09-22T04:02:29.819502+0000","last_undegraded":"2024-09-22T04:02:29.819502+0000","last_fullsized":"2024-09-22T04:02:29.819502+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_clean_scrub_stamp":"2024-09-22T03:49:10.979949+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":209,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:29.818606+0000","last_change":"2024-09-22T03:49:17.031458+0000","last_active":"2024-09-22T04:02:29.818606+0000","last_peered":"2024-09-22T04:02:29.818606+0000","last_clean":"2024-09-22T04:02:29.818606+0000","last_became_active":"2024-09-22T03:49:15.125490+0000","last_became_peered":"2024-09-22T03:49:15.125490+0000","last_unstale":"2024-09-22T04:02:29.818606+0000","last_undegraded":"2024-09-22T04:02:29.818606+0000","last_fullsized":"2024-09-22T04:02:29.818606+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"80'356","reported_seq":368,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:03:00.136765+0000","last_change":"2024-09-22T04:02:28.912870+0000","last_active":"2024-09-22T04:03:00.136765+0000","last_peered":"2024-09-22T04:03:00.136765+0000","last_clean":"2024-09-22T04:03:00.136765+0000","last_became_active":"2024-09-22T04:02:28.905573+0000","last_became_peered":"2024-09-22T04:02:28.905573+0000","last_unstale":"2024-09-22T04:03:00.136765+0000","last_undegraded":"2024-09-22T04:03:00.136765+0000","last_fullsized":"2024-09-22T04:03:00.136765+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":356,"log_dups_size":0,"ondisk_log_size":356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23330816,"num_objects":356,"num_object_clones":0,"num_object_copies":1068,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":356,"num_write_kb":22784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":208,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:29.815930+0000","last_change":"2024-09-22T03:49:17.029339+0000","last_active":"2024-09-22T04:02:29.815930+0000","last_peered":"2024-09-22T04:02:29.815930+0000","last_clean":"2024-09-22T04:02:29.815930+0000","last_became_active":"2024-09-22T03:49:15.097304+0000","last_became_peered":"2024-09-22T03:49:15.097304+0000","last_unstale":"2024-09-22T04:02:29.815930+0000","last_undegraded":"2024-09-22T04:02:29.815930+0000","last_fullsized":"2024-09-22T04:02:29.815930+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"80'347","reported_seq":359,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:59.867721+0000","last_change":"2024-09-22T04:02:28.928198+0000","last_active":"2024-09-22T04:02:59.867721+0000","last_peered":"2024-09-22T04:02:59.867721+0000","last_clean":"2024-09-22T04:02:59.867721+0000","last_became_active":"2024-09-22T04:02:28.909503+0000","last_became_peered":"2024-09-22T04:02:28.909503+0000","last_unstale":"2024-09-22T04:02:59.867721+0000","last_undegraded":"2024-09-22T04:02:59.867721+0000","last_fullsized":"2024-09-22T04:02:59.867721+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":347,"log_dups_size":0,"ondisk_log_size":347,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22740992,"num_objects":347,"num_object_clones":0,"num_object_copies":1041,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":347,"num_write_kb":22208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":208,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:29.822286+0000","last_change":"2024-09-22T03:49:17.029349+0000","last_active":"2024-09-22T04:02:29.822286+0000","last_peered":"2024-09-22T04:02:29.822286+0000","last_clean":"2024-09-22T04:02:29.822286+0000","last_became_active":"2024-09-22T03:49:15.094890+0000","last_became_peered":"2024-09-22T03:49:15.094890+0000","last_unstale":"2024-09-22T04:02:29.822286+0000","last_undegraded":"2024-09-22T04:02:29.822286+0000","last_fullsized":"2024-09-22T04:02:29.822286+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.7","version":"80'352","reported_seq":364,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:03:00.035506+0000","last_change":"2024-09-22T04:02:28.945388+0000","last_active":"2024-09-22T04:03:00.035506+0000","last_peered":"2024-09-22T04:03:00.035506+0000","last_clean":"2024-09-22T04:03:00.035506+0000","last_became_active":"2024-09-22T04:02:28.939479+0000","last_became_peered":"2024-09-22T04:02:28.939479+0000","last_unstale":"2024-09-22T04:03:00.035506+0000","last_undegraded":"2024-09-22T04:03:00.035506+0000","last_fullsized":"2024-09-22T04:03:00.035506+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":352,"num_object_clones":0,"num_object_copies":1056,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":352,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":210,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:29.820716+0000","last_change":"2024-09-22T03:49:17.031466+0000","last_active":"2024-09-22T04:02:29.820716+0000","last_peered":"2024-09-22T04:02:29.820716+0000","last_clean":"2024-09-22T04:02:29.820716+0000","last_became_active":"2024-09-22T03:49:15.098420+0000","last_became_peered":"2024-09-22T03:49:15.098420+0000","last_unstale":"2024-09-22T04:02:29.820716+0000","last_undegraded":"2024-09-22T04:02:29.820716+0000","last_fullsized":"2024-09-22T04:02:29.820716+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1","version":"80'353","reported_seq":365,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:03:00.122816+0000","last_change":"2024-09-22T04:02:28.927518+0000","last_active":"2024-09-22T04:03:00.122816+0000","last_peered":"2024-09-22T04:03:00.122816+0000","last_clean":"2024-09-22T04:03:00.122816+0000","last_became_active":"2024-09-22T04:02:28.919323+0000","last_became_peered":"2024-09-22T04:02:28.919323+0000","last_unstale":"2024-09-22T04:03:00.122816+0000","last_undegraded":"2024-09-22T04:03:00.122816+0000","last_fullsized":"2024-09-22T04:03:00.122816+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":353,"log_dups_size":0,"ondisk_log_size":353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23134208,"num_objects":353,"num_object_clones":0,"num_object_copies":1059,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":353,"num_write_kb":22592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":208,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:29.823311+0000","last_change":"2024-09-22T03:49:17.036954+0000","last_active":"2024-09-22T04:02:29.823311+0000","last_peered":"2024-09-22T04:02:29.823311+0000","last_clean":"2024-09-22T04:02:29.823311+0000","last_became_active":"2024-09-22T03:49:15.110506+0000","last_became_peered":"2024-09-22T03:49:15.110506+0000","last_unstale":"2024-09-22T04:02:29.823311+0000","last_undegraded":"2024-09-22T04:02:29.823311+0000","last_fullsized":"2024-09-22T04:02:29.823311+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"80'396","reported_seq":408,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:03:01.045789+0000","last_change":"2024-09-22T04:02:28.954190+0000","last_active":"2024-09-22T04:03:01.045789+0000","last_peered":"2024-09-22T04:03:01.045789+0000","last_clean":"2024-09-22T04:03:01.045789+0000","last_became_active":"2024-09-22T04:02:28.946807+0000","last_became_peered":"2024-09-22T04:02:28.946807+0000","last_unstale":"2024-09-22T04:03:01.045789+0000","last_undegraded":"2024-09-22T04:03:01.045789+0000","last_fullsized":"2024-09-22T04:03:01.045789+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25952256,"num_objects":396,"num_object_clones":0,"num_object_copies":1188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":396,"num_write_kb":25344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":208,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:29.820857+0000","last_change":"2024-09-22T03:49:17.032989+0000","last_active":"2024-09-22T04:02:29.820857+0000","last_peered":"2024-09-22T04:02:29.820857+0000","last_clean":"2024-09-22T04:02:29.820857+0000","last_became_active":"2024-09-22T03:49:15.079260+0000","last_became_peered":"2024-09-22T03:49:15.079260+0000","last_unstale":"2024-09-22T04:02:29.820857+0000","last_undegraded":"2024-09-22T04:02:29.820857+0000","last_fullsized":"2024-09-22T04:02:29.820857+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3","version":"80'313","reported_seq":325,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:03:00.195044+0000","last_change":"2024-09-22T04:02:28.924084+0000","last_active":"2024-09-22T04:03:00.195044+0000","last_peered":"2024-09-22T04:03:00.195044+0000","last_clean":"2024-09-22T04:03:00.195044+0000","last_became_active":"2024-09-22T04:02:28.898697+0000","last_became_peered":"2024-09-22T04:02:28.898697+0000","last_unstale":"2024-09-22T04:03:00.195044+0000","last_undegraded":"2024-09-22T04:03:00.195044+0000","last_fullsized":"2024-09-22T04:03:00.195044+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":313,"log_dups_size":0,"ondisk_log_size":313,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20512768,"num_objects":313,"num_object_clones":0,"num_object_copies":939,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":313,"num_write_kb":20032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":208,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:29.823587+0000","last_change":"2024-09-22T03:49:17.036402+0000","last_active":"2024-09-22T04:02:29.823587+0000","last_peered":"2024-09-22T04:02:29.823587+0000","last_clean":"2024-09-22T04:02:29.823587+0000","last_became_active":"2024-09-22T03:49:15.108430+0000","last_became_peered":"2024-09-22T03:49:15.108430+0000","last_unstale":"2024-09-22T04:02:29.823587+0000","last_undegraded":"2024-09-22T04:02:29.823587+0000","last_fullsized":"2024-09-22T04:02:29.823587+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"80'335","reported_seq":347,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:03:00.212517+0000","last_change":"2024-09-22T04:02:29.018532+0000","last_active":"2024-09-22T04:03:00.212517+0000","last_peered":"2024-09-22T04:03:00.212517+0000","last_clean":"2024-09-22T04:03:00.212517+0000","last_became_active":"2024-09-22T04:02:29.006046+0000","last_became_peered":"2024-09-22T04:02:29.006046+0000","last_unstale":"2024-09-22T04:03:00.212517+0000","last_undegraded":"2024-09-22T04:03:00.212517+0000","last_fullsized":"2024-09-22T04:03:00.212517+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":335,"log_dups_size":0,"ondisk_log_size":335,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21954560,"num_objects":335,"num_object_clones":0,"num_object_copies":1005,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":335,"num_write_kb":21440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":208,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:29.815415+0000","last_change":"2024-09-22T03:49:17.029128+0000","last_active":"2024-09-22T04:02:29.815415+0000","last_peered":"2024-09-22T04:02:29.815415+0000","last_clean":"2024-09-22T04:02:29.815415+0000","last_became_active":"2024-09-22T03:49:15.113396+0000","last_became_peered":"2024-09-22T03:49:15.113396+0000","last_unstale":"2024-09-22T04:02:29.815415+0000","last_undegraded":"2024-09-22T04:02:29.815415+0000","last_fullsized":"2024-09-22T04:02:29.815415+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":371458048,"num_objects":5668,"num_object_clones":0,"num_object_copies":17004,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5668,"num_write_kb":362752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":69398528,"data_stored":1110376448,"data_compressed":52723286,"data_compressed_allocated":69398528,"data_compressed_original":1110376448,"omap_allocated":0,"internal_metadata":0},"log_size":5668,"ondisk_log_size":5668,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949673788,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":143052,"kb_used_data":13500,"kb_used_omap":0,"kb_used_meta":129536,"kb_avail":94228788,"statfs":{"total":96636764160,"available":96490278912,"internally_reserved":0,"allocated":13824000,"data_stored":210163530,"data_compressed":9969179,"data_compressed_allocated":13123584,"data_compressed_original":209895424,"omap_allocated":0,"internal_metadata":132644864},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654706492,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":139828,"kb_used_data":18592,"kb_used_omap":0,"kb_used_meta":121216,"kb_avail":94232012,"statfs":{"total":96636764160,"available":96493580288,"internally_reserved":0,"allocated":19038208,"data_stored":293983530,"data_compressed":13947070,"data_compressed_allocated":18358272,"data_compressed_original":293732352,"omap_allocated":0,"internal_metadata":124125184},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706492,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":141544,"kb_used_data":16152,"kb_used_omap":0,"kb_used_meta":125376,"kb_avail":94230296,"statfs":{"total":96636764160,"available":96491823104,"internally_reserved":0,"allocated":16539648,"data_stored":253613898,"data_compressed":12032278,"data_compressed_allocated":15839232,"data_compressed_original":253345792,"omap_allocated":0,"internal_metadata":128385024},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706492,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":151356,"kb_used_data":21804,"kb_used_omap":0,"kb_used_meta":129536,"kb_avail":94220484,"statfs":{"total":96636764160,"available":96481775616,"internally_reserved":0,"allocated":22327296,"data_stored":346281783,"data_compressed":16432359,"data_compressed_allocated":21630976,"data_compressed_original":346013696,"omap_allocated":0,"internal_metadata":132644864},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":21614592,"data_stored":345833472,"data_compressed":16420975,"data_compressed_allocated":21614592,"data_compressed_original":345833472,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":13185024,"data_stored":210960384,"data_compressed":10016923,"data_compressed_allocated":13185024,"data_compressed_original":210960384,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":15822848,"data_stored":253165568,"data_compressed":12020894,"data_compressed_allocated":15822848,"data_compressed_original":253165568,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":18776064,"data_stored":300417024,"data_compressed":14264494,"data_compressed_allocated":18776064,"data_compressed_original":300417024,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T04:03:03.623 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T04:03:03.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:03:03.782+0000 7f85d723e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:03:03.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:03:03.794+0000 7f85d723e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:03:03.881 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 34 16 6247 6231 11.453 9.6875 0.14071 0.0871077 2024-09-22T04:03:04.881 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 35 16 6428 6412 11.449 11.3125 0.131831 0.0872067 2024-09-22T04:03:05.882 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 36 16 6614 6598 11.4539 11.625 0.0996622 0.0872151 2024-09-22T04:03:06.243 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T04:03:06.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:03:06.400+0000 7fc643cd1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:03:06.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:03:06.411+0000 7fc643cd1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:03:06.882 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 37 16 6803 6787 11.4635 11.8125 0.0462427 0.0871535 2024-09-22T04:03:07.882 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 38 16 6977 6961 11.448 10.875 0.101499 0.087186 2024-09-22T04:03:08.319 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T04:03:08.319 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T04:03:08.319 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T04:03:08.319 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T04:03:08.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:03:08.486+0000 7f55faec8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:03:08.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:03:08.499+0000 7f55faec8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:03:08.682 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:03:08.682 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:03:08.682 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:03:08.682 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:03:08.682 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:03:08.682 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:03:08.683 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:03:08.683 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:03:08.683 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:03:08.683 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:03:08.683 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:03:08.683 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:03:08.686 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:03:08.686 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:03:08.686 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T04:03:08.740 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T04:03:08.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:03:08.854+0000 7fcdea911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:03:08.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:03:08.872+0000 7fcdea911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:03:08.882 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 39 16 7158 7142 11.4445 11.3125 0.0987532 0.0872201 2024-09-22T04:03:08.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:03:08.906+0000 7f9ac4f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:03:08.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:03:08.916+0000 7f9ac4f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:03:08.959 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:03:08.959 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:03:08.960 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:03:08.960 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:03:08.960 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:03:08.960 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:03:08.960 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:03:08.960 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:03:08.960 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:03:08.960 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:03:08.960 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:03:08.960 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:03:08.965 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:03:08.965 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:03:08.965 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T04:03:09.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:03:09.124+0000 7f3715c74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:03:09.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:03:09.137+0000 7f3715c74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:03:09.165 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:03:09.165 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:03:09.165 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:03:09.165 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:03:09.165 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:03:09.165 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:03:09.165 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:03:09.165 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:03:09.165 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:03:09.165 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:03:09.165 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:03:09.166 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:03:09.171 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:03:09.171 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:03:09.171 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T04:03:09.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:03:09.326+0000 7f00fbf11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:03:09.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:03:09.343+0000 7f00fbf11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:03:09.398 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:03:09.398 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:03:09.398 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:03:09.398 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:03:09.398 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:03:09.398 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:03:09.398 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:03:09.398 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:03:09.398 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:03:09.398 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:03:09.398 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:03:09.398 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:03:09.402 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:03:09.402 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:03:09.882 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:2024-09-22T04:03:09.882109+0000 min lat: 0.0179924 max lat: 0.218626 avg lat: 0.0875605 2024-09-22T04:03:09.882 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-22T04:03:09.882 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 40 16 7317 7301 11.4068 9.9375 0.118142 0.0875605 2024-09-22T04:03:10.882 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 41 16 7486 7470 11.3862 10.5625 0.10791 0.0876728 2024-09-22T04:03:11.341 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T04:03:11.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:03:11.510+0000 7f59ec591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:03:11.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:03:11.524+0000 7f59ec591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:03:11.882 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 42 16 7669 7653 11.3874 11.4375 0.139367 0.0876941 2024-09-22T04:03:12.882 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 43 16 7841 7825 11.3725 10.75 0.0251304 0.0877975 2024-09-22T04:03:13.882 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 44 16 8027 8011 11.3783 11.625 0.0623378 0.087786 2024-09-22T04:03:13.946 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T04:03:14.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:03:14.086+0000 7eff0d47f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:03:14.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:03:14.095+0000 7eff0d47f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:03:14.403 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T04:03:14.403 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T04:03:14.403 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T04:03:14.403 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T04:03:14.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:03:14.567+0000 7fbe22b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:03:14.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:03:14.587+0000 7fbe22b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:03:14.628 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:03:14.628 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:03:14.628 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:03:14.628 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:03:14.628 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:03:14.628 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:03:14.629 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:03:14.629 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:03:14.629 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:03:14.629 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:03:14.629 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:03:14.629 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:03:14.635 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:03:14.635 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:03:14.636 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T04:03:14.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:03:14.828+0000 7f6deb751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:03:14.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:03:14.844+0000 7f6deb751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:03:14.881 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:03:14.881 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:03:14.881 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:03:14.882 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:03:14.882 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:03:14.882 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:03:14.882 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:03:14.882 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:03:14.882 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:03:14.882 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:03:14.882 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:03:14.882 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:03:14.882 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 45 16 8209 8193 11.3781 11.375 0.0411349 0.0878147 2024-09-22T04:03:14.886 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:03:14.886 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:03:14.886 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T04:03:15.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:03:15.030+0000 7fb3ccf91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:03:15.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:03:15.047+0000 7fb3ccf91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:03:15.091 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:03:15.091 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:03:15.091 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:03:15.091 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:03:15.091 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:03:15.091 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:03:15.091 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:03:15.091 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:03:15.091 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:03:15.091 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:03:15.092 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:03:15.092 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:03:15.096 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:03:15.096 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:03:15.097 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T04:03:15.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:03:15.251+0000 7f5bb9297640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:03:15.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:03:15.265+0000 7f5bb9297640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:03:15.295 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:03:15.295 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:03:15.295 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:03:15.295 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:03:15.295 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:03:15.295 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:03:15.295 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:03:15.295 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:03:15.295 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:03:15.295 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:03:15.296 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:03:15.296 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:03:15.299 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:03:15.299 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:03:15.882 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 46 16 8358 8342 11.3332 9.3125 0.0675097 0.0881566 2024-09-22T04:03:16.593 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T04:03:16.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:03:16.750+0000 7f2db2f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:03:16.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:03:16.761+0000 7f2db2f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:03:16.883 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 47 16 8542 8526 11.3367 11.5 0.118556 0.0881144 2024-09-22T04:03:17.883 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 48 16 8713 8697 11.3232 10.6875 0.106161 0.0881675 2024-09-22T04:03:18.883 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 49 16 8882 8866 11.3077 10.5625 0.0918013 0.0883581 2024-09-22T04:03:19.155 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T04:03:19.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:03:19.314+0000 7f611323e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:03:19.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:03:19.322+0000 7f611323e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:03:19.883 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 50 16 9040 9024 11.279 9.875 0.110105 0.0885585 2024-09-22T04:03:20.300 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T04:03:20.300 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T04:03:20.300 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T04:03:20.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:03:20.465+0000 7f50db348640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:03:20.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:03:20.481+0000 7f50db348640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:03:20.811 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T04:03:20.812 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-22T04:03:20.833 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":498,"stamp":"2024-09-22T04:03:19.141934+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":544801331,"num_objects":8308,"num_object_clones":0,"num_object_copies":24924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":8385,"num_write_kb":532564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8359,"ondisk_log_size":8359,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":503552,"kb_used_data":101184,"kb_used_omap":0,"kb_used_meta":402304,"kb_avail":376983808,"statfs":{"total":386547056640,"available":386031419392,"internally_reserved":0,"allocated":103612416,"data_stored":1614174965,"data_compressed":76604694,"data_compressed_allocated":100835328,"data_compressed_original":1613119488,"omap_allocated":0,"internal_metadata":411959296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":115343360,"num_objects":1760,"num_object_clones":0,"num_object_copies":5280,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1760,"num_write_kb":112640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002535"},"pg_stats":[{"pgid":"7.f","version":"80'507","reported_seq":519,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:03:15.132763+0000","last_change":"2024-09-22T04:02:28.979477+0000","last_active":"2024-09-22T04:03:15.132763+0000","last_peered":"2024-09-22T04:03:15.132763+0000","last_clean":"2024-09-22T04:03:15.132763+0000","last_became_active":"2024-09-22T04:02:28.971367+0000","last_became_peered":"2024-09-22T04:02:28.971367+0000","last_unstale":"2024-09-22T04:03:15.132763+0000","last_undegraded":"2024-09-22T04:03:15.132763+0000","last_fullsized":"2024-09-22T04:03:15.132763+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":507,"log_dups_size":0,"ondisk_log_size":507,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33226752,"num_objects":507,"num_object_clones":0,"num_object_copies":1521,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":507,"num_write_kb":32448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"80'507","reported_seq":519,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:03:14.830744+0000","last_change":"2024-09-22T04:02:28.872853+0000","last_active":"2024-09-22T04:03:14.830744+0000","last_peered":"2024-09-22T04:03:14.830744+0000","last_clean":"2024-09-22T04:03:14.830744+0000","last_became_active":"2024-09-22T04:02:28.865538+0000","last_became_peered":"2024-09-22T04:02:28.865538+0000","last_unstale":"2024-09-22T04:03:14.830744+0000","last_undegraded":"2024-09-22T04:03:14.830744+0000","last_fullsized":"2024-09-22T04:03:14.830744+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":507,"log_dups_size":0,"ondisk_log_size":507,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33226752,"num_objects":507,"num_object_clones":0,"num_object_copies":1521,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":507,"num_write_kb":32448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.d","version":"80'524","reported_seq":536,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:03:15.597490+0000","last_change":"2024-09-22T04:02:28.967443+0000","last_active":"2024-09-22T04:03:15.597490+0000","last_peered":"2024-09-22T04:03:15.597490+0000","last_clean":"2024-09-22T04:03:15.597490+0000","last_became_active":"2024-09-22T04:02:28.959444+0000","last_became_peered":"2024-09-22T04:02:28.959444+0000","last_unstale":"2024-09-22T04:03:15.597490+0000","last_undegraded":"2024-09-22T04:03:15.597490+0000","last_fullsized":"2024-09-22T04:03:15.597490+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":524,"log_dups_size":0,"ondisk_log_size":524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34340864,"num_objects":524,"num_object_clones":0,"num_object_copies":1572,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":524,"num_write_kb":33536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"80'515","reported_seq":527,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:03:15.242111+0000","last_change":"2024-09-22T04:02:28.963918+0000","last_active":"2024-09-22T04:03:15.242111+0000","last_peered":"2024-09-22T04:03:15.242111+0000","last_clean":"2024-09-22T04:03:15.242111+0000","last_became_active":"2024-09-22T04:02:28.948540+0000","last_became_peered":"2024-09-22T04:02:28.948540+0000","last_unstale":"2024-09-22T04:03:15.242111+0000","last_undegraded":"2024-09-22T04:03:15.242111+0000","last_fullsized":"2024-09-22T04:03:15.242111+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":515,"log_dups_size":0,"ondisk_log_size":515,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33751040,"num_objects":515,"num_object_clones":0,"num_object_copies":1545,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":515,"num_write_kb":32960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"80'538","reported_seq":550,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:03:16.177008+0000","last_change":"2024-09-22T04:02:28.971728+0000","last_active":"2024-09-22T04:03:16.177008+0000","last_peered":"2024-09-22T04:03:16.177008+0000","last_clean":"2024-09-22T04:03:16.177008+0000","last_became_active":"2024-09-22T04:02:28.960293+0000","last_became_peered":"2024-09-22T04:02:28.960293+0000","last_unstale":"2024-09-22T04:03:16.177008+0000","last_undegraded":"2024-09-22T04:03:16.177008+0000","last_fullsized":"2024-09-22T04:03:16.177008+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":538,"log_dups_size":0,"ondisk_log_size":538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35258368,"num_objects":538,"num_object_clones":0,"num_object_copies":1614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":538,"num_write_kb":34432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"80'490","reported_seq":502,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:03:16.186557+0000","last_change":"2024-09-22T04:02:29.026441+0000","last_active":"2024-09-22T04:03:16.186557+0000","last_peered":"2024-09-22T04:03:16.186557+0000","last_clean":"2024-09-22T04:03:16.186557+0000","last_became_active":"2024-09-22T04:02:28.991656+0000","last_became_peered":"2024-09-22T04:02:28.991656+0000","last_unstale":"2024-09-22T04:03:16.186557+0000","last_undegraded":"2024-09-22T04:03:16.186557+0000","last_fullsized":"2024-09-22T04:03:16.186557+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":490,"log_dups_size":0,"ondisk_log_size":490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32112640,"num_objects":490,"num_object_clones":0,"num_object_copies":1470,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":490,"num_write_kb":31360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.9","version":"80'557","reported_seq":569,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:03:14.985404+0000","last_change":"2024-09-22T04:02:28.996162+0000","last_active":"2024-09-22T04:03:14.985404+0000","last_peered":"2024-09-22T04:03:14.985404+0000","last_clean":"2024-09-22T04:03:14.985404+0000","last_became_active":"2024-09-22T04:02:28.990154+0000","last_became_peered":"2024-09-22T04:02:28.990154+0000","last_unstale":"2024-09-22T04:03:14.985404+0000","last_undegraded":"2024-09-22T04:03:14.985404+0000","last_fullsized":"2024-09-22T04:03:14.985404+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":557,"log_dups_size":0,"ondisk_log_size":557,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36503552,"num_objects":557,"num_object_clones":0,"num_object_copies":1671,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":557,"num_write_kb":35648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"80'544","reported_seq":556,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:03:14.848960+0000","last_change":"2024-09-22T04:02:28.902123+0000","last_active":"2024-09-22T04:03:14.848960+0000","last_peered":"2024-09-22T04:03:14.848960+0000","last_clean":"2024-09-22T04:03:14.848960+0000","last_became_active":"2024-09-22T04:02:28.895508+0000","last_became_peered":"2024-09-22T04:02:28.895508+0000","last_unstale":"2024-09-22T04:03:14.848960+0000","last_undegraded":"2024-09-22T04:03:14.848960+0000","last_fullsized":"2024-09-22T04:03:14.848960+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":544,"log_dups_size":0,"ondisk_log_size":544,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35651584,"num_objects":544,"num_object_clones":0,"num_object_copies":1632,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":544,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.6","version":"80'510","reported_seq":522,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:03:15.037546+0000","last_change":"2024-09-22T04:02:29.024059+0000","last_active":"2024-09-22T04:03:15.037546+0000","last_peered":"2024-09-22T04:03:15.037546+0000","last_clean":"2024-09-22T04:03:15.037546+0000","last_became_active":"2024-09-22T04:02:29.013699+0000","last_became_peered":"2024-09-22T04:02:29.013699+0000","last_unstale":"2024-09-22T04:03:15.037546+0000","last_undegraded":"2024-09-22T04:03:15.037546+0000","last_fullsized":"2024-09-22T04:03:15.037546+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":510,"log_dups_size":0,"ondisk_log_size":510,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33423360,"num_objects":510,"num_object_clones":0,"num_object_copies":1530,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":510,"num_write_kb":32640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":283,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:29.819502+0000","last_change":"2024-09-22T03:49:12.034704+0000","last_active":"2024-09-22T04:02:29.819502+0000","last_peered":"2024-09-22T04:02:29.819502+0000","last_clean":"2024-09-22T04:02:29.819502+0000","last_became_active":"2024-09-22T03:49:12.027470+0000","last_became_peered":"2024-09-22T03:49:12.027470+0000","last_unstale":"2024-09-22T04:02:29.819502+0000","last_undegraded":"2024-09-22T04:02:29.819502+0000","last_fullsized":"2024-09-22T04:02:29.819502+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_clean_scrub_stamp":"2024-09-22T03:49:10.979949+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":209,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:29.818606+0000","last_change":"2024-09-22T03:49:17.031458+0000","last_active":"2024-09-22T04:02:29.818606+0000","last_peered":"2024-09-22T04:02:29.818606+0000","last_clean":"2024-09-22T04:02:29.818606+0000","last_became_active":"2024-09-22T03:49:15.125490+0000","last_became_peered":"2024-09-22T03:49:15.125490+0000","last_unstale":"2024-09-22T04:02:29.818606+0000","last_undegraded":"2024-09-22T04:02:29.818606+0000","last_fullsized":"2024-09-22T04:02:29.818606+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"80'520","reported_seq":532,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:03:15.036760+0000","last_change":"2024-09-22T04:02:28.912870+0000","last_active":"2024-09-22T04:03:15.036760+0000","last_peered":"2024-09-22T04:03:15.036760+0000","last_clean":"2024-09-22T04:03:15.036760+0000","last_became_active":"2024-09-22T04:02:28.905573+0000","last_became_peered":"2024-09-22T04:02:28.905573+0000","last_unstale":"2024-09-22T04:03:15.036760+0000","last_undegraded":"2024-09-22T04:03:15.036760+0000","last_fullsized":"2024-09-22T04:03:15.036760+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":520,"log_dups_size":0,"ondisk_log_size":520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34078720,"num_objects":520,"num_object_clones":0,"num_object_copies":1560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":520,"num_write_kb":33280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":208,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:29.815930+0000","last_change":"2024-09-22T03:49:17.029339+0000","last_active":"2024-09-22T04:02:29.815930+0000","last_peered":"2024-09-22T04:02:29.815930+0000","last_clean":"2024-09-22T04:02:29.815930+0000","last_became_active":"2024-09-22T03:49:15.097304+0000","last_became_peered":"2024-09-22T03:49:15.097304+0000","last_unstale":"2024-09-22T04:02:29.815930+0000","last_undegraded":"2024-09-22T04:02:29.815930+0000","last_fullsized":"2024-09-22T04:02:29.815930+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"80'521","reported_seq":533,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:03:15.312254+0000","last_change":"2024-09-22T04:02:28.928198+0000","last_active":"2024-09-22T04:03:15.312254+0000","last_peered":"2024-09-22T04:03:15.312254+0000","last_clean":"2024-09-22T04:03:15.312254+0000","last_became_active":"2024-09-22T04:02:28.909503+0000","last_became_peered":"2024-09-22T04:02:28.909503+0000","last_unstale":"2024-09-22T04:03:15.312254+0000","last_undegraded":"2024-09-22T04:03:15.312254+0000","last_fullsized":"2024-09-22T04:03:15.312254+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":521,"log_dups_size":0,"ondisk_log_size":521,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34144256,"num_objects":521,"num_object_clones":0,"num_object_copies":1563,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":521,"num_write_kb":33344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":208,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:29.822286+0000","last_change":"2024-09-22T03:49:17.029349+0000","last_active":"2024-09-22T04:02:29.822286+0000","last_peered":"2024-09-22T04:02:29.822286+0000","last_clean":"2024-09-22T04:02:29.822286+0000","last_became_active":"2024-09-22T03:49:15.094890+0000","last_became_peered":"2024-09-22T03:49:15.094890+0000","last_unstale":"2024-09-22T04:02:29.822286+0000","last_undegraded":"2024-09-22T04:02:29.822286+0000","last_fullsized":"2024-09-22T04:02:29.822286+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.7","version":"80'535","reported_seq":547,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:03:15.000062+0000","last_change":"2024-09-22T04:02:28.945388+0000","last_active":"2024-09-22T04:03:15.000062+0000","last_peered":"2024-09-22T04:03:15.000062+0000","last_clean":"2024-09-22T04:03:15.000062+0000","last_became_active":"2024-09-22T04:02:28.939479+0000","last_became_peered":"2024-09-22T04:02:28.939479+0000","last_unstale":"2024-09-22T04:03:15.000062+0000","last_undegraded":"2024-09-22T04:03:15.000062+0000","last_fullsized":"2024-09-22T04:03:15.000062+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":535,"log_dups_size":0,"ondisk_log_size":535,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35061760,"num_objects":535,"num_object_clones":0,"num_object_copies":1605,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":535,"num_write_kb":34240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":210,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:29.820716+0000","last_change":"2024-09-22T03:49:17.031466+0000","last_active":"2024-09-22T04:02:29.820716+0000","last_peered":"2024-09-22T04:02:29.820716+0000","last_clean":"2024-09-22T04:02:29.820716+0000","last_became_active":"2024-09-22T03:49:15.098420+0000","last_became_peered":"2024-09-22T03:49:15.098420+0000","last_unstale":"2024-09-22T04:02:29.820716+0000","last_undegraded":"2024-09-22T04:02:29.820716+0000","last_fullsized":"2024-09-22T04:02:29.820716+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1","version":"80'487","reported_seq":499,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:03:14.709131+0000","last_change":"2024-09-22T04:02:28.927518+0000","last_active":"2024-09-22T04:03:14.709131+0000","last_peered":"2024-09-22T04:03:14.709131+0000","last_clean":"2024-09-22T04:03:14.709131+0000","last_became_active":"2024-09-22T04:02:28.919323+0000","last_became_peered":"2024-09-22T04:02:28.919323+0000","last_unstale":"2024-09-22T04:03:14.709131+0000","last_undegraded":"2024-09-22T04:03:14.709131+0000","last_fullsized":"2024-09-22T04:03:14.709131+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31916032,"num_objects":487,"num_object_clones":0,"num_object_copies":1461,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":487,"num_write_kb":31168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":208,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:29.823311+0000","last_change":"2024-09-22T03:49:17.036954+0000","last_active":"2024-09-22T04:02:29.823311+0000","last_peered":"2024-09-22T04:02:29.823311+0000","last_clean":"2024-09-22T04:02:29.823311+0000","last_became_active":"2024-09-22T03:49:15.110506+0000","last_became_peered":"2024-09-22T03:49:15.110506+0000","last_unstale":"2024-09-22T04:02:29.823311+0000","last_undegraded":"2024-09-22T04:02:29.823311+0000","last_fullsized":"2024-09-22T04:02:29.823311+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"80'550","reported_seq":562,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:03:16.209952+0000","last_change":"2024-09-22T04:02:28.954190+0000","last_active":"2024-09-22T04:03:16.209952+0000","last_peered":"2024-09-22T04:03:16.209952+0000","last_clean":"2024-09-22T04:03:16.209952+0000","last_became_active":"2024-09-22T04:02:28.946807+0000","last_became_peered":"2024-09-22T04:02:28.946807+0000","last_unstale":"2024-09-22T04:03:16.209952+0000","last_undegraded":"2024-09-22T04:03:16.209952+0000","last_fullsized":"2024-09-22T04:03:16.209952+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":550,"log_dups_size":0,"ondisk_log_size":550,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36044800,"num_objects":550,"num_object_clones":0,"num_object_copies":1650,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":550,"num_write_kb":35200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":208,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:29.820857+0000","last_change":"2024-09-22T03:49:17.032989+0000","last_active":"2024-09-22T04:02:29.820857+0000","last_peered":"2024-09-22T04:02:29.820857+0000","last_clean":"2024-09-22T04:02:29.820857+0000","last_became_active":"2024-09-22T03:49:15.079260+0000","last_became_peered":"2024-09-22T03:49:15.079260+0000","last_unstale":"2024-09-22T04:02:29.820857+0000","last_undegraded":"2024-09-22T04:02:29.820857+0000","last_fullsized":"2024-09-22T04:02:29.820857+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3","version":"80'491","reported_seq":503,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:03:14.744510+0000","last_change":"2024-09-22T04:02:28.924084+0000","last_active":"2024-09-22T04:03:14.744510+0000","last_peered":"2024-09-22T04:03:14.744510+0000","last_clean":"2024-09-22T04:03:14.744510+0000","last_became_active":"2024-09-22T04:02:28.898697+0000","last_became_peered":"2024-09-22T04:02:28.898697+0000","last_unstale":"2024-09-22T04:03:14.744510+0000","last_undegraded":"2024-09-22T04:03:14.744510+0000","last_fullsized":"2024-09-22T04:03:14.744510+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":491,"log_dups_size":0,"ondisk_log_size":491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32178176,"num_objects":491,"num_object_clones":0,"num_object_copies":1473,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":491,"num_write_kb":31424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":208,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:29.823587+0000","last_change":"2024-09-22T03:49:17.036402+0000","last_active":"2024-09-22T04:02:29.823587+0000","last_peered":"2024-09-22T04:02:29.823587+0000","last_clean":"2024-09-22T04:02:29.823587+0000","last_became_active":"2024-09-22T03:49:15.108430+0000","last_became_peered":"2024-09-22T03:49:15.108430+0000","last_unstale":"2024-09-22T04:02:29.823587+0000","last_undegraded":"2024-09-22T04:02:29.823587+0000","last_fullsized":"2024-09-22T04:02:29.823587+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"80'508","reported_seq":520,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:03:15.234729+0000","last_change":"2024-09-22T04:02:29.018532+0000","last_active":"2024-09-22T04:03:15.234729+0000","last_peered":"2024-09-22T04:03:15.234729+0000","last_clean":"2024-09-22T04:03:15.234729+0000","last_became_active":"2024-09-22T04:02:29.006046+0000","last_became_peered":"2024-09-22T04:02:29.006046+0000","last_unstale":"2024-09-22T04:03:15.234729+0000","last_undegraded":"2024-09-22T04:03:15.234729+0000","last_fullsized":"2024-09-22T04:03:15.234729+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":508,"log_dups_size":0,"ondisk_log_size":508,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33292288,"num_objects":508,"num_object_clones":0,"num_object_copies":1524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":508,"num_write_kb":32512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":208,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:29.815415+0000","last_change":"2024-09-22T03:49:17.029128+0000","last_active":"2024-09-22T04:02:29.815415+0000","last_peered":"2024-09-22T04:02:29.815415+0000","last_clean":"2024-09-22T04:02:29.815415+0000","last_became_active":"2024-09-22T03:49:15.113396+0000","last_became_peered":"2024-09-22T03:49:15.113396+0000","last_unstale":"2024-09-22T04:02:29.815415+0000","last_undegraded":"2024-09-22T04:02:29.815415+0000","last_fullsized":"2024-09-22T04:02:29.815415+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":544210944,"num_objects":8304,"num_object_clones":0,"num_object_copies":24912,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8304,"num_write_kb":531456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":101810176,"data_stored":1628962816,"data_compressed":77348542,"data_compressed_allocated":101810176,"data_compressed_original":1628962816,"omap_allocated":0,"internal_metadata":0},"log_size":8304,"ondisk_log_size":8304,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949673803,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":140616,"kb_used_data":19384,"kb_used_omap":0,"kb_used_meta":121216,"kb_avail":94231224,"statfs":{"total":96636764160,"available":96492773376,"internally_reserved":0,"allocated":19849216,"data_stored":306566986,"data_compressed":14546931,"data_compressed_allocated":19148800,"data_compressed_original":306298880,"omap_allocated":0,"internal_metadata":124125184},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654706507,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":70028,"kb_used_data":27196,"kb_used_omap":0,"kb_used_meta":42816,"kb_avail":94301812,"statfs":{"total":96636764160,"available":96565055488,"internally_reserved":0,"allocated":27848704,"data_stored":434951466,"data_compressed":20640982,"data_compressed_allocated":27168768,"data_compressed_original":434700288,"omap_allocated":0,"internal_metadata":43843584},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706507,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":140572,"kb_used_data":23500,"kb_used_omap":0,"kb_used_meta":117056,"kb_avail":94231268,"statfs":{"total":96636764160,"available":96492818432,"internally_reserved":0,"allocated":24064000,"data_stored":374003530,"data_compressed":17749022,"data_compressed_allocated":23363584,"data_compressed_original":373735424,"omap_allocated":0,"internal_metadata":119865344},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706506,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":152336,"kb_used_data":31104,"kb_used_omap":0,"kb_used_meta":121216,"kb_avail":94219504,"statfs":{"total":96636764160,"available":96480772096,"internally_reserved":0,"allocated":31850496,"data_stored":498652983,"data_compressed":23667759,"data_compressed_allocated":31154176,"data_compressed_original":498384896,"omap_allocated":0,"internal_metadata":124125184},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":31768576,"data_stored":508297216,"data_compressed":24135623,"data_compressed_allocated":31768576,"data_compressed_original":508297216,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":19214336,"data_stored":307429376,"data_compressed":14597787,"data_compressed_allocated":19214336,"data_compressed_original":307429376,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":23334912,"data_stored":373358592,"data_compressed":17728302,"data_compressed_allocated":23334912,"data_compressed_original":373358592,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":27492352,"data_stored":439877632,"data_compressed":20886830,"data_compressed_allocated":27492352,"data_compressed_original":439877632,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T04:03:20.883 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 51 16 9218 9202 11.2759 11.125 0.122023 0.0886102 2024-09-22T04:03:21.825 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T04:03:21.883 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 52 16 9363 9347 11.2334 9.0625 0.118807 0.0888884 2024-09-22T04:03:21.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:03:21.984+0000 7ff9c305a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:03:21.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:03:21.994+0000 7ff9c305a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:03:22.883 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 53 16 9540 9524 11.2301 11.0625 0.101363 0.0889517 2024-09-22T04:03:23.883 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 54 16 9714 9698 11.2235 10.875 0.0996095 0.0889976 2024-09-22T04:03:24.441 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T04:03:24.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:03:24.598+0000 7f26adf91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:03:24.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:03:24.609+0000 7f26adf91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:03:24.883 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 55 16 9894 9878 11.224 11.25 0.113114 0.0889911 2024-09-22T04:03:25.836 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T04:03:25.836 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T04:03:25.836 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T04:03:25.837 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T04:03:25.883 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 56 16 10067 10051 11.2166 10.8125 0.10253 0.0890899 2024-09-22T04:03:26.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:03:26.002+0000 7f9311391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:03:26.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:03:26.019+0000 7f9311391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:03:26.276 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:03:26.277 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:03:26.277 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:03:26.277 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:03:26.277 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:03:26.277 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:03:26.277 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:03:26.277 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:03:26.277 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:03:26.277 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:03:26.277 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:03:26.277 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:03:26.281 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:03:26.281 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:03:26.282 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T04:03:26.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:03:26.446+0000 7f8cc2791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:03:26.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:03:26.461+0000 7f8cc2791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:03:26.533 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:03:26.533 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:03:26.533 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:03:26.533 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:03:26.534 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:03:26.534 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:03:26.534 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:03:26.534 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:03:26.534 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:03:26.534 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:03:26.534 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:03:26.534 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:03:26.537 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:03:26.537 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:03:26.538 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T04:03:26.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:03:26.689+0000 7f850a2d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:03:26.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:03:26.703+0000 7f850a2d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:03:26.764 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:03:26.764 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:03:26.764 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:03:26.764 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:03:26.764 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:03:26.764 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:03:26.764 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:03:26.764 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:03:26.764 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:03:26.764 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:03:26.764 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:03:26.765 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:03:26.770 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:03:26.770 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:03:26.770 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T04:03:26.883 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 57 16 10236 10220 11.2051 10.5625 0.113376 0.0891185 2024-09-22T04:03:26.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:03:26.923+0000 7fa338f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:03:26.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:03:26.941+0000 7fa338f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:03:27.017 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:03:27.017 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:03:27.018 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:03:27.018 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:03:27.018 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:03:27.018 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:03:27.018 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:03:27.018 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:03:27.018 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:03:27.018 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:03:27.018 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:03:27.018 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:03:27.021 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:03:27.022 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:03:27.084 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T04:03:27.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:03:27.251+0000 7fda26c74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:03:27.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:03:27.262+0000 7fda26c74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:03:27.884 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 58 16 10412 10396 11.2016 11 0.0876603 0.0891768 2024-09-22T04:03:28.884 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 59 16 10583 10567 11.1928 10.6875 0.0920768 0.0892633 2024-09-22T04:03:29.655 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T04:03:29.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:03:29.812+0000 7f74ffd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:03:29.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:03:29.820+0000 7f74ffd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:03:29.884 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:2024-09-22T04:03:29.884012+0000 min lat: 0.0179924 max lat: 0.218626 avg lat: 0.0894311 2024-09-22T04:03:29.884 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-22T04:03:29.884 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 60 16 10741 10725 11.1709 9.875 0.142204 0.0894311 2024-09-22T04:03:30.884 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 61 16 10905 10889 11.1558 10.25 0.03757 0.0895827 2024-09-22T04:03:31.884 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 62 16 11080 11064 11.1522 10.9375 0.110907 0.0895923 2024-09-22T04:03:32.023 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T04:03:32.023 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T04:03:32.023 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T04:03:32.023 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T04:03:32.141 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T04:03:32.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:03:32.173+0000 7f06b0ec8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:03:32.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:03:32.192+0000 7f06b0ec8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:03:32.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:03:32.298+0000 7fe341551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:03:32.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:03:32.306+0000 7fe341551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:03:32.383 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:03:32.383 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:03:32.383 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:03:32.383 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:03:32.383 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:03:32.383 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:03:32.383 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:03:32.383 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:03:32.384 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:03:32.384 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:03:32.384 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:03:32.384 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:03:32.388 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:03:32.388 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:03:32.388 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T04:03:32.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:03:32.583+0000 7f5553d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:03:32.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:03:32.601+0000 7f5553d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:03:32.633 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:03:32.633 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:03:32.633 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:03:32.633 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:03:32.633 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:03:32.633 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:03:32.633 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:03:32.633 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:03:32.633 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:03:32.633 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:03:32.633 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:03:32.634 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:03:32.641 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:03:32.641 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:03:32.641 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T04:03:32.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:03:32.806+0000 7fed394ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:03:32.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:03:32.820+0000 7fed394ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:03:32.869 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:03:32.869 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:03:32.869 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:03:32.869 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:03:32.869 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:03:32.869 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:03:32.869 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:03:32.869 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:03:32.869 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:03:32.870 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:03:32.870 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:03:32.870 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:03:32.873 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:03:32.874 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:03:32.874 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T04:03:32.884 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 63 16 11247 11231 11.1409 10.4375 0.0954116 0.0896755 2024-09-22T04:03:33.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:03:33.030+0000 7f130ed51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:03:33.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:03:33.044+0000 7f130ed51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:03:33.078 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:03:33.078 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:03:33.078 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:03:33.078 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:03:33.078 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:03:33.078 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:03:33.078 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:03:33.078 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:03:33.078 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:03:33.078 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:03:33.079 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:03:33.079 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:03:33.082 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:03:33.082 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:03:33.884 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 64 16 11420 11404 11.1357 10.8125 0.1344 0.0897008 2024-09-22T04:03:34.718 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T04:03:34.884 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 65 16 11596 11580 11.1336 11 0.112639 0.0897158 2024-09-22T04:03:34.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:03:34.885+0000 7fad62151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:03:34.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:03:34.893+0000 7fad62151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:03:35.884 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 66 16 11752 11736 11.1126 9.75 0.0782341 0.0898965 2024-09-22T04:03:36.884 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 67 16 11938 11922 11.1203 11.625 0.074975 0.0898738 2024-09-22T04:03:37.312 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T04:03:37.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:03:37.461+0000 7fb8f1311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:03:37.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:03:37.468+0000 7fb8f1311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:03:37.885 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 68 16 12090 12074 11.0964 9.5 0.0752451 0.0900589 2024-09-22T04:03:38.083 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T04:03:38.083 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T04:03:38.083 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T04:03:38.083 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T04:03:38.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:03:38.248+0000 7f25c9446640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:03:38.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:03:38.269+0000 7f25c9446640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:03:38.493 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:03:38.493 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:03:38.493 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:03:38.494 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:03:38.494 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:03:38.494 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:03:38.494 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:03:38.494 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:03:38.494 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:03:38.494 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:03:38.494 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:03:38.494 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:03:38.497 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:03:38.497 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:03:38.497 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T04:03:38.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:03:38.652+0000 7fbf0a2d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:03:38.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:03:38.670+0000 7fbf0a2d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:03:38.698 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:03:38.699 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:03:38.699 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:03:38.699 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:03:38.699 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:03:38.699 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:03:38.699 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:03:38.699 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:03:38.699 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:03:38.699 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:03:38.699 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:03:38.699 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:03:38.703 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:03:38.704 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:03:38.704 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T04:03:38.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:03:38.855+0000 7f7ed5e74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:03:38.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:03:38.871+0000 7f7ed5e74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:03:38.885 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 69 16 12260 12244 11.0896 10.625 0.116566 0.0900783 2024-09-22T04:03:38.990 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:03:38.991 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:03:38.991 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:03:38.991 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:03:38.991 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:03:38.991 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:03:38.991 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:03:38.991 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:03:38.991 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:03:38.991 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:03:38.991 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:03:38.991 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:03:38.995 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:03:38.995 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:03:38.996 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T04:03:39.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:03:39.154+0000 7f57d4ebd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:03:39.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:03:39.168+0000 7f57d4ebd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:03:39.332 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:03:39.332 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:03:39.332 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:03:39.332 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:03:39.332 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:03:39.332 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:03:39.332 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:03:39.332 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:03:39.332 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:03:39.332 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:03:39.332 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:03:39.332 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:03:39.336 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:03:39.337 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:03:39.846 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T04:03:39.885 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 70 16 12422 12406 11.0758 10.125 0.139513 0.0901678 2024-09-22T04:03:40.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:03:39.996+0000 7f1bc1351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:03:40.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:03:40.005+0000 7f1bc1351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:03:40.885 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 71 16 12597 12581 11.0738 10.9375 0.111392 0.0902253 2024-09-22T04:03:41.885 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 72 16 12766 12750 11.0667 10.5625 0.100871 0.0903059 2024-09-22T04:03:42.695 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T04:03:42.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:03:42.861+0000 7fb60bad1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:03:42.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:03:42.876+0000 7fb60a86f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:03:42.885 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 73 16 12931 12915 11.0563 10.3125 0.12445 0.0903767 2024-09-22T04:03:43.885 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 74 16 13112 13096 11.0598 11.3125 0.135272 0.0903562 2024-09-22T04:03:44.337 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T04:03:44.338 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T04:03:44.338 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T04:03:44.338 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T04:03:44.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:03:44.483+0000 7f17cd791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:03:44.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:03:44.500+0000 7f17cd791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:03:44.725 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:03:44.725 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:03:44.725 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:03:44.725 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:03:44.725 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:03:44.725 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:03:44.725 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:03:44.726 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:03:44.726 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:03:44.726 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:03:44.726 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:03:44.726 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:03:44.731 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:03:44.731 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:03:44.731 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T04:03:44.885 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 75 16 13266 13250 11.0406 9.625 0.0755454 0.0904546 2024-09-22T04:03:44.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:03:44.903+0000 7f7344257640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:03:44.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:03:44.918+0000 7f7344257640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:03:44.983 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:03:44.983 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:03:44.983 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:03:44.983 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:03:44.983 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:03:44.983 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:03:44.984 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:03:44.984 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:03:44.984 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:03:44.984 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:03:44.984 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:03:44.984 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:03:44.988 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:03:44.989 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:03:44.989 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T04:03:45.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:03:45.149+0000 7ffade2a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:03:45.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:03:45.166+0000 7ffade2a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:03:45.223 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:03:45.223 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:03:45.223 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:03:45.223 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:03:45.223 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:03:45.223 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:03:45.223 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:03:45.223 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:03:45.223 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:03:45.223 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:03:45.223 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:03:45.224 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:03:45.227 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:03:45.228 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:03:45.228 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T04:03:45.304 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T04:03:45.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:03:45.389+0000 7f7a68548640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:03:45.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:03:45.413+0000 7f7a68548640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:03:45.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:03:45.463+0000 7fed5b791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:03:45.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:03:45.474+0000 7fed5b791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:03:45.499 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:03:45.499 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:03:45.499 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:03:45.499 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:03:45.499 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:03:45.499 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:03:45.500 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:03:45.500 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:03:45.500 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:03:45.500 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:03:45.500 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:03:45.500 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:03:45.503 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:03:45.503 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:03:45.885 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 76 16 13439 13423 11.0376 10.8125 0.132627 0.0905176 2024-09-22T04:03:46.886 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 77 16 13605 13589 11.029 10.375 0.117822 0.0906125 2024-09-22T04:03:47.873 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T04:03:47.886 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 78 16 13780 13764 11.0278 10.9375 0.0605337 0.0906396 2024-09-22T04:03:48.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:03:48.015+0000 7f5419591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:03:48.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:03:48.027+0000 7f5419591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:03:48.886 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 79 16 13942 13926 11.0164 10.125 0.0874536 0.0907159 2024-09-22T04:03:49.886 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:2024-09-22T04:03:49.886084+0000 min lat: 0.0179924 max lat: 0.222626 avg lat: 0.0909247 2024-09-22T04:03:49.886 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-22T04:03:49.886 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 80 16 14081 14065 10.9873 8.6875 0.0801219 0.0909247 2024-09-22T04:03:50.465 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T04:03:50.504 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T04:03:50.504 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T04:03:50.504 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T04:03:50.504 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T04:03:50.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:03:50.617+0000 7fcd52511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:03:50.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:03:50.627+0000 7fcd52511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:03:50.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:03:50.679+0000 7fec9eb11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:03:50.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:03:50.695+0000 7fec9eb11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:03:50.789 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:03:50.789 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:03:50.789 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:03:50.789 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:03:50.790 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:03:50.790 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:03:50.790 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:03:50.790 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:03:50.790 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:03:50.790 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:03:50.791 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:03:50.791 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:03:50.793 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:03:50.793 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:03:50.793 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T04:03:50.886 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 81 16 14239 14223 10.9735 9.875 0.084414 0.0910519 2024-09-22T04:03:50.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:03:50.938+0000 7f310ed91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:03:50.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:03:50.955+0000 7f310ed91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:03:50.983 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:03:50.983 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:03:50.984 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:03:50.984 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:03:50.984 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:03:50.984 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:03:50.984 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:03:50.984 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:03:50.984 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:03:50.985 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:03:50.985 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:03:50.985 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:03:50.987 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:03:50.988 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:03:50.988 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T04:03:51.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:03:51.151+0000 7f6b7dd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:03:51.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:03:51.171+0000 7f6b7dd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:03:51.220 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:03:51.220 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:03:51.220 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:03:51.220 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:03:51.220 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:03:51.221 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:03:51.221 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:03:51.221 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:03:51.221 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:03:51.221 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:03:51.221 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:03:51.221 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:03:51.223 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:03:51.223 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:03:51.224 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T04:03:51.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:03:51.370+0000 7fafe8afd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:03:51.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:03:51.386+0000 7fafe8afd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:03:51.555 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:03:51.555 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:03:51.555 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:03:51.555 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:03:51.555 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:03:51.556 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:03:51.556 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:03:51.556 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:03:51.556 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:03:51.556 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:03:51.556 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:03:51.556 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:03:51.560 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:03:51.560 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:03:51.886 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 82 16 14398 14382 10.9609 9.9375 0.0409457 0.0911683 2024-09-22T04:03:52.886 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 83 16 14571 14555 10.9591 10.8125 0.117675 0.0911907 2024-09-22T04:03:53.055 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T04:03:53.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:03:53.216+0000 7f3f0fea3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:03:53.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:03:53.229+0000 7f3f0fea3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:03:53.886 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 84 16 14727 14711 10.9447 9.75 0.0763791 0.0913273 2024-09-22T04:03:54.886 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 85 16 14891 14875 10.9365 10.25 0.0766774 0.0913659 2024-09-22T04:03:55.689 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T04:03:55.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:03:55.855+0000 7f75d8b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:03:55.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:03:55.867+0000 7f75d8b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:03:55.886 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 86 16 15056 15040 10.9292 10.3125 0.0374233 0.0914242 2024-09-22T04:03:56.561 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T04:03:56.562 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T04:03:56.562 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T04:03:56.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:03:56.716+0000 7fddf70bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:03:56.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:03:56.732+0000 7fddf70bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:03:56.886 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 87 16 15222 15206 10.9228 10.375 0.0338973 0.0914708 2024-09-22T04:03:57.081 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T04:03:57.081 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-22T04:03:57.102 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":516,"stamp":"2024-09-22T04:03:55.149508+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":930546227,"num_objects":14194,"num_object_clones":0,"num_object_copies":42582,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":14271,"num_write_kb":909268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14245,"ondisk_log_size":14245,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":389044,"kb_used_data":171636,"kb_used_omap":0,"kb_used_meta":217344,"kb_avail":377098316,"statfs":{"total":386547056640,"available":386148675584,"internally_reserved":0,"allocated":175755264,"data_stored":2768460533,"data_compressed":131416347,"data_compressed_allocated":172978176,"data_compressed_original":2767405056,"omap_allocated":0,"internal_metadata":222560256},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":109314048,"num_objects":1668,"num_object_clones":0,"num_object_copies":5004,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1668,"num_write_kb":106752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002633"},"pg_stats":[{"pgid":"7.f","version":"80'834","reported_seq":846,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:03:49.656985+0000","last_change":"2024-09-22T04:02:28.979477+0000","last_active":"2024-09-22T04:03:49.656985+0000","last_peered":"2024-09-22T04:03:49.656985+0000","last_clean":"2024-09-22T04:03:49.656985+0000","last_became_active":"2024-09-22T04:02:28.971367+0000","last_became_peered":"2024-09-22T04:02:28.971367+0000","last_unstale":"2024-09-22T04:03:49.656985+0000","last_undegraded":"2024-09-22T04:03:49.656985+0000","last_fullsized":"2024-09-22T04:03:49.656985+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":834,"log_dups_size":0,"ondisk_log_size":834,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54657024,"num_objects":834,"num_object_clones":0,"num_object_copies":2502,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":834,"num_write_kb":53376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"80'873","reported_seq":885,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:03:50.019386+0000","last_change":"2024-09-22T04:02:28.872853+0000","last_active":"2024-09-22T04:03:50.019386+0000","last_peered":"2024-09-22T04:03:50.019386+0000","last_clean":"2024-09-22T04:03:50.019386+0000","last_became_active":"2024-09-22T04:02:28.865538+0000","last_became_peered":"2024-09-22T04:02:28.865538+0000","last_unstale":"2024-09-22T04:03:50.019386+0000","last_undegraded":"2024-09-22T04:03:50.019386+0000","last_fullsized":"2024-09-22T04:03:50.019386+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":873,"log_dups_size":0,"ondisk_log_size":873,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57212928,"num_objects":873,"num_object_clones":0,"num_object_copies":2619,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":873,"num_write_kb":55872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.d","version":"80'921","reported_seq":933,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:03:51.052760+0000","last_change":"2024-09-22T04:02:28.967443+0000","last_active":"2024-09-22T04:03:51.052760+0000","last_peered":"2024-09-22T04:03:51.052760+0000","last_clean":"2024-09-22T04:03:51.052760+0000","last_became_active":"2024-09-22T04:02:28.959444+0000","last_became_peered":"2024-09-22T04:02:28.959444+0000","last_unstale":"2024-09-22T04:03:51.052760+0000","last_undegraded":"2024-09-22T04:03:51.052760+0000","last_fullsized":"2024-09-22T04:03:51.052760+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":921,"log_dups_size":0,"ondisk_log_size":921,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60358656,"num_objects":921,"num_object_clones":0,"num_object_copies":2763,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":921,"num_write_kb":58944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"80'876","reported_seq":888,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:03:50.058474+0000","last_change":"2024-09-22T04:02:28.963918+0000","last_active":"2024-09-22T04:03:50.058474+0000","last_peered":"2024-09-22T04:03:50.058474+0000","last_clean":"2024-09-22T04:03:50.058474+0000","last_became_active":"2024-09-22T04:02:28.948540+0000","last_became_peered":"2024-09-22T04:02:28.948540+0000","last_unstale":"2024-09-22T04:03:50.058474+0000","last_undegraded":"2024-09-22T04:03:50.058474+0000","last_fullsized":"2024-09-22T04:03:50.058474+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":876,"log_dups_size":0,"ondisk_log_size":876,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57409536,"num_objects":876,"num_object_clones":0,"num_object_copies":2628,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":876,"num_write_kb":56064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"80'898","reported_seq":910,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:03:51.162655+0000","last_change":"2024-09-22T04:02:28.971728+0000","last_active":"2024-09-22T04:03:51.162655+0000","last_peered":"2024-09-22T04:03:51.162655+0000","last_clean":"2024-09-22T04:03:51.162655+0000","last_became_active":"2024-09-22T04:02:28.960293+0000","last_became_peered":"2024-09-22T04:02:28.960293+0000","last_unstale":"2024-09-22T04:03:51.162655+0000","last_undegraded":"2024-09-22T04:03:51.162655+0000","last_fullsized":"2024-09-22T04:03:51.162655+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":898,"log_dups_size":0,"ondisk_log_size":898,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58851328,"num_objects":898,"num_object_clones":0,"num_object_copies":2694,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":898,"num_write_kb":57472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"80'847","reported_seq":859,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:03:51.164239+0000","last_change":"2024-09-22T04:02:29.026441+0000","last_active":"2024-09-22T04:03:51.164239+0000","last_peered":"2024-09-22T04:03:51.164239+0000","last_clean":"2024-09-22T04:03:51.164239+0000","last_became_active":"2024-09-22T04:02:28.991656+0000","last_became_peered":"2024-09-22T04:02:28.991656+0000","last_unstale":"2024-09-22T04:03:51.164239+0000","last_undegraded":"2024-09-22T04:03:51.164239+0000","last_fullsized":"2024-09-22T04:03:51.164239+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":847,"log_dups_size":0,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55508992,"num_objects":847,"num_object_clones":0,"num_object_copies":2541,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":847,"num_write_kb":54208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.9","version":"80'943","reported_seq":955,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:03:50.249321+0000","last_change":"2024-09-22T04:02:28.996162+0000","last_active":"2024-09-22T04:03:50.249321+0000","last_peered":"2024-09-22T04:03:50.249321+0000","last_clean":"2024-09-22T04:03:50.249321+0000","last_became_active":"2024-09-22T04:02:28.990154+0000","last_became_peered":"2024-09-22T04:02:28.990154+0000","last_unstale":"2024-09-22T04:03:50.249321+0000","last_undegraded":"2024-09-22T04:03:50.249321+0000","last_fullsized":"2024-09-22T04:03:50.249321+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":943,"log_dups_size":0,"ondisk_log_size":943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61800448,"num_objects":943,"num_object_clones":0,"num_object_copies":2829,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":943,"num_write_kb":60352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"80'942","reported_seq":954,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:03:50.186133+0000","last_change":"2024-09-22T04:02:28.902123+0000","last_active":"2024-09-22T04:03:50.186133+0000","last_peered":"2024-09-22T04:03:50.186133+0000","last_clean":"2024-09-22T04:03:50.186133+0000","last_became_active":"2024-09-22T04:02:28.895508+0000","last_became_peered":"2024-09-22T04:02:28.895508+0000","last_unstale":"2024-09-22T04:03:50.186133+0000","last_undegraded":"2024-09-22T04:03:50.186133+0000","last_fullsized":"2024-09-22T04:03:50.186133+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":942,"log_dups_size":0,"ondisk_log_size":942,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61734912,"num_objects":942,"num_object_clones":0,"num_object_copies":2826,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":942,"num_write_kb":60288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.6","version":"80'855","reported_seq":867,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:03:50.262003+0000","last_change":"2024-09-22T04:02:29.024059+0000","last_active":"2024-09-22T04:03:50.262003+0000","last_peered":"2024-09-22T04:03:50.262003+0000","last_clean":"2024-09-22T04:03:50.262003+0000","last_became_active":"2024-09-22T04:02:29.013699+0000","last_became_peered":"2024-09-22T04:02:29.013699+0000","last_unstale":"2024-09-22T04:03:50.262003+0000","last_undegraded":"2024-09-22T04:03:50.262003+0000","last_fullsized":"2024-09-22T04:03:50.262003+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":855,"log_dups_size":0,"ondisk_log_size":855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56033280,"num_objects":855,"num_object_clones":0,"num_object_copies":2565,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":855,"num_write_kb":54720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":283,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:29.819502+0000","last_change":"2024-09-22T03:49:12.034704+0000","last_active":"2024-09-22T04:02:29.819502+0000","last_peered":"2024-09-22T04:02:29.819502+0000","last_clean":"2024-09-22T04:02:29.819502+0000","last_became_active":"2024-09-22T03:49:12.027470+0000","last_became_peered":"2024-09-22T03:49:12.027470+0000","last_unstale":"2024-09-22T04:02:29.819502+0000","last_undegraded":"2024-09-22T04:02:29.819502+0000","last_fullsized":"2024-09-22T04:02:29.819502+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_clean_scrub_stamp":"2024-09-22T03:49:10.979949+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":209,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:29.818606+0000","last_change":"2024-09-22T03:49:17.031458+0000","last_active":"2024-09-22T04:02:29.818606+0000","last_peered":"2024-09-22T04:02:29.818606+0000","last_clean":"2024-09-22T04:02:29.818606+0000","last_became_active":"2024-09-22T03:49:15.125490+0000","last_became_peered":"2024-09-22T03:49:15.125490+0000","last_unstale":"2024-09-22T04:02:29.818606+0000","last_undegraded":"2024-09-22T04:02:29.818606+0000","last_fullsized":"2024-09-22T04:02:29.818606+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"80'891","reported_seq":903,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:03:49.677433+0000","last_change":"2024-09-22T04:02:28.912870+0000","last_active":"2024-09-22T04:03:49.677433+0000","last_peered":"2024-09-22T04:03:49.677433+0000","last_clean":"2024-09-22T04:03:49.677433+0000","last_became_active":"2024-09-22T04:02:28.905573+0000","last_became_peered":"2024-09-22T04:02:28.905573+0000","last_unstale":"2024-09-22T04:03:49.677433+0000","last_undegraded":"2024-09-22T04:03:49.677433+0000","last_fullsized":"2024-09-22T04:03:49.677433+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":891,"log_dups_size":0,"ondisk_log_size":891,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58392576,"num_objects":891,"num_object_clones":0,"num_object_copies":2673,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":891,"num_write_kb":57024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":208,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:29.815930+0000","last_change":"2024-09-22T03:49:17.029339+0000","last_active":"2024-09-22T04:02:29.815930+0000","last_peered":"2024-09-22T04:02:29.815930+0000","last_clean":"2024-09-22T04:02:29.815930+0000","last_became_active":"2024-09-22T03:49:15.097304+0000","last_became_peered":"2024-09-22T03:49:15.097304+0000","last_unstale":"2024-09-22T04:02:29.815930+0000","last_undegraded":"2024-09-22T04:02:29.815930+0000","last_fullsized":"2024-09-22T04:02:29.815930+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"80'881","reported_seq":893,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:03:50.162650+0000","last_change":"2024-09-22T04:02:28.928198+0000","last_active":"2024-09-22T04:03:50.162650+0000","last_peered":"2024-09-22T04:03:50.162650+0000","last_clean":"2024-09-22T04:03:50.162650+0000","last_became_active":"2024-09-22T04:02:28.909503+0000","last_became_peered":"2024-09-22T04:02:28.909503+0000","last_unstale":"2024-09-22T04:03:50.162650+0000","last_undegraded":"2024-09-22T04:03:50.162650+0000","last_fullsized":"2024-09-22T04:03:50.162650+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":881,"log_dups_size":0,"ondisk_log_size":881,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57737216,"num_objects":881,"num_object_clones":0,"num_object_copies":2643,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":881,"num_write_kb":56384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":208,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:29.822286+0000","last_change":"2024-09-22T03:49:17.029349+0000","last_active":"2024-09-22T04:02:29.822286+0000","last_peered":"2024-09-22T04:02:29.822286+0000","last_clean":"2024-09-22T04:02:29.822286+0000","last_became_active":"2024-09-22T03:49:15.094890+0000","last_became_peered":"2024-09-22T03:49:15.094890+0000","last_unstale":"2024-09-22T04:02:29.822286+0000","last_undegraded":"2024-09-22T04:02:29.822286+0000","last_fullsized":"2024-09-22T04:02:29.822286+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.7","version":"80'901","reported_seq":913,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:03:49.986214+0000","last_change":"2024-09-22T04:02:28.945388+0000","last_active":"2024-09-22T04:03:49.986214+0000","last_peered":"2024-09-22T04:03:49.986214+0000","last_clean":"2024-09-22T04:03:49.986214+0000","last_became_active":"2024-09-22T04:02:28.939479+0000","last_became_peered":"2024-09-22T04:02:28.939479+0000","last_unstale":"2024-09-22T04:03:49.986214+0000","last_undegraded":"2024-09-22T04:03:49.986214+0000","last_fullsized":"2024-09-22T04:03:49.986214+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":901,"log_dups_size":0,"ondisk_log_size":901,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59047936,"num_objects":901,"num_object_clones":0,"num_object_copies":2703,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":901,"num_write_kb":57664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":210,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:29.820716+0000","last_change":"2024-09-22T03:49:17.031466+0000","last_active":"2024-09-22T04:02:29.820716+0000","last_peered":"2024-09-22T04:02:29.820716+0000","last_clean":"2024-09-22T04:02:29.820716+0000","last_became_active":"2024-09-22T03:49:15.098420+0000","last_became_peered":"2024-09-22T03:49:15.098420+0000","last_unstale":"2024-09-22T04:02:29.820716+0000","last_undegraded":"2024-09-22T04:02:29.820716+0000","last_fullsized":"2024-09-22T04:02:29.820716+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1","version":"80'867","reported_seq":879,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:03:49.992797+0000","last_change":"2024-09-22T04:02:28.927518+0000","last_active":"2024-09-22T04:03:49.992797+0000","last_peered":"2024-09-22T04:03:49.992797+0000","last_clean":"2024-09-22T04:03:49.992797+0000","last_became_active":"2024-09-22T04:02:28.919323+0000","last_became_peered":"2024-09-22T04:02:28.919323+0000","last_unstale":"2024-09-22T04:03:49.992797+0000","last_undegraded":"2024-09-22T04:03:49.992797+0000","last_fullsized":"2024-09-22T04:03:49.992797+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":867,"log_dups_size":0,"ondisk_log_size":867,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56819712,"num_objects":867,"num_object_clones":0,"num_object_copies":2601,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":867,"num_write_kb":55488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":208,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:29.823311+0000","last_change":"2024-09-22T03:49:17.036954+0000","last_active":"2024-09-22T04:02:29.823311+0000","last_peered":"2024-09-22T04:02:29.823311+0000","last_clean":"2024-09-22T04:02:29.823311+0000","last_became_active":"2024-09-22T03:49:15.110506+0000","last_became_peered":"2024-09-22T03:49:15.110506+0000","last_unstale":"2024-09-22T04:02:29.823311+0000","last_undegraded":"2024-09-22T04:02:29.823311+0000","last_fullsized":"2024-09-22T04:02:29.823311+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"80'917","reported_seq":929,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:03:50.993747+0000","last_change":"2024-09-22T04:02:28.954190+0000","last_active":"2024-09-22T04:03:50.993747+0000","last_peered":"2024-09-22T04:03:50.993747+0000","last_clean":"2024-09-22T04:03:50.993747+0000","last_became_active":"2024-09-22T04:02:28.946807+0000","last_became_peered":"2024-09-22T04:02:28.946807+0000","last_unstale":"2024-09-22T04:03:50.993747+0000","last_undegraded":"2024-09-22T04:03:50.993747+0000","last_fullsized":"2024-09-22T04:03:50.993747+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":917,"log_dups_size":0,"ondisk_log_size":917,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60096512,"num_objects":917,"num_object_clones":0,"num_object_copies":2751,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":917,"num_write_kb":58688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":208,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:29.820857+0000","last_change":"2024-09-22T03:49:17.032989+0000","last_active":"2024-09-22T04:02:29.820857+0000","last_peered":"2024-09-22T04:02:29.820857+0000","last_clean":"2024-09-22T04:02:29.820857+0000","last_became_active":"2024-09-22T03:49:15.079260+0000","last_became_peered":"2024-09-22T03:49:15.079260+0000","last_unstale":"2024-09-22T04:02:29.820857+0000","last_undegraded":"2024-09-22T04:02:29.820857+0000","last_fullsized":"2024-09-22T04:02:29.820857+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3","version":"80'856","reported_seq":868,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:03:50.313742+0000","last_change":"2024-09-22T04:02:28.924084+0000","last_active":"2024-09-22T04:03:50.313742+0000","last_peered":"2024-09-22T04:03:50.313742+0000","last_clean":"2024-09-22T04:03:50.313742+0000","last_became_active":"2024-09-22T04:02:28.898697+0000","last_became_peered":"2024-09-22T04:02:28.898697+0000","last_unstale":"2024-09-22T04:03:50.313742+0000","last_undegraded":"2024-09-22T04:03:50.313742+0000","last_fullsized":"2024-09-22T04:03:50.313742+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":856,"log_dups_size":0,"ondisk_log_size":856,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56098816,"num_objects":856,"num_object_clones":0,"num_object_copies":2568,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":856,"num_write_kb":54784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":208,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:29.823587+0000","last_change":"2024-09-22T03:49:17.036402+0000","last_active":"2024-09-22T04:02:29.823587+0000","last_peered":"2024-09-22T04:02:29.823587+0000","last_clean":"2024-09-22T04:02:29.823587+0000","last_became_active":"2024-09-22T03:49:15.108430+0000","last_became_peered":"2024-09-22T03:49:15.108430+0000","last_unstale":"2024-09-22T04:02:29.823587+0000","last_undegraded":"2024-09-22T04:02:29.823587+0000","last_fullsized":"2024-09-22T04:02:29.823587+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"80'888","reported_seq":900,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:03:50.170540+0000","last_change":"2024-09-22T04:02:29.018532+0000","last_active":"2024-09-22T04:03:50.170540+0000","last_peered":"2024-09-22T04:03:50.170540+0000","last_clean":"2024-09-22T04:03:50.170540+0000","last_became_active":"2024-09-22T04:02:29.006046+0000","last_became_peered":"2024-09-22T04:02:29.006046+0000","last_unstale":"2024-09-22T04:03:50.170540+0000","last_undegraded":"2024-09-22T04:03:50.170540+0000","last_fullsized":"2024-09-22T04:03:50.170540+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":888,"log_dups_size":0,"ondisk_log_size":888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58195968,"num_objects":888,"num_object_clones":0,"num_object_copies":2664,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":888,"num_write_kb":56832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":208,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:29.815415+0000","last_change":"2024-09-22T03:49:17.029128+0000","last_active":"2024-09-22T04:02:29.815415+0000","last_peered":"2024-09-22T04:02:29.815415+0000","last_clean":"2024-09-22T04:02:29.815415+0000","last_became_active":"2024-09-22T03:49:15.113396+0000","last_became_peered":"2024-09-22T03:49:15.113396+0000","last_unstale":"2024-09-22T04:02:29.815415+0000","last_undegraded":"2024-09-22T04:02:29.815415+0000","last_fullsized":"2024-09-22T04:02:29.815415+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":929955840,"num_objects":14190,"num_object_clones":0,"num_object_copies":42570,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14190,"num_write_kb":908160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":174047232,"data_stored":2784755712,"data_compressed":132231771,"data_compressed_allocated":174047232,"data_compressed_original":2784755712,"omap_allocated":0,"internal_metadata":0},"log_size":14190,"ondisk_log_size":14190,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949673838,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":149468,"kb_used_data":32396,"kb_used_omap":0,"kb_used_meta":117056,"kb_avail":94222372,"statfs":{"total":96636764160,"available":96483708928,"internally_reserved":0,"allocated":33173504,"data_stored":519755594,"data_compressed":24670266,"data_compressed_allocated":32473088,"data_compressed_original":519487488,"omap_allocated":0,"internal_metadata":119865344},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654706542,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":76752,"kb_used_data":46400,"kb_used_omap":0,"kb_used_meta":30336,"kb_avail":94295088,"statfs":{"total":96636764160,"available":96558170112,"internally_reserved":0,"allocated":47513600,"data_stored":749589802,"data_compressed":35581694,"data_compressed_allocated":46833664,"data_compressed_original":749338624,"omap_allocated":0,"internal_metadata":31064064},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706541,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":70124,"kb_used_data":39516,"kb_used_omap":0,"kb_used_meta":30592,"kb_avail":94301716,"statfs":{"total":96636764160,"available":96564957184,"internally_reserved":0,"allocated":40464384,"data_stored":636409674,"data_compressed":30209469,"data_compressed_allocated":39763968,"data_compressed_original":636141568,"omap_allocated":0,"internal_metadata":31326208},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706541,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":92700,"kb_used_data":53324,"kb_used_omap":0,"kb_used_meta":39360,"kb_avail":94279140,"statfs":{"total":96636764160,"available":96541839360,"internally_reserved":0,"allocated":54603776,"data_stored":862705463,"data_compressed":40954918,"data_compressed_allocated":53907456,"data_compressed_original":862437376,"omap_allocated":0,"internal_metadata":40304640},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":54362112,"data_stored":869793792,"data_compressed":41301414,"data_compressed_allocated":54362112,"data_compressed_original":869793792,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32526336,"data_stored":520421376,"data_compressed":24711786,"data_compressed_allocated":32526336,"data_compressed_original":520421376,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40034304,"data_stored":640548864,"data_compressed":30415925,"data_compressed_allocated":40034304,"data_compressed_original":640548864,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":47124480,"data_stored":753991680,"data_compressed":35802646,"data_compressed_allocated":47124480,"data_compressed_original":753991680,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T04:03:57.887 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 88 16 15388 15372 10.9166 10.375 0.0800084 0.0915625 2024-09-22T04:03:58.323 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T04:03:58.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:03:58.497+0000 7fa3c8951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:03:58.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:03:58.508+0000 7fa3c8951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:03:58.887 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 89 16 15541 15525 10.9014 9.5625 0.0703615 0.0916736 2024-09-22T04:03:59.887 INFO:tasks.radosbench.radosbench.0.smithi037.stdout: 90 16 15697 15681 10.8886 9.75 0.0724215 0.0917565 2024-09-22T04:04:00.741 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T04:04:00.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:04:00.864+0000 7f2ebc391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:04:00.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:04:00.871+0000 7f2ebc391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:04:00.887 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Total time run: 90.0528 2024-09-22T04:04:00.887 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Total writes made: 15697 2024-09-22T04:04:00.887 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Write size: 65536 2024-09-22T04:04:00.887 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Object size: 65536 2024-09-22T04:04:00.887 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Bandwidth (MB/sec): 10.8943 2024-09-22T04:04:00.888 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Stddev Bandwidth: 0.831749 2024-09-22T04:04:00.888 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Max bandwidth (MB/sec): 13.25 2024-09-22T04:04:00.888 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Min bandwidth (MB/sec): 8.6875 2024-09-22T04:04:00.888 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Average IOPS: 174 2024-09-22T04:04:00.888 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Stddev IOPS: 13.308 2024-09-22T04:04:00.888 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Max IOPS: 212 2024-09-22T04:04:00.888 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Min IOPS: 139 2024-09-22T04:04:00.888 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Average Latency(s): 0.0917705 2024-09-22T04:04:00.888 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Stddev Latency(s): 0.0352537 2024-09-22T04:04:00.888 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Max latency(s): 0.222626 2024-09-22T04:04:00.888 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Min latency(s): 0.0179924 2024-09-22T04:04:00.918 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Cleaning up (deleting benchmark objects) 2024-09-22T04:04:02.105 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T04:04:02.105 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T04:04:02.105 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T04:04:02.106 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T04:04:02.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:04:02.259+0000 7f93734a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:04:02.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:04:02.277+0000 7f93734a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:04:02.519 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:04:02.519 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:04:02.519 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:04:02.519 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:04:02.519 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:04:02.519 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:04:02.519 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:04:02.520 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:04:02.520 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:04:02.520 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:04:02.520 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:04:02.520 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:04:02.524 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:04:02.524 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:04:02.524 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T04:04:02.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:04:02.663+0000 7ffb03d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:04:02.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:04:02.677+0000 7ffb03d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:04:02.701 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:04:02.702 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:04:02.702 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:04:02.702 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:04:02.702 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:04:02.702 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:04:02.702 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:04:02.702 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:04:02.702 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:04:02.702 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:04:02.702 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:04:02.702 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:04:02.706 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:04:02.706 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:04:02.707 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T04:04:02.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:04:02.859+0000 7f8250711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:04:02.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:04:02.873+0000 7f8250711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:04:02.917 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:04:02.917 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:04:02.917 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:04:02.918 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:04:02.918 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:04:02.918 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:04:02.918 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:04:02.918 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:04:02.918 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:04:02.918 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:04:02.918 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:04:02.918 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:04:02.922 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:04:02.923 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:04:02.923 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T04:04:03.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:04:03.082+0000 7f8e0ae6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:04:03.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:04:03.101+0000 7f8e0ae6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:04:03.159 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:04:03.159 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:04:03.159 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:04:03.159 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:04:03.159 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:04:03.159 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:04:03.159 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:04:03.159 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:04:03.159 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:04:03.159 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:04:03.159 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:04:03.160 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:04:03.162 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:04:03.163 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:04:03.191 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T04:04:03.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:04:03.343+0000 7f7a1cb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:04:03.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:04:03.353+0000 7f7a1cb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:04:05.701 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T04:04:05.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:04:05.863+0000 7ff58f297640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:04:05.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:04:05.874+0000 7ff58f297640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:04:08.164 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T04:04:08.164 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T04:04:08.165 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T04:04:08.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:04:08.328+0000 7f7e3d751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:04:08.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:04:08.345+0000 7f7e3d751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:04:08.596 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T04:04:08.682 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T04:04:08.682 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-22T04:04:08.705 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":522,"stamp":"2024-09-22T04:04:07.151991+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":974258763,"num_objects":14862,"num_object_clones":0,"num_object_copies":44586,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":16619,"num_write_kb":1005717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16593,"ondisk_log_size":16593,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":425060,"kb_used_data":182692,"kb_used_omap":0,"kb_used_meta":242304,"kb_avail":377062300,"statfs":{"total":386547056640,"available":386111795200,"internally_reserved":0,"allocated":187076608,"data_stored":2949405501,"data_compressed":140011038,"data_compressed_allocated":184287232,"data_compressed_original":2948349952,"omap_allocated":0,"internal_metadata":248119296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":43712536,"num_objects":668,"num_object_clones":0,"num_object_copies":2004,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2348,"num_write_kb":96449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002482"},"pg_stats":[{"pgid":"7.f","version":"80'977","reported_seq":989,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:04:05.244995+0000","last_change":"2024-09-22T04:02:28.979477+0000","last_active":"2024-09-22T04:04:05.244995+0000","last_peered":"2024-09-22T04:04:05.244995+0000","last_clean":"2024-09-22T04:04:05.244995+0000","last_became_active":"2024-09-22T04:02:28.971367+0000","last_became_peered":"2024-09-22T04:02:28.971367+0000","last_unstale":"2024-09-22T04:04:05.244995+0000","last_undegraded":"2024-09-22T04:04:05.244995+0000","last_fullsized":"2024-09-22T04:04:05.244995+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":977,"log_dups_size":0,"ondisk_log_size":977,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57999360,"num_objects":885,"num_object_clones":0,"num_object_copies":2655,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":977,"num_write_kb":59584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"80'1025","reported_seq":1037,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:04:05.005194+0000","last_change":"2024-09-22T04:02:28.872853+0000","last_active":"2024-09-22T04:04:05.005194+0000","last_peered":"2024-09-22T04:04:05.005194+0000","last_clean":"2024-09-22T04:04:05.005194+0000","last_became_active":"2024-09-22T04:02:28.865538+0000","last_became_peered":"2024-09-22T04:02:28.865538+0000","last_unstale":"2024-09-22T04:04:05.005194+0000","last_undegraded":"2024-09-22T04:04:05.005194+0000","last_fullsized":"2024-09-22T04:04:05.005194+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1025,"log_dups_size":0,"ondisk_log_size":1025,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61407232,"num_objects":937,"num_object_clones":0,"num_object_copies":2811,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1025,"num_write_kb":62784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.d","version":"80'1054","reported_seq":1067,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:04:06.242594+0000","last_change":"2024-09-22T04:02:28.967443+0000","last_active":"2024-09-22T04:04:06.242594+0000","last_peered":"2024-09-22T04:04:06.242594+0000","last_clean":"2024-09-22T04:04:06.242594+0000","last_became_active":"2024-09-22T04:02:28.959444+0000","last_became_peered":"2024-09-22T04:02:28.959444+0000","last_unstale":"2024-09-22T04:04:06.242594+0000","last_undegraded":"2024-09-22T04:04:06.242594+0000","last_fullsized":"2024-09-22T04:04:06.242594+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1054,"log_dups_size":0,"ondisk_log_size":1054,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61407256,"num_objects":938,"num_object_clones":0,"num_object_copies":2814,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1054,"num_write_kb":63681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"80'1018","reported_seq":1030,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:04:04.794685+0000","last_change":"2024-09-22T04:02:28.963918+0000","last_active":"2024-09-22T04:04:04.794685+0000","last_peered":"2024-09-22T04:04:04.794685+0000","last_clean":"2024-09-22T04:04:04.794685+0000","last_became_active":"2024-09-22T04:02:28.948540+0000","last_became_peered":"2024-09-22T04:02:28.948540+0000","last_unstale":"2024-09-22T04:04:04.794685+0000","last_undegraded":"2024-09-22T04:04:04.794685+0000","last_fullsized":"2024-09-22T04:04:04.794685+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1018,"log_dups_size":0,"ondisk_log_size":1018,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59506688,"num_objects":908,"num_object_clones":0,"num_object_copies":2724,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1018,"num_write_kb":61632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"80'1062","reported_seq":1074,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:04:06.204941+0000","last_change":"2024-09-22T04:02:28.971728+0000","last_active":"2024-09-22T04:04:06.204941+0000","last_peered":"2024-09-22T04:04:06.204941+0000","last_clean":"2024-09-22T04:04:06.204941+0000","last_became_active":"2024-09-22T04:02:28.960293+0000","last_became_peered":"2024-09-22T04:02:28.960293+0000","last_unstale":"2024-09-22T04:04:06.204941+0000","last_undegraded":"2024-09-22T04:04:06.204941+0000","last_fullsized":"2024-09-22T04:04:06.204941+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1062,"log_dups_size":0,"ondisk_log_size":1062,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60293120,"num_objects":920,"num_object_clones":0,"num_object_copies":2760,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1062,"num_write_kb":63424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"80'1007","reported_seq":1019,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:04:05.950696+0000","last_change":"2024-09-22T04:02:29.026441+0000","last_active":"2024-09-22T04:04:05.950696+0000","last_peered":"2024-09-22T04:04:05.950696+0000","last_clean":"2024-09-22T04:04:05.950696+0000","last_became_active":"2024-09-22T04:02:28.991656+0000","last_became_peered":"2024-09-22T04:02:28.991656+0000","last_unstale":"2024-09-22T04:04:05.950696+0000","last_undegraded":"2024-09-22T04:04:05.950696+0000","last_fullsized":"2024-09-22T04:04:05.950696+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1007,"log_dups_size":0,"ondisk_log_size":1007,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57737216,"num_objects":881,"num_object_clones":0,"num_object_copies":2643,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1007,"num_write_kb":60416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.9","version":"80'1097","reported_seq":1109,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:04:05.072506+0000","last_change":"2024-09-22T04:02:28.996162+0000","last_active":"2024-09-22T04:04:05.072506+0000","last_peered":"2024-09-22T04:04:05.072506+0000","last_clean":"2024-09-22T04:04:05.072506+0000","last_became_active":"2024-09-22T04:02:28.990154+0000","last_became_peered":"2024-09-22T04:02:28.990154+0000","last_unstale":"2024-09-22T04:04:05.072506+0000","last_undegraded":"2024-09-22T04:04:05.072506+0000","last_fullsized":"2024-09-22T04:04:05.072506+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1097,"log_dups_size":0,"ondisk_log_size":1097,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65077248,"num_objects":993,"num_object_clones":0,"num_object_copies":2979,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1097,"num_write_kb":66880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"80'1114","reported_seq":1126,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:04:05.181176+0000","last_change":"2024-09-22T04:02:28.902123+0000","last_active":"2024-09-22T04:04:05.181176+0000","last_peered":"2024-09-22T04:04:05.181176+0000","last_clean":"2024-09-22T04:04:05.181176+0000","last_became_active":"2024-09-22T04:02:28.895508+0000","last_became_peered":"2024-09-22T04:02:28.895508+0000","last_unstale":"2024-09-22T04:04:05.181176+0000","last_undegraded":"2024-09-22T04:04:05.181176+0000","last_fullsized":"2024-09-22T04:04:05.181176+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1114,"log_dups_size":0,"ondisk_log_size":1114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65273856,"num_objects":996,"num_object_clones":0,"num_object_copies":2988,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1114,"num_write_kb":67520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.6","version":"80'983","reported_seq":995,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:04:05.217849+0000","last_change":"2024-09-22T04:02:29.024059+0000","last_active":"2024-09-22T04:04:05.217849+0000","last_peered":"2024-09-22T04:04:05.217849+0000","last_clean":"2024-09-22T04:04:05.217849+0000","last_became_active":"2024-09-22T04:02:29.013699+0000","last_became_peered":"2024-09-22T04:02:29.013699+0000","last_unstale":"2024-09-22T04:04:05.217849+0000","last_undegraded":"2024-09-22T04:04:05.217849+0000","last_fullsized":"2024-09-22T04:04:05.217849+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":983,"log_dups_size":0,"ondisk_log_size":983,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57212928,"num_objects":873,"num_object_clones":0,"num_object_copies":2619,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":983,"num_write_kb":59392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":283,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:29.819502+0000","last_change":"2024-09-22T03:49:12.034704+0000","last_active":"2024-09-22T04:02:29.819502+0000","last_peered":"2024-09-22T04:02:29.819502+0000","last_clean":"2024-09-22T04:02:29.819502+0000","last_became_active":"2024-09-22T03:49:12.027470+0000","last_became_peered":"2024-09-22T03:49:12.027470+0000","last_unstale":"2024-09-22T04:02:29.819502+0000","last_undegraded":"2024-09-22T04:02:29.819502+0000","last_fullsized":"2024-09-22T04:02:29.819502+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_clean_scrub_stamp":"2024-09-22T03:49:10.979949+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":209,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:29.818606+0000","last_change":"2024-09-22T03:49:17.031458+0000","last_active":"2024-09-22T04:02:29.818606+0000","last_peered":"2024-09-22T04:02:29.818606+0000","last_clean":"2024-09-22T04:02:29.818606+0000","last_became_active":"2024-09-22T03:49:15.125490+0000","last_became_peered":"2024-09-22T03:49:15.125490+0000","last_unstale":"2024-09-22T04:02:29.818606+0000","last_undegraded":"2024-09-22T04:02:29.818606+0000","last_fullsized":"2024-09-22T04:02:29.818606+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"80'1040","reported_seq":1052,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:04:05.040238+0000","last_change":"2024-09-22T04:02:28.912870+0000","last_active":"2024-09-22T04:04:05.040238+0000","last_peered":"2024-09-22T04:04:05.040238+0000","last_clean":"2024-09-22T04:04:05.040238+0000","last_became_active":"2024-09-22T04:02:28.905573+0000","last_became_peered":"2024-09-22T04:02:28.905573+0000","last_unstale":"2024-09-22T04:04:05.040238+0000","last_undegraded":"2024-09-22T04:04:05.040238+0000","last_fullsized":"2024-09-22T04:04:05.040238+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1040,"log_dups_size":0,"ondisk_log_size":1040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61997056,"num_objects":946,"num_object_clones":0,"num_object_copies":2838,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1040,"num_write_kb":63552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":208,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:29.815930+0000","last_change":"2024-09-22T03:49:17.029339+0000","last_active":"2024-09-22T04:02:29.815930+0000","last_peered":"2024-09-22T04:02:29.815930+0000","last_clean":"2024-09-22T04:02:29.815930+0000","last_became_active":"2024-09-22T03:49:15.097304+0000","last_became_peered":"2024-09-22T03:49:15.097304+0000","last_unstale":"2024-09-22T04:02:29.815930+0000","last_undegraded":"2024-09-22T04:02:29.815930+0000","last_fullsized":"2024-09-22T04:02:29.815930+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"80'1018","reported_seq":1030,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:04:05.177373+0000","last_change":"2024-09-22T04:02:28.928198+0000","last_active":"2024-09-22T04:04:05.177373+0000","last_peered":"2024-09-22T04:04:05.177373+0000","last_clean":"2024-09-22T04:04:05.177373+0000","last_became_active":"2024-09-22T04:02:28.909503+0000","last_became_peered":"2024-09-22T04:02:28.909503+0000","last_unstale":"2024-09-22T04:04:05.177373+0000","last_undegraded":"2024-09-22T04:04:05.177373+0000","last_fullsized":"2024-09-22T04:04:05.177373+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1018,"log_dups_size":0,"ondisk_log_size":1018,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60686336,"num_objects":926,"num_object_clones":0,"num_object_copies":2778,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1018,"num_write_kb":62208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":208,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:29.822286+0000","last_change":"2024-09-22T03:49:17.029349+0000","last_active":"2024-09-22T04:02:29.822286+0000","last_peered":"2024-09-22T04:02:29.822286+0000","last_clean":"2024-09-22T04:02:29.822286+0000","last_became_active":"2024-09-22T03:49:15.094890+0000","last_became_peered":"2024-09-22T03:49:15.094890+0000","last_unstale":"2024-09-22T04:02:29.822286+0000","last_undegraded":"2024-09-22T04:02:29.822286+0000","last_fullsized":"2024-09-22T04:02:29.822286+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.7","version":"80'1047","reported_seq":1059,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:04:05.030632+0000","last_change":"2024-09-22T04:02:28.945388+0000","last_active":"2024-09-22T04:04:05.030632+0000","last_peered":"2024-09-22T04:04:05.030632+0000","last_clean":"2024-09-22T04:04:05.030632+0000","last_became_active":"2024-09-22T04:02:28.939479+0000","last_became_peered":"2024-09-22T04:02:28.939479+0000","last_unstale":"2024-09-22T04:04:05.030632+0000","last_undegraded":"2024-09-22T04:04:05.030632+0000","last_fullsized":"2024-09-22T04:04:05.030632+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1047,"log_dups_size":0,"ondisk_log_size":1047,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60882944,"num_objects":929,"num_object_clones":0,"num_object_copies":2787,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1047,"num_write_kb":63232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":210,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:29.820716+0000","last_change":"2024-09-22T03:49:17.031466+0000","last_active":"2024-09-22T04:02:29.820716+0000","last_peered":"2024-09-22T04:02:29.820716+0000","last_clean":"2024-09-22T04:02:29.820716+0000","last_became_active":"2024-09-22T03:49:15.098420+0000","last_became_peered":"2024-09-22T03:49:15.098420+0000","last_unstale":"2024-09-22T04:02:29.820716+0000","last_undegraded":"2024-09-22T04:02:29.820716+0000","last_fullsized":"2024-09-22T04:02:29.820716+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1","version":"80'1004","reported_seq":1016,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:04:04.644422+0000","last_change":"2024-09-22T04:02:28.927518+0000","last_active":"2024-09-22T04:04:04.644422+0000","last_peered":"2024-09-22T04:04:04.644422+0000","last_clean":"2024-09-22T04:04:04.644422+0000","last_became_active":"2024-09-22T04:02:28.919323+0000","last_became_peered":"2024-09-22T04:02:28.919323+0000","last_unstale":"2024-09-22T04:04:04.644422+0000","last_undegraded":"2024-09-22T04:04:04.644422+0000","last_fullsized":"2024-09-22T04:04:04.644422+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1004,"log_dups_size":0,"ondisk_log_size":1004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60293120,"num_objects":920,"num_object_clones":0,"num_object_copies":2760,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1004,"num_write_kb":61568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":208,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:29.823311+0000","last_change":"2024-09-22T03:49:17.036954+0000","last_active":"2024-09-22T04:02:29.823311+0000","last_peered":"2024-09-22T04:02:29.823311+0000","last_clean":"2024-09-22T04:02:29.823311+0000","last_became_active":"2024-09-22T03:49:15.110506+0000","last_became_peered":"2024-09-22T03:49:15.110506+0000","last_unstale":"2024-09-22T04:02:29.823311+0000","last_undegraded":"2024-09-22T04:02:29.823311+0000","last_fullsized":"2024-09-22T04:02:29.823311+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"80'1085","reported_seq":1097,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:04:05.919672+0000","last_change":"2024-09-22T04:02:28.954190+0000","last_active":"2024-09-22T04:04:05.919672+0000","last_peered":"2024-09-22T04:04:05.919672+0000","last_clean":"2024-09-22T04:04:05.919672+0000","last_became_active":"2024-09-22T04:02:28.946807+0000","last_became_peered":"2024-09-22T04:02:28.946807+0000","last_unstale":"2024-09-22T04:04:05.919672+0000","last_undegraded":"2024-09-22T04:04:05.919672+0000","last_fullsized":"2024-09-22T04:04:05.919672+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1085,"log_dups_size":0,"ondisk_log_size":1085,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63373312,"num_objects":967,"num_object_clones":0,"num_object_copies":2901,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1085,"num_write_kb":65664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":208,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:29.820857+0000","last_change":"2024-09-22T03:49:17.032989+0000","last_active":"2024-09-22T04:02:29.820857+0000","last_peered":"2024-09-22T04:02:29.820857+0000","last_clean":"2024-09-22T04:02:29.820857+0000","last_became_active":"2024-09-22T03:49:15.079260+0000","last_became_peered":"2024-09-22T03:49:15.079260+0000","last_unstale":"2024-09-22T04:02:29.820857+0000","last_undegraded":"2024-09-22T04:02:29.820857+0000","last_fullsized":"2024-09-22T04:02:29.820857+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3","version":"80'988","reported_seq":1000,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:04:05.047852+0000","last_change":"2024-09-22T04:02:28.924084+0000","last_active":"2024-09-22T04:04:05.047852+0000","last_peered":"2024-09-22T04:04:05.047852+0000","last_clean":"2024-09-22T04:04:05.047852+0000","last_became_active":"2024-09-22T04:02:28.898697+0000","last_became_peered":"2024-09-22T04:02:28.898697+0000","last_unstale":"2024-09-22T04:04:05.047852+0000","last_undegraded":"2024-09-22T04:04:05.047852+0000","last_fullsized":"2024-09-22T04:04:05.047852+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":988,"log_dups_size":0,"ondisk_log_size":988,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58851328,"num_objects":898,"num_object_clones":0,"num_object_copies":2694,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":988,"num_write_kb":60352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":208,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:29.823587+0000","last_change":"2024-09-22T03:49:17.036402+0000","last_active":"2024-09-22T04:02:29.823587+0000","last_peered":"2024-09-22T04:02:29.823587+0000","last_clean":"2024-09-22T04:02:29.823587+0000","last_became_active":"2024-09-22T03:49:15.108430+0000","last_became_peered":"2024-09-22T03:49:15.108430+0000","last_unstale":"2024-09-22T04:02:29.823587+0000","last_undegraded":"2024-09-22T04:02:29.823587+0000","last_fullsized":"2024-09-22T04:02:29.823587+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"80'1019","reported_seq":1031,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:04:05.265169+0000","last_change":"2024-09-22T04:02:29.018532+0000","last_active":"2024-09-22T04:04:05.265169+0000","last_peered":"2024-09-22T04:04:05.265169+0000","last_clean":"2024-09-22T04:04:05.265169+0000","last_became_active":"2024-09-22T04:02:29.006046+0000","last_became_peered":"2024-09-22T04:02:29.006046+0000","last_unstale":"2024-09-22T04:04:05.265169+0000","last_undegraded":"2024-09-22T04:04:05.265169+0000","last_fullsized":"2024-09-22T04:04:05.265169+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1019,"log_dups_size":0,"ondisk_log_size":1019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61669376,"num_objects":941,"num_object_clones":0,"num_object_copies":2823,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1019,"num_write_kb":62720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":208,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:29.815415+0000","last_change":"2024-09-22T03:49:17.029128+0000","last_active":"2024-09-22T04:02:29.815415+0000","last_peered":"2024-09-22T04:02:29.815415+0000","last_clean":"2024-09-22T04:02:29.815415+0000","last_became_active":"2024-09-22T03:49:15.113396+0000","last_became_peered":"2024-09-22T03:49:15.113396+0000","last_unstale":"2024-09-22T04:02:29.815415+0000","last_undegraded":"2024-09-22T04:02:29.815415+0000","last_fullsized":"2024-09-22T04:02:29.815415+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":973668376,"num_objects":14858,"num_object_clones":0,"num_object_copies":44574,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":16538,"num_write_kb":1004609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":182792192,"data_stored":2924478536,"data_compressed":138869352,"data_compressed_allocated":182779904,"data_compressed_original":2924478464,"omap_allocated":0,"internal_metadata":0},"log_size":16538,"ondisk_log_size":16538,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949673853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":154860,"kb_used_data":33628,"kb_used_omap":0,"kb_used_meta":121216,"kb_avail":94216980,"statfs":{"total":96636764160,"available":96478187520,"internally_reserved":0,"allocated":34435072,"data_stored":539875170,"data_compressed":25626232,"data_compressed_allocated":33730560,"data_compressed_original":539607040,"omap_allocated":0,"internal_metadata":124125184},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654706557,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":88264,"kb_used_data":49592,"kb_used_omap":0,"kb_used_meta":38656,"kb_avail":94283576,"statfs":{"total":96636764160,"available":96546381824,"internally_reserved":0,"allocated":50782208,"data_stored":801822018,"data_compressed":38062610,"data_compressed_allocated":50098176,"data_compressed_original":801570816,"omap_allocated":0,"internal_metadata":39583744},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706556,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":77144,"kb_used_data":42376,"kb_used_omap":0,"kb_used_meta":34752,"kb_avail":94294696,"statfs":{"total":96636764160,"available":96557768704,"internally_reserved":0,"allocated":43393024,"data_stored":683267914,"data_compressed":32435047,"data_compressed_allocated":42692608,"data_compressed_original":682999808,"omap_allocated":0,"internal_metadata":35586048},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706556,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":104792,"kb_used_data":57096,"kb_used_omap":0,"kb_used_meta":47680,"kb_avail":94267048,"statfs":{"total":96636764160,"available":96529457152,"internally_reserved":0,"allocated":58466304,"data_stored":924440399,"data_compressed":43887149,"data_compressed_allocated":57765888,"data_compressed_original":924172288,"omap_allocated":0,"internal_metadata":48824320},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57180160,"data_stored":914817048,"data_compressed":43440219,"data_compressed_allocated":57176064,"data_compressed_original":914817024,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":33603584,"data_stored":537591832,"data_compressed":25527734,"data_compressed_allocated":33599488,"data_compressed_original":537591808,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":42168320,"data_stored":674693120,"data_compressed":32037893,"data_compressed_allocated":42168320,"data_compressed_original":674693120,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49840128,"data_stored":797376536,"data_compressed":37863506,"data_compressed_allocated":49836032,"data_compressed_original":797376512,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T04:04:08.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:04:08.765+0000 7f4623391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:04:08.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:04:08.778+0000 7f4623391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:04:11.264 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T04:04:11.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:04:11.428+0000 7f03f44bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:04:11.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:04:11.438+0000 7f03f44bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:04:13.707 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T04:04:13.707 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T04:04:13.708 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T04:04:13.861 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T04:04:13.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:04:13.860+0000 7f6cb32d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:04:13.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:04:13.874+0000 7f6cb32d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:04:14.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:04:14.026+0000 7feab8afd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:04:14.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:04:14.040+0000 7feab8afd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:04:14.205 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T04:04:14.207 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-22T04:04:14.225 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":525,"stamp":"2024-09-22T04:04:13.153220+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":912720459,"num_objects":13923,"num_object_clones":0,"num_object_copies":41769,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":17558,"num_write_kb":1005717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17532,"ondisk_log_size":17532,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":409904,"kb_used_data":171692,"kb_used_omap":0,"kb_used_meta":238144,"kb_avail":377077456,"statfs":{"total":386547056640,"available":386127314944,"internally_reserved":0,"allocated":175812608,"data_stored":2769181501,"data_compressed":131453909,"data_compressed_allocated":173023232,"data_compressed_original":2768125952,"omap_allocated":0,"internal_metadata":243859456},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-106823656,"num_objects":-1629,"num_object_clones":0,"num_object_copies":-4887,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1929,"num_write_kb":9537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002505"},"pg_stats":[{"pgid":"7.f","version":"80'1048","reported_seq":1060,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:04:10.283698+0000","last_change":"2024-09-22T04:02:28.979477+0000","last_active":"2024-09-22T04:04:10.283698+0000","last_peered":"2024-09-22T04:04:10.283698+0000","last_clean":"2024-09-22T04:04:10.283698+0000","last_became_active":"2024-09-22T04:02:28.971367+0000","last_became_peered":"2024-09-22T04:02:28.971367+0000","last_unstale":"2024-09-22T04:04:10.283698+0000","last_undegraded":"2024-09-22T04:04:10.283698+0000","last_fullsized":"2024-09-22T04:04:10.283698+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1048,"log_dups_size":0,"ondisk_log_size":1048,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53346304,"num_objects":814,"num_object_clones":0,"num_object_copies":2442,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1048,"num_write_kb":59584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"80'1078","reported_seq":1090,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:04:10.194049+0000","last_change":"2024-09-22T04:02:28.872853+0000","last_active":"2024-09-22T04:04:10.194049+0000","last_peered":"2024-09-22T04:04:10.194049+0000","last_clean":"2024-09-22T04:04:10.194049+0000","last_became_active":"2024-09-22T04:02:28.865538+0000","last_became_peered":"2024-09-22T04:02:28.865538+0000","last_unstale":"2024-09-22T04:04:10.194049+0000","last_undegraded":"2024-09-22T04:04:10.194049+0000","last_fullsized":"2024-09-22T04:04:10.194049+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1078,"log_dups_size":0,"ondisk_log_size":1078,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57933824,"num_objects":884,"num_object_clones":0,"num_object_copies":2652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1078,"num_write_kb":62784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.d","version":"80'1109","reported_seq":1122,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:04:10.984811+0000","last_change":"2024-09-22T04:02:28.967443+0000","last_active":"2024-09-22T04:04:10.984811+0000","last_peered":"2024-09-22T04:04:10.984811+0000","last_clean":"2024-09-22T04:04:10.984811+0000","last_became_active":"2024-09-22T04:02:28.959444+0000","last_became_peered":"2024-09-22T04:02:28.959444+0000","last_unstale":"2024-09-22T04:04:10.984811+0000","last_undegraded":"2024-09-22T04:04:10.984811+0000","last_fullsized":"2024-09-22T04:04:10.984811+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1109,"log_dups_size":0,"ondisk_log_size":1109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57802776,"num_objects":883,"num_object_clones":0,"num_object_copies":2649,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1109,"num_write_kb":63681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"80'1067","reported_seq":1079,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:04:10.281960+0000","last_change":"2024-09-22T04:02:28.963918+0000","last_active":"2024-09-22T04:04:10.281960+0000","last_peered":"2024-09-22T04:04:10.281960+0000","last_clean":"2024-09-22T04:04:10.281960+0000","last_became_active":"2024-09-22T04:02:28.948540+0000","last_became_peered":"2024-09-22T04:02:28.948540+0000","last_unstale":"2024-09-22T04:04:10.281960+0000","last_undegraded":"2024-09-22T04:04:10.281960+0000","last_fullsized":"2024-09-22T04:04:10.281960+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1067,"log_dups_size":0,"ondisk_log_size":1067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56295424,"num_objects":859,"num_object_clones":0,"num_object_copies":2577,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1067,"num_write_kb":61632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"80'1111","reported_seq":1123,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:04:11.194078+0000","last_change":"2024-09-22T04:02:28.971728+0000","last_active":"2024-09-22T04:04:11.194078+0000","last_peered":"2024-09-22T04:04:11.194078+0000","last_clean":"2024-09-22T04:04:11.194078+0000","last_became_active":"2024-09-22T04:02:28.960293+0000","last_became_peered":"2024-09-22T04:02:28.960293+0000","last_unstale":"2024-09-22T04:04:11.194078+0000","last_undegraded":"2024-09-22T04:04:11.194078+0000","last_fullsized":"2024-09-22T04:04:11.194078+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1111,"log_dups_size":0,"ondisk_log_size":1111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57081856,"num_objects":871,"num_object_clones":0,"num_object_copies":2613,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1111,"num_write_kb":63424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"80'1067","reported_seq":1079,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:04:11.242532+0000","last_change":"2024-09-22T04:02:29.026441+0000","last_active":"2024-09-22T04:04:11.242532+0000","last_peered":"2024-09-22T04:04:11.242532+0000","last_clean":"2024-09-22T04:04:11.242532+0000","last_became_active":"2024-09-22T04:02:28.991656+0000","last_became_peered":"2024-09-22T04:02:28.991656+0000","last_unstale":"2024-09-22T04:04:11.242532+0000","last_undegraded":"2024-09-22T04:04:11.242532+0000","last_fullsized":"2024-09-22T04:04:11.242532+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1067,"log_dups_size":0,"ondisk_log_size":1067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53805056,"num_objects":821,"num_object_clones":0,"num_object_copies":2463,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1067,"num_write_kb":60416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.9","version":"80'1157","reported_seq":1169,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:04:10.216846+0000","last_change":"2024-09-22T04:02:28.996162+0000","last_active":"2024-09-22T04:04:10.216846+0000","last_peered":"2024-09-22T04:04:10.216846+0000","last_clean":"2024-09-22T04:04:10.216846+0000","last_became_active":"2024-09-22T04:02:28.990154+0000","last_became_peered":"2024-09-22T04:02:28.990154+0000","last_unstale":"2024-09-22T04:04:10.216846+0000","last_undegraded":"2024-09-22T04:04:10.216846+0000","last_fullsized":"2024-09-22T04:04:10.216846+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1157,"log_dups_size":0,"ondisk_log_size":1157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61145088,"num_objects":933,"num_object_clones":0,"num_object_copies":2799,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1157,"num_write_kb":66880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"80'1191","reported_seq":1203,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:04:10.200754+0000","last_change":"2024-09-22T04:02:28.902123+0000","last_active":"2024-09-22T04:04:10.200754+0000","last_peered":"2024-09-22T04:04:10.200754+0000","last_clean":"2024-09-22T04:04:10.200754+0000","last_became_active":"2024-09-22T04:02:28.895508+0000","last_became_peered":"2024-09-22T04:02:28.895508+0000","last_unstale":"2024-09-22T04:04:10.200754+0000","last_undegraded":"2024-09-22T04:04:10.200754+0000","last_fullsized":"2024-09-22T04:04:10.200754+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1191,"log_dups_size":0,"ondisk_log_size":1191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60227584,"num_objects":919,"num_object_clones":0,"num_object_copies":2757,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1191,"num_write_kb":67520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.6","version":"80'1047","reported_seq":1059,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:04:10.239126+0000","last_change":"2024-09-22T04:02:29.024059+0000","last_active":"2024-09-22T04:04:10.239126+0000","last_peered":"2024-09-22T04:04:10.239126+0000","last_clean":"2024-09-22T04:04:10.239126+0000","last_became_active":"2024-09-22T04:02:29.013699+0000","last_became_peered":"2024-09-22T04:02:29.013699+0000","last_unstale":"2024-09-22T04:04:10.239126+0000","last_undegraded":"2024-09-22T04:04:10.239126+0000","last_fullsized":"2024-09-22T04:04:10.239126+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1047,"log_dups_size":0,"ondisk_log_size":1047,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53018624,"num_objects":809,"num_object_clones":0,"num_object_copies":2427,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1047,"num_write_kb":59392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":283,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:29.819502+0000","last_change":"2024-09-22T03:49:12.034704+0000","last_active":"2024-09-22T04:02:29.819502+0000","last_peered":"2024-09-22T04:02:29.819502+0000","last_clean":"2024-09-22T04:02:29.819502+0000","last_became_active":"2024-09-22T03:49:12.027470+0000","last_became_peered":"2024-09-22T03:49:12.027470+0000","last_unstale":"2024-09-22T04:02:29.819502+0000","last_undegraded":"2024-09-22T04:02:29.819502+0000","last_fullsized":"2024-09-22T04:02:29.819502+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_clean_scrub_stamp":"2024-09-22T03:49:10.979949+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":209,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:29.818606+0000","last_change":"2024-09-22T03:49:17.031458+0000","last_active":"2024-09-22T04:02:29.818606+0000","last_peered":"2024-09-22T04:02:29.818606+0000","last_clean":"2024-09-22T04:02:29.818606+0000","last_became_active":"2024-09-22T03:49:15.125490+0000","last_became_peered":"2024-09-22T03:49:15.125490+0000","last_unstale":"2024-09-22T04:02:29.818606+0000","last_undegraded":"2024-09-22T04:02:29.818606+0000","last_fullsized":"2024-09-22T04:02:29.818606+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"80'1103","reported_seq":1115,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:04:10.159366+0000","last_change":"2024-09-22T04:02:28.912870+0000","last_active":"2024-09-22T04:04:10.159366+0000","last_peered":"2024-09-22T04:04:10.159366+0000","last_clean":"2024-09-22T04:04:10.159366+0000","last_became_active":"2024-09-22T04:02:28.905573+0000","last_became_peered":"2024-09-22T04:02:28.905573+0000","last_unstale":"2024-09-22T04:04:10.159366+0000","last_undegraded":"2024-09-22T04:04:10.159366+0000","last_fullsized":"2024-09-22T04:04:10.159366+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1103,"log_dups_size":0,"ondisk_log_size":1103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57868288,"num_objects":883,"num_object_clones":0,"num_object_copies":2649,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1103,"num_write_kb":63552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":208,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:29.815930+0000","last_change":"2024-09-22T03:49:17.029339+0000","last_active":"2024-09-22T04:02:29.815930+0000","last_peered":"2024-09-22T04:02:29.815930+0000","last_clean":"2024-09-22T04:02:29.815930+0000","last_became_active":"2024-09-22T03:49:15.097304+0000","last_became_peered":"2024-09-22T03:49:15.097304+0000","last_unstale":"2024-09-22T04:02:29.815930+0000","last_undegraded":"2024-09-22T04:02:29.815930+0000","last_fullsized":"2024-09-22T04:02:29.815930+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"80'1072","reported_seq":1084,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:04:10.178023+0000","last_change":"2024-09-22T04:02:28.928198+0000","last_active":"2024-09-22T04:04:10.178023+0000","last_peered":"2024-09-22T04:04:10.178023+0000","last_clean":"2024-09-22T04:04:10.178023+0000","last_became_active":"2024-09-22T04:02:28.909503+0000","last_became_peered":"2024-09-22T04:02:28.909503+0000","last_unstale":"2024-09-22T04:04:10.178023+0000","last_undegraded":"2024-09-22T04:04:10.178023+0000","last_fullsized":"2024-09-22T04:04:10.178023+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1072,"log_dups_size":0,"ondisk_log_size":1072,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57147392,"num_objects":872,"num_object_clones":0,"num_object_copies":2616,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1072,"num_write_kb":62208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":208,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:29.822286+0000","last_change":"2024-09-22T03:49:17.029349+0000","last_active":"2024-09-22T04:02:29.822286+0000","last_peered":"2024-09-22T04:02:29.822286+0000","last_clean":"2024-09-22T04:02:29.822286+0000","last_became_active":"2024-09-22T03:49:15.094890+0000","last_became_peered":"2024-09-22T03:49:15.094890+0000","last_unstale":"2024-09-22T04:02:29.822286+0000","last_undegraded":"2024-09-22T04:02:29.822286+0000","last_fullsized":"2024-09-22T04:02:29.822286+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.7","version":"80'1106","reported_seq":1118,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:04:10.059598+0000","last_change":"2024-09-22T04:02:28.945388+0000","last_active":"2024-09-22T04:04:10.059598+0000","last_peered":"2024-09-22T04:04:10.059598+0000","last_clean":"2024-09-22T04:04:10.059598+0000","last_became_active":"2024-09-22T04:02:28.939479+0000","last_became_peered":"2024-09-22T04:02:28.939479+0000","last_unstale":"2024-09-22T04:04:10.059598+0000","last_undegraded":"2024-09-22T04:04:10.059598+0000","last_fullsized":"2024-09-22T04:04:10.059598+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1106,"log_dups_size":0,"ondisk_log_size":1106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57016320,"num_objects":870,"num_object_clones":0,"num_object_copies":2610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1106,"num_write_kb":63232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":210,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:29.820716+0000","last_change":"2024-09-22T03:49:17.031466+0000","last_active":"2024-09-22T04:02:29.820716+0000","last_peered":"2024-09-22T04:02:29.820716+0000","last_clean":"2024-09-22T04:02:29.820716+0000","last_became_active":"2024-09-22T03:49:15.098420+0000","last_became_peered":"2024-09-22T03:49:15.098420+0000","last_unstale":"2024-09-22T04:02:29.820716+0000","last_undegraded":"2024-09-22T04:02:29.820716+0000","last_fullsized":"2024-09-22T04:02:29.820716+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1","version":"80'1066","reported_seq":1078,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:04:10.132318+0000","last_change":"2024-09-22T04:02:28.927518+0000","last_active":"2024-09-22T04:04:10.132318+0000","last_peered":"2024-09-22T04:04:10.132318+0000","last_clean":"2024-09-22T04:04:10.132318+0000","last_became_active":"2024-09-22T04:02:28.919323+0000","last_became_peered":"2024-09-22T04:02:28.919323+0000","last_unstale":"2024-09-22T04:04:10.132318+0000","last_undegraded":"2024-09-22T04:04:10.132318+0000","last_fullsized":"2024-09-22T04:04:10.132318+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1066,"log_dups_size":0,"ondisk_log_size":1066,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56229888,"num_objects":858,"num_object_clones":0,"num_object_copies":2574,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1066,"num_write_kb":61568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":208,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:29.823311+0000","last_change":"2024-09-22T03:49:17.036954+0000","last_active":"2024-09-22T04:02:29.823311+0000","last_peered":"2024-09-22T04:02:29.823311+0000","last_clean":"2024-09-22T04:02:29.823311+0000","last_became_active":"2024-09-22T03:49:15.110506+0000","last_became_peered":"2024-09-22T03:49:15.110506+0000","last_unstale":"2024-09-22T04:02:29.823311+0000","last_undegraded":"2024-09-22T04:02:29.823311+0000","last_fullsized":"2024-09-22T04:02:29.823311+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"80'1152","reported_seq":1164,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:04:11.073969+0000","last_change":"2024-09-22T04:02:28.954190+0000","last_active":"2024-09-22T04:04:11.073969+0000","last_peered":"2024-09-22T04:04:11.073969+0000","last_clean":"2024-09-22T04:04:11.073969+0000","last_became_active":"2024-09-22T04:02:28.946807+0000","last_became_peered":"2024-09-22T04:02:28.946807+0000","last_unstale":"2024-09-22T04:04:11.073969+0000","last_undegraded":"2024-09-22T04:04:11.073969+0000","last_fullsized":"2024-09-22T04:04:11.073969+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1152,"log_dups_size":0,"ondisk_log_size":1152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58982400,"num_objects":900,"num_object_clones":0,"num_object_copies":2700,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1152,"num_write_kb":65664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":208,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:29.820857+0000","last_change":"2024-09-22T03:49:17.032989+0000","last_active":"2024-09-22T04:02:29.820857+0000","last_peered":"2024-09-22T04:02:29.820857+0000","last_clean":"2024-09-22T04:02:29.820857+0000","last_became_active":"2024-09-22T03:49:15.079260+0000","last_became_peered":"2024-09-22T03:49:15.079260+0000","last_unstale":"2024-09-22T04:02:29.820857+0000","last_undegraded":"2024-09-22T04:02:29.820857+0000","last_fullsized":"2024-09-22T04:02:29.820857+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3","version":"80'1037","reported_seq":1049,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:04:09.848241+0000","last_change":"2024-09-22T04:02:28.924084+0000","last_active":"2024-09-22T04:04:09.848241+0000","last_peered":"2024-09-22T04:04:09.848241+0000","last_clean":"2024-09-22T04:04:09.848241+0000","last_became_active":"2024-09-22T04:02:28.898697+0000","last_became_peered":"2024-09-22T04:02:28.898697+0000","last_unstale":"2024-09-22T04:04:09.848241+0000","last_undegraded":"2024-09-22T04:04:09.848241+0000","last_fullsized":"2024-09-22T04:04:09.848241+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1037,"log_dups_size":0,"ondisk_log_size":1037,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55640064,"num_objects":849,"num_object_clones":0,"num_object_copies":2547,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1037,"num_write_kb":60352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":208,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:29.823587+0000","last_change":"2024-09-22T03:49:17.036402+0000","last_active":"2024-09-22T04:02:29.823587+0000","last_peered":"2024-09-22T04:02:29.823587+0000","last_clean":"2024-09-22T04:02:29.823587+0000","last_became_active":"2024-09-22T03:49:15.108430+0000","last_became_peered":"2024-09-22T03:49:15.108430+0000","last_unstale":"2024-09-22T04:02:29.823587+0000","last_undegraded":"2024-09-22T04:02:29.823587+0000","last_fullsized":"2024-09-22T04:02:29.823587+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"80'1066","reported_seq":1078,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:04:10.141666+0000","last_change":"2024-09-22T04:02:29.018532+0000","last_active":"2024-09-22T04:04:10.141666+0000","last_peered":"2024-09-22T04:04:10.141666+0000","last_clean":"2024-09-22T04:04:10.141666+0000","last_became_active":"2024-09-22T04:02:29.006046+0000","last_became_peered":"2024-09-22T04:02:29.006046+0000","last_unstale":"2024-09-22T04:04:10.141666+0000","last_undegraded":"2024-09-22T04:04:10.141666+0000","last_fullsized":"2024-09-22T04:04:10.141666+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1066,"log_dups_size":0,"ondisk_log_size":1066,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58589184,"num_objects":894,"num_object_clones":0,"num_object_copies":2682,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1066,"num_write_kb":62720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":208,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:29.815415+0000","last_change":"2024-09-22T03:49:17.029128+0000","last_active":"2024-09-22T04:02:29.815415+0000","last_peered":"2024-09-22T04:02:29.815415+0000","last_clean":"2024-09-22T04:02:29.815415+0000","last_became_active":"2024-09-22T03:49:15.113396+0000","last_became_peered":"2024-09-22T03:49:15.113396+0000","last_unstale":"2024-09-22T04:02:29.815415+0000","last_undegraded":"2024-09-22T04:02:29.815415+0000","last_fullsized":"2024-09-22T04:02:29.815415+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":912130072,"num_objects":13919,"num_object_clones":0,"num_object_copies":41757,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":17477,"num_write_kb":1004609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":171294720,"data_stored":2740518984,"data_compressed":130134501,"data_compressed_allocated":171282432,"data_compressed_original":2740518912,"omap_allocated":0,"internal_metadata":0},"log_size":17477,"ondisk_log_size":17477,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949673858,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":157012,"kb_used_data":31616,"kb_used_omap":0,"kb_used_meta":125376,"kb_avail":94214828,"statfs":{"total":96636764160,"available":96475983872,"internally_reserved":0,"allocated":32374784,"data_stored":506910562,"data_compressed":24060919,"data_compressed_allocated":31670272,"data_compressed_original":506642432,"omap_allocated":0,"internal_metadata":128385024},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654706562,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":85268,"kb_used_data":46596,"kb_used_omap":0,"kb_used_meta":38656,"kb_avail":94286572,"statfs":{"total":96636764160,"available":96549449728,"internally_reserved":0,"allocated":47714304,"data_stored":752735554,"data_compressed":35731984,"data_compressed_allocated":47030272,"data_compressed_original":752484352,"omap_allocated":0,"internal_metadata":39583744},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706561,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":78780,"kb_used_data":39852,"kb_used_omap":0,"kb_used_meta":38912,"kb_avail":94293060,"statfs":{"total":96636764160,"available":96556093440,"internally_reserved":0,"allocated":40808448,"data_stored":641914698,"data_compressed":30471639,"data_compressed_allocated":40108032,"data_compressed_original":641646592,"omap_allocated":0,"internal_metadata":39845888},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706561,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":88844,"kb_used_data":53628,"kb_used_omap":0,"kb_used_meta":35200,"kb_avail":94282996,"statfs":{"total":96636764160,"available":96545787904,"internally_reserved":0,"allocated":54915072,"data_stored":867620687,"data_compressed":41189367,"data_compressed_allocated":54214656,"data_compressed_original":867352576,"omap_allocated":0,"internal_metadata":36044800},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":53547008,"data_stored":856686616,"data_compressed":40680063,"data_compressed_allocated":53542912,"data_compressed_original":856686592,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":31567872,"data_stored":505020440,"data_compressed":23981071,"data_compressed_allocated":31563776,"data_compressed_original":505020416,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":39555072,"data_stored":632881152,"data_compressed":30052583,"data_compressed_allocated":39555072,"data_compressed_original":632881152,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":46624768,"data_stored":745930776,"data_compressed":35420784,"data_compressed_allocated":46620672,"data_compressed_original":745930752,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T04:04:16.600 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T04:04:16.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:04:16.738+0000 7f06ac791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:04:16.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:04:16.748+0000 7f06ac791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:04:19.227 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T04:04:19.227 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T04:04:19.227 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T04:04:19.227 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T04:04:19.272 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T04:04:19.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:04:19.367+0000 7f7f62abd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:04:19.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:04:19.386+0000 7f7f62abd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:04:19.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:04:19.432+0000 7f2854ca3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:04:19.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:04:19.443+0000 7f2854ca3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:04:19.603 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:04:19.603 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:04:19.603 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:04:19.604 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:04:19.604 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:04:19.604 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:04:19.604 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:04:19.604 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:04:19.604 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:04:19.604 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:04:19.604 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:04:19.604 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:04:19.607 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:04:19.607 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:04:19.608 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T04:04:19.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:04:19.764+0000 7fd0a5093640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:04:19.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:04:19.781+0000 7fd0a5093640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:04:19.813 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:04:19.813 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:04:19.813 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:04:19.813 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:04:19.813 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:04:19.813 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:04:19.813 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:04:19.813 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:04:19.813 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:04:19.814 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:04:19.814 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:04:19.814 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:04:19.816 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:04:19.817 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:04:19.817 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T04:04:20.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:04:20.006+0000 7f8138511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:04:20.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:04:20.027+0000 7f8138511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:04:20.064 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:04:20.065 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:04:20.065 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:04:20.065 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:04:20.065 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:04:20.065 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:04:20.065 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:04:20.065 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:04:20.065 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:04:20.066 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:04:20.066 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:04:20.066 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:04:20.068 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:04:20.068 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:04:20.069 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T04:04:20.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:04:20.227+0000 7f26f5391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:04:20.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:04:20.243+0000 7f26f5391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:04:20.304 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:04:20.305 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:04:20.305 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:04:20.305 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:04:20.305 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:04:20.305 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:04:20.305 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:04:20.305 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:04:20.305 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:04:20.305 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:04:20.305 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:04:20.305 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:04:20.308 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:04:20.308 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:04:21.815 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T04:04:21.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:04:21.976+0000 7f268b0d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:04:21.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:04:21.987+0000 7f268b0d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:04:24.580 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T04:04:24.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:04:24.738+0000 7fa0d7b11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:04:24.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:04:24.749+0000 7fa0d7b11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:04:25.309 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T04:04:25.309 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T04:04:25.309 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T04:04:25.309 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T04:04:25.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:04:25.487+0000 7f86c9c4f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:04:25.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:04:25.502+0000 7f86c9c4f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:04:25.741 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:04:25.741 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:04:25.741 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:04:25.741 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:04:25.742 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:04:25.742 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:04:25.742 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:04:25.742 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:04:25.742 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:04:25.742 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:04:25.742 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:04:25.742 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:04:25.744 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:04:25.745 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:04:25.745 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T04:04:25.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:04:25.896+0000 7fa375b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:04:25.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:04:25.913+0000 7fa375b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:04:25.956 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:04:25.957 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:04:25.957 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:04:25.957 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:04:25.957 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:04:25.957 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:04:25.957 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:04:25.957 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:04:25.957 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:04:25.957 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:04:25.958 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:04:25.958 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:04:25.960 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:04:25.961 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:04:25.961 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T04:04:26.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:04:26.129+0000 7fcb93911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:04:26.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:04:26.143+0000 7fcb93911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:04:26.203 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:04:26.203 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:04:26.204 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:04:26.204 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:04:26.204 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:04:26.204 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:04:26.204 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:04:26.204 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:04:26.204 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:04:26.204 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:04:26.204 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:04:26.204 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:04:26.208 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:04:26.208 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:04:26.209 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T04:04:26.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:04:26.356+0000 7fc2c2591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:04:26.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:04:26.374+0000 7fc2c2591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:04:26.451 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:04:26.451 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:04:26.451 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:04:26.451 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:04:26.451 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:04:26.451 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:04:26.451 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:04:26.451 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:04:26.451 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:04:26.451 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:04:26.451 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:04:26.452 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:04:26.454 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:04:26.455 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:04:27.098 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T04:04:27.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:04:27.256+0000 7fef792fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:04:27.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:04:27.270+0000 7fef792fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:04:29.791 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T04:04:29.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:04:29.947+0000 7f2cacd11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:04:29.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:04:29.960+0000 7f2cacd11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:04:31.456 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T04:04:31.456 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T04:04:31.456 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T04:04:31.456 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T04:04:31.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:04:31.618+0000 7ff009d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:04:31.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:04:31.634+0000 7ff009d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:04:31.877 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:04:31.877 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:04:31.877 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:04:31.877 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:04:31.878 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:04:31.878 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:04:31.878 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:04:31.878 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:04:31.878 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:04:31.878 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:04:31.878 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:04:31.878 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:04:31.882 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:04:31.882 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:04:31.882 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T04:04:32.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:04:32.036+0000 7f4591d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:04:32.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:04:32.055+0000 7f4591d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:04:32.091 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:04:32.091 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:04:32.091 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:04:32.091 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:04:32.092 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:04:32.092 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:04:32.092 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:04:32.092 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:04:32.092 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:04:32.092 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:04:32.092 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:04:32.092 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:04:32.095 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:04:32.095 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:04:32.095 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T04:04:32.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:04:32.250+0000 7f0000cd1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:04:32.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:04:32.269+0000 7f0000cd1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:04:32.378 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:04:32.378 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:04:32.378 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:04:32.378 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:04:32.378 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:04:32.378 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:04:32.378 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:04:32.378 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:04:32.379 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:04:32.379 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:04:32.379 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:04:32.379 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:04:32.382 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:04:32.382 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:04:32.383 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T04:04:32.513 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T04:04:32.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:04:32.542+0000 7fb366ed1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:04:32.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:04:32.565+0000 7fb366ed1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:04:32.606 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:04:32.606 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:04:32.606 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:04:32.606 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:04:32.606 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:04:32.606 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:04:32.606 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:04:32.606 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:04:32.607 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:04:32.607 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:04:32.607 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:04:32.607 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:04:32.611 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:04:32.611 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:04:32.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:04:32.672+0000 7f7284b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:04:32.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:04:32.680+0000 7f7284b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:04:35.102 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T04:04:35.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:04:35.278+0000 7fd428efd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:04:35.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:04:35.289+0000 7fd428efd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:04:37.612 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T04:04:37.612 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T04:04:37.613 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T04:04:37.703 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T04:04:37.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:04:37.761+0000 7f14b3351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:04:37.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:04:37.777+0000 7f14b3351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:04:37.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:04:37.867+0000 7fb0416d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:04:37.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:04:37.887+0000 7fb0416d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:04:38.148 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T04:04:38.148 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-22T04:04:38.169 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":537,"stamp":"2024-09-22T04:04:37.158149+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":630260299,"num_objects":9613,"num_object_clones":0,"num_object_copies":28839,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":21868,"num_write_kb":1005717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21842,"ondisk_log_size":21842,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":341136,"kb_used_data":119564,"kb_used_omap":0,"kb_used_meta":221504,"kb_avail":377146224,"statfs":{"total":386547056640,"available":386197733376,"internally_reserved":0,"allocated":122433536,"data_stored":1915116349,"data_compressed":90898325,"data_compressed_allocated":119644160,"data_compressed_original":1914060800,"omap_allocated":0,"internal_metadata":226820096},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-167051264,"num_objects":-2549,"num_object_clones":0,"num_object_copies":-7647,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2549,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002467"},"pg_stats":[{"pgid":"7.f","version":"80'1305","reported_seq":1317,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:04:35.246280+0000","last_change":"2024-09-22T04:02:28.979477+0000","last_active":"2024-09-22T04:04:35.246280+0000","last_peered":"2024-09-22T04:04:35.246280+0000","last_clean":"2024-09-22T04:04:35.246280+0000","last_became_active":"2024-09-22T04:02:28.971367+0000","last_became_peered":"2024-09-22T04:02:28.971367+0000","last_unstale":"2024-09-22T04:04:35.246280+0000","last_undegraded":"2024-09-22T04:04:35.246280+0000","last_fullsized":"2024-09-22T04:04:35.246280+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1305,"log_dups_size":0,"ondisk_log_size":1305,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36503552,"num_objects":557,"num_object_clones":0,"num_object_copies":1671,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1305,"num_write_kb":59584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"80'1346","reported_seq":1358,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:04:34.932056+0000","last_change":"2024-09-22T04:02:28.872853+0000","last_active":"2024-09-22T04:04:34.932056+0000","last_peered":"2024-09-22T04:04:34.932056+0000","last_clean":"2024-09-22T04:04:34.932056+0000","last_became_active":"2024-09-22T04:02:28.865538+0000","last_became_peered":"2024-09-22T04:02:28.865538+0000","last_unstale":"2024-09-22T04:04:34.932056+0000","last_undegraded":"2024-09-22T04:04:34.932056+0000","last_fullsized":"2024-09-22T04:04:34.932056+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1346,"log_dups_size":0,"ondisk_log_size":1346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40370176,"num_objects":616,"num_object_clones":0,"num_object_copies":1848,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1346,"num_write_kb":62784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.d","version":"80'1371","reported_seq":1384,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:04:36.135650+0000","last_change":"2024-09-22T04:02:28.967443+0000","last_active":"2024-09-22T04:04:36.135650+0000","last_peered":"2024-09-22T04:04:36.135650+0000","last_clean":"2024-09-22T04:04:36.135650+0000","last_became_active":"2024-09-22T04:02:28.959444+0000","last_became_peered":"2024-09-22T04:02:28.959444+0000","last_unstale":"2024-09-22T04:04:36.135650+0000","last_undegraded":"2024-09-22T04:04:36.135650+0000","last_fullsized":"2024-09-22T04:04:36.135650+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1371,"log_dups_size":0,"ondisk_log_size":1371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40632344,"num_objects":621,"num_object_clones":0,"num_object_copies":1863,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1371,"num_write_kb":63681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"80'1344","reported_seq":1356,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:04:34.840059+0000","last_change":"2024-09-22T04:02:28.963918+0000","last_active":"2024-09-22T04:04:34.840059+0000","last_peered":"2024-09-22T04:04:34.840059+0000","last_clean":"2024-09-22T04:04:34.840059+0000","last_became_active":"2024-09-22T04:02:28.948540+0000","last_became_peered":"2024-09-22T04:02:28.948540+0000","last_unstale":"2024-09-22T04:04:34.840059+0000","last_undegraded":"2024-09-22T04:04:34.840059+0000","last_fullsized":"2024-09-22T04:04:34.840059+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1344,"log_dups_size":0,"ondisk_log_size":1344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38141952,"num_objects":582,"num_object_clones":0,"num_object_copies":1746,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1344,"num_write_kb":61632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"80'1393","reported_seq":1405,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:04:36.123349+0000","last_change":"2024-09-22T04:02:28.971728+0000","last_active":"2024-09-22T04:04:36.123349+0000","last_peered":"2024-09-22T04:04:36.123349+0000","last_clean":"2024-09-22T04:04:36.123349+0000","last_became_active":"2024-09-22T04:02:28.960293+0000","last_became_peered":"2024-09-22T04:02:28.960293+0000","last_unstale":"2024-09-22T04:04:36.123349+0000","last_undegraded":"2024-09-22T04:04:36.123349+0000","last_fullsized":"2024-09-22T04:04:36.123349+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1393,"log_dups_size":0,"ondisk_log_size":1393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38600704,"num_objects":589,"num_object_clones":0,"num_object_copies":1767,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1393,"num_write_kb":63424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"80'1308","reported_seq":1320,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:04:36.281462+0000","last_change":"2024-09-22T04:02:29.026441+0000","last_active":"2024-09-22T04:04:36.281462+0000","last_peered":"2024-09-22T04:04:36.281462+0000","last_clean":"2024-09-22T04:04:36.281462+0000","last_became_active":"2024-09-22T04:02:28.991656+0000","last_became_peered":"2024-09-22T04:02:28.991656+0000","last_unstale":"2024-09-22T04:04:36.281462+0000","last_undegraded":"2024-09-22T04:04:36.281462+0000","last_fullsized":"2024-09-22T04:04:36.281462+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1308,"log_dups_size":0,"ondisk_log_size":1308,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38010880,"num_objects":580,"num_object_clones":0,"num_object_copies":1740,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1308,"num_write_kb":60416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.9","version":"80'1450","reported_seq":1462,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:04:35.251009+0000","last_change":"2024-09-22T04:02:28.996162+0000","last_active":"2024-09-22T04:04:35.251009+0000","last_peered":"2024-09-22T04:04:35.251009+0000","last_clean":"2024-09-22T04:04:35.251009+0000","last_became_active":"2024-09-22T04:02:28.990154+0000","last_became_peered":"2024-09-22T04:02:28.990154+0000","last_unstale":"2024-09-22T04:04:35.251009+0000","last_undegraded":"2024-09-22T04:04:35.251009+0000","last_fullsized":"2024-09-22T04:04:35.251009+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1450,"log_dups_size":0,"ondisk_log_size":1450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":640,"num_object_clones":0,"num_object_copies":1920,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1450,"num_write_kb":66880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"80'1468","reported_seq":1480,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:04:35.157196+0000","last_change":"2024-09-22T04:02:28.902123+0000","last_active":"2024-09-22T04:04:35.157196+0000","last_peered":"2024-09-22T04:04:35.157196+0000","last_clean":"2024-09-22T04:04:35.157196+0000","last_became_active":"2024-09-22T04:02:28.895508+0000","last_became_peered":"2024-09-22T04:02:28.895508+0000","last_unstale":"2024-09-22T04:04:35.157196+0000","last_undegraded":"2024-09-22T04:04:35.157196+0000","last_fullsized":"2024-09-22T04:04:35.157196+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1468,"log_dups_size":0,"ondisk_log_size":1468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42074112,"num_objects":642,"num_object_clones":0,"num_object_copies":1926,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1468,"num_write_kb":67520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.6","version":"80'1303","reported_seq":1315,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:04:35.306718+0000","last_change":"2024-09-22T04:02:29.024059+0000","last_active":"2024-09-22T04:04:35.306718+0000","last_peered":"2024-09-22T04:04:35.306718+0000","last_clean":"2024-09-22T04:04:35.306718+0000","last_became_active":"2024-09-22T04:02:29.013699+0000","last_became_peered":"2024-09-22T04:02:29.013699+0000","last_unstale":"2024-09-22T04:04:35.306718+0000","last_undegraded":"2024-09-22T04:04:35.306718+0000","last_fullsized":"2024-09-22T04:04:35.306718+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1303,"log_dups_size":0,"ondisk_log_size":1303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36241408,"num_objects":553,"num_object_clones":0,"num_object_copies":1659,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1303,"num_write_kb":59392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":283,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:29.819502+0000","last_change":"2024-09-22T03:49:12.034704+0000","last_active":"2024-09-22T04:02:29.819502+0000","last_peered":"2024-09-22T04:02:29.819502+0000","last_clean":"2024-09-22T04:02:29.819502+0000","last_became_active":"2024-09-22T03:49:12.027470+0000","last_became_peered":"2024-09-22T03:49:12.027470+0000","last_unstale":"2024-09-22T04:02:29.819502+0000","last_undegraded":"2024-09-22T04:02:29.819502+0000","last_fullsized":"2024-09-22T04:02:29.819502+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_clean_scrub_stamp":"2024-09-22T03:49:10.979949+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":209,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:29.818606+0000","last_change":"2024-09-22T03:49:17.031458+0000","last_active":"2024-09-22T04:02:29.818606+0000","last_peered":"2024-09-22T04:02:29.818606+0000","last_clean":"2024-09-22T04:02:29.818606+0000","last_became_active":"2024-09-22T03:49:15.125490+0000","last_became_peered":"2024-09-22T03:49:15.125490+0000","last_unstale":"2024-09-22T04:02:29.818606+0000","last_undegraded":"2024-09-22T04:02:29.818606+0000","last_fullsized":"2024-09-22T04:02:29.818606+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"80'1380","reported_seq":1392,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:04:35.128690+0000","last_change":"2024-09-22T04:02:28.912870+0000","last_active":"2024-09-22T04:04:35.128690+0000","last_peered":"2024-09-22T04:04:35.128690+0000","last_clean":"2024-09-22T04:04:35.128690+0000","last_became_active":"2024-09-22T04:02:28.905573+0000","last_became_peered":"2024-09-22T04:02:28.905573+0000","last_unstale":"2024-09-22T04:04:35.128690+0000","last_undegraded":"2024-09-22T04:04:35.128690+0000","last_fullsized":"2024-09-22T04:04:35.128690+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1380,"log_dups_size":0,"ondisk_log_size":1380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39714816,"num_objects":606,"num_object_clones":0,"num_object_copies":1818,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1380,"num_write_kb":63552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":208,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:29.815930+0000","last_change":"2024-09-22T03:49:17.029339+0000","last_active":"2024-09-22T04:02:29.815930+0000","last_peered":"2024-09-22T04:02:29.815930+0000","last_clean":"2024-09-22T04:02:29.815930+0000","last_became_active":"2024-09-22T03:49:15.097304+0000","last_became_peered":"2024-09-22T03:49:15.097304+0000","last_unstale":"2024-09-22T04:02:29.815930+0000","last_undegraded":"2024-09-22T04:02:29.815930+0000","last_fullsized":"2024-09-22T04:02:29.815930+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"80'1353","reported_seq":1365,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:04:35.213715+0000","last_change":"2024-09-22T04:02:28.928198+0000","last_active":"2024-09-22T04:04:35.213715+0000","last_peered":"2024-09-22T04:04:35.213715+0000","last_clean":"2024-09-22T04:04:35.213715+0000","last_became_active":"2024-09-22T04:02:28.909503+0000","last_became_peered":"2024-09-22T04:02:28.909503+0000","last_unstale":"2024-09-22T04:04:35.213715+0000","last_undegraded":"2024-09-22T04:04:35.213715+0000","last_fullsized":"2024-09-22T04:04:35.213715+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1353,"log_dups_size":0,"ondisk_log_size":1353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38731776,"num_objects":591,"num_object_clones":0,"num_object_copies":1773,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1353,"num_write_kb":62208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":208,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:29.822286+0000","last_change":"2024-09-22T03:49:17.029349+0000","last_active":"2024-09-22T04:02:29.822286+0000","last_peered":"2024-09-22T04:02:29.822286+0000","last_clean":"2024-09-22T04:02:29.822286+0000","last_became_active":"2024-09-22T03:49:15.094890+0000","last_became_peered":"2024-09-22T03:49:15.094890+0000","last_unstale":"2024-09-22T04:02:29.822286+0000","last_undegraded":"2024-09-22T04:02:29.822286+0000","last_fullsized":"2024-09-22T04:02:29.822286+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.7","version":"80'1366","reported_seq":1378,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:04:34.964568+0000","last_change":"2024-09-22T04:02:28.945388+0000","last_active":"2024-09-22T04:04:34.964568+0000","last_peered":"2024-09-22T04:04:34.964568+0000","last_clean":"2024-09-22T04:04:34.964568+0000","last_became_active":"2024-09-22T04:02:28.939479+0000","last_became_peered":"2024-09-22T04:02:28.939479+0000","last_unstale":"2024-09-22T04:04:34.964568+0000","last_undegraded":"2024-09-22T04:04:34.964568+0000","last_fullsized":"2024-09-22T04:04:34.964568+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1366,"log_dups_size":0,"ondisk_log_size":1366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39976960,"num_objects":610,"num_object_clones":0,"num_object_copies":1830,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1366,"num_write_kb":63232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":210,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:29.820716+0000","last_change":"2024-09-22T03:49:17.031466+0000","last_active":"2024-09-22T04:02:29.820716+0000","last_peered":"2024-09-22T04:02:29.820716+0000","last_clean":"2024-09-22T04:02:29.820716+0000","last_became_active":"2024-09-22T03:49:15.098420+0000","last_became_peered":"2024-09-22T03:49:15.098420+0000","last_unstale":"2024-09-22T04:02:29.820716+0000","last_undegraded":"2024-09-22T04:02:29.820716+0000","last_fullsized":"2024-09-22T04:02:29.820716+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1","version":"80'1339","reported_seq":1351,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:04:35.227537+0000","last_change":"2024-09-22T04:02:28.927518+0000","last_active":"2024-09-22T04:04:35.227537+0000","last_peered":"2024-09-22T04:04:35.227537+0000","last_clean":"2024-09-22T04:04:35.227537+0000","last_became_active":"2024-09-22T04:02:28.919323+0000","last_became_peered":"2024-09-22T04:02:28.919323+0000","last_unstale":"2024-09-22T04:04:35.227537+0000","last_undegraded":"2024-09-22T04:04:35.227537+0000","last_fullsized":"2024-09-22T04:04:35.227537+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1339,"log_dups_size":0,"ondisk_log_size":1339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38338560,"num_objects":585,"num_object_clones":0,"num_object_copies":1755,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1339,"num_write_kb":61568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":208,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:29.823311+0000","last_change":"2024-09-22T03:49:17.036954+0000","last_active":"2024-09-22T04:02:29.823311+0000","last_peered":"2024-09-22T04:02:29.823311+0000","last_clean":"2024-09-22T04:02:29.823311+0000","last_became_active":"2024-09-22T03:49:15.110506+0000","last_became_peered":"2024-09-22T03:49:15.110506+0000","last_unstale":"2024-09-22T04:02:29.823311+0000","last_undegraded":"2024-09-22T04:02:29.823311+0000","last_fullsized":"2024-09-22T04:02:29.823311+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"80'1446","reported_seq":1458,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:04:36.046010+0000","last_change":"2024-09-22T04:02:28.954190+0000","last_active":"2024-09-22T04:04:36.046010+0000","last_peered":"2024-09-22T04:04:36.046010+0000","last_clean":"2024-09-22T04:04:36.046010+0000","last_became_active":"2024-09-22T04:02:28.946807+0000","last_became_peered":"2024-09-22T04:02:28.946807+0000","last_unstale":"2024-09-22T04:04:36.046010+0000","last_undegraded":"2024-09-22T04:04:36.046010+0000","last_fullsized":"2024-09-22T04:04:36.046010+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1446,"log_dups_size":0,"ondisk_log_size":1446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39714816,"num_objects":606,"num_object_clones":0,"num_object_copies":1818,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1446,"num_write_kb":65664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":208,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:29.820857+0000","last_change":"2024-09-22T03:49:17.032989+0000","last_active":"2024-09-22T04:02:29.820857+0000","last_peered":"2024-09-22T04:02:29.820857+0000","last_clean":"2024-09-22T04:02:29.820857+0000","last_became_active":"2024-09-22T03:49:15.079260+0000","last_became_peered":"2024-09-22T03:49:15.079260+0000","last_unstale":"2024-09-22T04:02:29.820857+0000","last_undegraded":"2024-09-22T04:02:29.820857+0000","last_fullsized":"2024-09-22T04:02:29.820857+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3","version":"80'1279","reported_seq":1291,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:04:35.177559+0000","last_change":"2024-09-22T04:02:28.924084+0000","last_active":"2024-09-22T04:04:35.177559+0000","last_peered":"2024-09-22T04:04:35.177559+0000","last_clean":"2024-09-22T04:04:35.177559+0000","last_became_active":"2024-09-22T04:02:28.898697+0000","last_became_peered":"2024-09-22T04:02:28.898697+0000","last_unstale":"2024-09-22T04:04:35.177559+0000","last_undegraded":"2024-09-22T04:04:35.177559+0000","last_fullsized":"2024-09-22T04:04:35.177559+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1279,"log_dups_size":0,"ondisk_log_size":1279,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39780352,"num_objects":607,"num_object_clones":0,"num_object_copies":1821,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1279,"num_write_kb":60352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":208,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:29.823587+0000","last_change":"2024-09-22T03:49:17.036402+0000","last_active":"2024-09-22T04:02:29.823587+0000","last_peered":"2024-09-22T04:02:29.823587+0000","last_clean":"2024-09-22T04:02:29.823587+0000","last_became_active":"2024-09-22T03:49:15.108430+0000","last_became_peered":"2024-09-22T03:49:15.108430+0000","last_unstale":"2024-09-22T04:02:29.823587+0000","last_undegraded":"2024-09-22T04:02:29.823587+0000","last_fullsized":"2024-09-22T04:02:29.823587+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"80'1336","reported_seq":1348,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:04:34.880740+0000","last_change":"2024-09-22T04:02:29.018532+0000","last_active":"2024-09-22T04:04:34.880740+0000","last_peered":"2024-09-22T04:04:34.880740+0000","last_clean":"2024-09-22T04:04:34.880740+0000","last_became_active":"2024-09-22T04:02:29.006046+0000","last_became_peered":"2024-09-22T04:02:29.006046+0000","last_unstale":"2024-09-22T04:04:34.880740+0000","last_undegraded":"2024-09-22T04:04:34.880740+0000","last_fullsized":"2024-09-22T04:04:34.880740+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1336,"log_dups_size":0,"ondisk_log_size":1336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40894464,"num_objects":624,"num_object_clones":0,"num_object_copies":1872,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1336,"num_write_kb":62720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":208,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:29.815415+0000","last_change":"2024-09-22T03:49:17.029128+0000","last_active":"2024-09-22T04:02:29.815415+0000","last_peered":"2024-09-22T04:02:29.815415+0000","last_clean":"2024-09-22T04:02:29.815415+0000","last_became_active":"2024-09-22T03:49:15.113396+0000","last_became_peered":"2024-09-22T03:49:15.113396+0000","last_unstale":"2024-09-22T04:02:29.815415+0000","last_undegraded":"2024-09-22T04:02:29.815415+0000","last_fullsized":"2024-09-22T04:02:29.815415+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":629669912,"num_objects":9609,"num_object_clones":0,"num_object_copies":28827,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":21787,"num_write_kb":1004609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":118280192,"data_stored":1892286536,"data_compressed":89855885,"data_compressed_allocated":118267904,"data_compressed_original":1892286464,"omap_allocated":0,"internal_metadata":0},"log_size":21787,"ondisk_log_size":21787,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949673883,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":139036,"kb_used_data":21964,"kb_used_omap":0,"kb_used_meta":117056,"kb_avail":94232804,"statfs":{"total":96636764160,"available":96494391296,"internally_reserved":0,"allocated":22491136,"data_stored":348772194,"data_compressed":16551663,"data_compressed_allocated":21786624,"data_compressed_original":348504064,"omap_allocated":0,"internal_metadata":119865344},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654706587,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":71108,"kb_used_data":32436,"kb_used_omap":0,"kb_used_meta":38656,"kb_avail":94300732,"statfs":{"total":96636764160,"available":96563949568,"internally_reserved":0,"allocated":33214464,"data_stored":520738114,"data_compressed":24715504,"data_compressed_allocated":32530432,"data_compressed_original":520486912,"omap_allocated":0,"internal_metadata":39583744},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706586,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":62608,"kb_used_data":27840,"kb_used_omap":0,"kb_used_meta":34752,"kb_avail":94309232,"statfs":{"total":96636764160,"available":96572653568,"internally_reserved":0,"allocated":28508160,"data_stored":445110090,"data_compressed":21126303,"data_compressed_allocated":27807744,"data_compressed_original":444841984,"omap_allocated":0,"internal_metadata":35586048},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706586,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":68384,"kb_used_data":37324,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94303456,"statfs":{"total":96636764160,"available":96566738944,"internally_reserved":0,"allocated":38219776,"data_stored":600495951,"data_compressed":28504855,"data_compressed_allocated":37519360,"data_compressed_original":600227840,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36995072,"data_stored":591855640,"data_compressed":28104471,"data_compressed_allocated":36990976,"data_compressed_original":591855616,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":21684224,"data_stored":346882072,"data_compressed":16471815,"data_compressed_allocated":21680128,"data_compressed_original":346882048,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":27357184,"data_stored":437714944,"data_compressed":20785047,"data_compressed_allocated":27357184,"data_compressed_original":437714944,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":32243712,"data_stored":515833880,"data_compressed":24494552,"data_compressed_allocated":32239616,"data_compressed_original":515833856,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T04:04:40.385 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T04:04:40.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:04:40.536+0000 7f40c5991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:04:40.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:04:40.546+0000 7f40c5991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:04:43.034 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T04:04:43.172 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T04:04:43.172 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T04:04:43.172 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T04:04:43.172 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T04:04:43.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:04:43.184+0000 7fe1d1688640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:04:43.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:04:43.195+0000 7fe1d1688640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:04:43.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:04:43.319+0000 7fe74ee6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:04:43.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:04:43.331+0000 7fe74ee6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:04:43.416 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:04:43.470 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:04:43.470 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:04:43.470 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:04:43.471 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:04:43.471 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:04:43.471 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:04:43.471 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:04:43.471 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:04:43.471 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:04:43.471 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:04:43.471 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:04:43.472 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:04:43.473 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:04:43.473 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T04:04:43.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:04:43.679+0000 7f3f0fad1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:04:43.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:04:43.694+0000 7f3f0fad1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:04:43.718 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:04:43.718 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:04:43.718 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:04:43.718 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:04:43.718 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:04:43.718 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:04:43.718 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:04:43.718 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:04:43.718 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:04:43.718 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:04:43.718 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:04:43.719 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:04:43.722 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:04:43.722 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:04:43.723 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T04:04:43.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:04:43.887+0000 7f046ad11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:04:43.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:04:43.900+0000 7f046ad11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:04:43.974 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:04:43.974 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:04:43.974 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:04:43.974 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:04:43.974 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:04:43.975 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:04:43.975 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:04:43.975 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:04:43.975 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:04:43.975 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:04:43.975 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:04:43.975 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:04:43.977 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:04:43.978 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:04:43.978 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T04:04:44.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:04:44.120+0000 7f628e151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:04:44.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:04:44.137+0000 7f628e151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:04:44.292 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:04:44.292 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:04:44.292 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:04:44.292 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:04:44.292 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:04:44.292 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:04:44.292 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:04:44.292 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:04:44.293 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:04:44.293 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:04:44.293 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:04:44.293 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:04:44.296 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:04:44.296 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:04:45.855 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T04:04:46.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:04:46.002+0000 7f0eafb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:04:46.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:04:46.015+0000 7f0eafb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:04:48.802 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T04:04:48.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:04:48.948+0000 7fd95e4fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:04:48.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:04:48.957+0000 7fd95e4fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:04:49.296 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T04:04:49.297 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T04:04:49.297 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T04:04:49.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:04:49.453+0000 7f7ea32fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:04:49.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:04:49.466+0000 7f7ea32fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:04:49.777 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T04:04:49.778 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-22T04:04:49.797 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":543,"stamp":"2024-09-22T04:04:49.160613+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":520028747,"num_objects":7931,"num_object_clones":0,"num_object_copies":23793,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":23550,"num_write_kb":1005717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":23524,"ondisk_log_size":23524,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":341692,"kb_used_data":99316,"kb_used_omap":0,"kb_used_meta":242304,"kb_avail":377145668,"statfs":{"total":386547056640,"available":386197164032,"internally_reserved":0,"allocated":101699584,"data_stored":1583373117,"data_compressed":75145381,"data_compressed_allocated":98910208,"data_compressed_original":1582317568,"omap_allocated":0,"internal_metadata":248119296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-110231552,"num_objects":-1682,"num_object_clones":0,"num_object_copies":-5046,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1682,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002463"},"pg_stats":[{"pgid":"7.f","version":"80'1402","reported_seq":1414,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:04:45.317793+0000","last_change":"2024-09-22T04:02:28.979477+0000","last_active":"2024-09-22T04:04:45.317793+0000","last_peered":"2024-09-22T04:04:45.317793+0000","last_clean":"2024-09-22T04:04:45.317793+0000","last_became_active":"2024-09-22T04:02:28.971367+0000","last_became_peered":"2024-09-22T04:02:28.971367+0000","last_unstale":"2024-09-22T04:04:45.317793+0000","last_undegraded":"2024-09-22T04:04:45.317793+0000","last_fullsized":"2024-09-22T04:04:45.317793+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1402,"log_dups_size":0,"ondisk_log_size":1402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30146560,"num_objects":460,"num_object_clones":0,"num_object_copies":1380,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1402,"num_write_kb":59584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"80'1458","reported_seq":1470,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:04:45.110848+0000","last_change":"2024-09-22T04:02:28.872853+0000","last_active":"2024-09-22T04:04:45.110848+0000","last_peered":"2024-09-22T04:04:45.110848+0000","last_clean":"2024-09-22T04:04:45.110848+0000","last_became_active":"2024-09-22T04:02:28.865538+0000","last_became_peered":"2024-09-22T04:02:28.865538+0000","last_unstale":"2024-09-22T04:04:45.110848+0000","last_undegraded":"2024-09-22T04:04:45.110848+0000","last_fullsized":"2024-09-22T04:04:45.110848+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1458,"log_dups_size":0,"ondisk_log_size":1458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33030144,"num_objects":504,"num_object_clones":0,"num_object_copies":1512,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1458,"num_write_kb":62784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.d","version":"80'1495","reported_seq":1508,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:04:46.103218+0000","last_change":"2024-09-22T04:02:28.967443+0000","last_active":"2024-09-22T04:04:46.103218+0000","last_peered":"2024-09-22T04:04:46.103218+0000","last_clean":"2024-09-22T04:04:46.103218+0000","last_became_active":"2024-09-22T04:02:28.959444+0000","last_became_peered":"2024-09-22T04:02:28.959444+0000","last_unstale":"2024-09-22T04:04:46.103218+0000","last_undegraded":"2024-09-22T04:04:46.103218+0000","last_fullsized":"2024-09-22T04:04:46.103218+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1495,"log_dups_size":0,"ondisk_log_size":1495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32505880,"num_objects":497,"num_object_clones":0,"num_object_copies":1491,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1495,"num_write_kb":63681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"80'1444","reported_seq":1456,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:04:45.199734+0000","last_change":"2024-09-22T04:02:28.963918+0000","last_active":"2024-09-22T04:04:45.199734+0000","last_peered":"2024-09-22T04:04:45.199734+0000","last_clean":"2024-09-22T04:04:45.199734+0000","last_became_active":"2024-09-22T04:02:28.948540+0000","last_became_peered":"2024-09-22T04:02:28.948540+0000","last_unstale":"2024-09-22T04:04:45.199734+0000","last_undegraded":"2024-09-22T04:04:45.199734+0000","last_fullsized":"2024-09-22T04:04:45.199734+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1444,"log_dups_size":0,"ondisk_log_size":1444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31588352,"num_objects":482,"num_object_clones":0,"num_object_copies":1446,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1444,"num_write_kb":61632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"80'1484","reported_seq":1496,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:04:46.244046+0000","last_change":"2024-09-22T04:02:28.971728+0000","last_active":"2024-09-22T04:04:46.244046+0000","last_peered":"2024-09-22T04:04:46.244046+0000","last_clean":"2024-09-22T04:04:46.244046+0000","last_became_active":"2024-09-22T04:02:28.960293+0000","last_became_peered":"2024-09-22T04:02:28.960293+0000","last_unstale":"2024-09-22T04:04:46.244046+0000","last_undegraded":"2024-09-22T04:04:46.244046+0000","last_fullsized":"2024-09-22T04:04:46.244046+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1484,"log_dups_size":0,"ondisk_log_size":1484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32636928,"num_objects":498,"num_object_clones":0,"num_object_copies":1494,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1484,"num_write_kb":63424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"80'1404","reported_seq":1416,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:04:46.133029+0000","last_change":"2024-09-22T04:02:29.026441+0000","last_active":"2024-09-22T04:04:46.133029+0000","last_peered":"2024-09-22T04:04:46.133029+0000","last_clean":"2024-09-22T04:04:46.133029+0000","last_became_active":"2024-09-22T04:02:28.991656+0000","last_became_peered":"2024-09-22T04:02:28.991656+0000","last_unstale":"2024-09-22T04:04:46.133029+0000","last_undegraded":"2024-09-22T04:04:46.133029+0000","last_fullsized":"2024-09-22T04:04:46.133029+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1404,"log_dups_size":0,"ondisk_log_size":1404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31719424,"num_objects":484,"num_object_clones":0,"num_object_copies":1452,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1404,"num_write_kb":60416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.9","version":"80'1557","reported_seq":1569,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:04:45.223879+0000","last_change":"2024-09-22T04:02:28.996162+0000","last_active":"2024-09-22T04:04:45.223879+0000","last_peered":"2024-09-22T04:04:45.223879+0000","last_clean":"2024-09-22T04:04:45.223879+0000","last_became_active":"2024-09-22T04:02:28.990154+0000","last_became_peered":"2024-09-22T04:02:28.990154+0000","last_unstale":"2024-09-22T04:04:45.223879+0000","last_undegraded":"2024-09-22T04:04:45.223879+0000","last_fullsized":"2024-09-22T04:04:45.223879+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1557,"log_dups_size":0,"ondisk_log_size":1557,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34930688,"num_objects":533,"num_object_clones":0,"num_object_copies":1599,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1557,"num_write_kb":66880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"80'1570","reported_seq":1582,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:04:45.004215+0000","last_change":"2024-09-22T04:02:28.902123+0000","last_active":"2024-09-22T04:04:45.004215+0000","last_peered":"2024-09-22T04:04:45.004215+0000","last_clean":"2024-09-22T04:04:45.004215+0000","last_became_active":"2024-09-22T04:02:28.895508+0000","last_became_peered":"2024-09-22T04:02:28.895508+0000","last_unstale":"2024-09-22T04:04:45.004215+0000","last_undegraded":"2024-09-22T04:04:45.004215+0000","last_fullsized":"2024-09-22T04:04:45.004215+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1570,"log_dups_size":0,"ondisk_log_size":1570,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35389440,"num_objects":540,"num_object_clones":0,"num_object_copies":1620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1570,"num_write_kb":67520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.6","version":"80'1411","reported_seq":1423,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:04:45.197933+0000","last_change":"2024-09-22T04:02:29.024059+0000","last_active":"2024-09-22T04:04:45.197933+0000","last_peered":"2024-09-22T04:04:45.197933+0000","last_clean":"2024-09-22T04:04:45.197933+0000","last_became_active":"2024-09-22T04:02:29.013699+0000","last_became_peered":"2024-09-22T04:02:29.013699+0000","last_unstale":"2024-09-22T04:04:45.197933+0000","last_undegraded":"2024-09-22T04:04:45.197933+0000","last_fullsized":"2024-09-22T04:04:45.197933+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1411,"log_dups_size":0,"ondisk_log_size":1411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29163520,"num_objects":445,"num_object_clones":0,"num_object_copies":1335,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1411,"num_write_kb":59392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":283,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:29.819502+0000","last_change":"2024-09-22T03:49:12.034704+0000","last_active":"2024-09-22T04:02:29.819502+0000","last_peered":"2024-09-22T04:02:29.819502+0000","last_clean":"2024-09-22T04:02:29.819502+0000","last_became_active":"2024-09-22T03:49:12.027470+0000","last_became_peered":"2024-09-22T03:49:12.027470+0000","last_unstale":"2024-09-22T04:02:29.819502+0000","last_undegraded":"2024-09-22T04:02:29.819502+0000","last_fullsized":"2024-09-22T04:02:29.819502+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_clean_scrub_stamp":"2024-09-22T03:49:10.979949+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":209,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:29.818606+0000","last_change":"2024-09-22T03:49:17.031458+0000","last_active":"2024-09-22T04:02:29.818606+0000","last_peered":"2024-09-22T04:02:29.818606+0000","last_clean":"2024-09-22T04:02:29.818606+0000","last_became_active":"2024-09-22T03:49:15.125490+0000","last_became_peered":"2024-09-22T03:49:15.125490+0000","last_unstale":"2024-09-22T04:02:29.818606+0000","last_undegraded":"2024-09-22T04:02:29.818606+0000","last_fullsized":"2024-09-22T04:02:29.818606+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"80'1484","reported_seq":1496,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:04:45.074188+0000","last_change":"2024-09-22T04:02:28.912870+0000","last_active":"2024-09-22T04:04:45.074188+0000","last_peered":"2024-09-22T04:04:45.074188+0000","last_clean":"2024-09-22T04:04:45.074188+0000","last_became_active":"2024-09-22T04:02:28.905573+0000","last_became_peered":"2024-09-22T04:02:28.905573+0000","last_unstale":"2024-09-22T04:04:45.074188+0000","last_undegraded":"2024-09-22T04:04:45.074188+0000","last_fullsized":"2024-09-22T04:04:45.074188+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1484,"log_dups_size":0,"ondisk_log_size":1484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32899072,"num_objects":502,"num_object_clones":0,"num_object_copies":1506,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1484,"num_write_kb":63552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":208,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:29.815930+0000","last_change":"2024-09-22T03:49:17.029339+0000","last_active":"2024-09-22T04:02:29.815930+0000","last_peered":"2024-09-22T04:02:29.815930+0000","last_clean":"2024-09-22T04:02:29.815930+0000","last_became_active":"2024-09-22T03:49:15.097304+0000","last_became_peered":"2024-09-22T03:49:15.097304+0000","last_unstale":"2024-09-22T04:02:29.815930+0000","last_undegraded":"2024-09-22T04:02:29.815930+0000","last_fullsized":"2024-09-22T04:02:29.815930+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"80'1456","reported_seq":1468,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:04:45.037104+0000","last_change":"2024-09-22T04:02:28.928198+0000","last_active":"2024-09-22T04:04:45.037104+0000","last_peered":"2024-09-22T04:04:45.037104+0000","last_clean":"2024-09-22T04:04:45.037104+0000","last_became_active":"2024-09-22T04:02:28.909503+0000","last_became_peered":"2024-09-22T04:02:28.909503+0000","last_unstale":"2024-09-22T04:04:45.037104+0000","last_undegraded":"2024-09-22T04:04:45.037104+0000","last_fullsized":"2024-09-22T04:04:45.037104+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1456,"log_dups_size":0,"ondisk_log_size":1456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31981568,"num_objects":488,"num_object_clones":0,"num_object_copies":1464,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1456,"num_write_kb":62208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":208,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:29.822286+0000","last_change":"2024-09-22T03:49:17.029349+0000","last_active":"2024-09-22T04:02:29.822286+0000","last_peered":"2024-09-22T04:02:29.822286+0000","last_clean":"2024-09-22T04:02:29.822286+0000","last_became_active":"2024-09-22T03:49:15.094890+0000","last_became_peered":"2024-09-22T03:49:15.094890+0000","last_unstale":"2024-09-22T04:02:29.822286+0000","last_undegraded":"2024-09-22T04:02:29.822286+0000","last_fullsized":"2024-09-22T04:02:29.822286+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.7","version":"80'1483","reported_seq":1495,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:04:44.646113+0000","last_change":"2024-09-22T04:02:28.945388+0000","last_active":"2024-09-22T04:04:44.646113+0000","last_peered":"2024-09-22T04:04:44.646113+0000","last_clean":"2024-09-22T04:04:44.646113+0000","last_became_active":"2024-09-22T04:02:28.939479+0000","last_became_peered":"2024-09-22T04:02:28.939479+0000","last_unstale":"2024-09-22T04:04:44.646113+0000","last_undegraded":"2024-09-22T04:04:44.646113+0000","last_fullsized":"2024-09-22T04:04:44.646113+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1483,"log_dups_size":0,"ondisk_log_size":1483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32309248,"num_objects":493,"num_object_clones":0,"num_object_copies":1479,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1483,"num_write_kb":63232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":210,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:29.820716+0000","last_change":"2024-09-22T03:49:17.031466+0000","last_active":"2024-09-22T04:02:29.820716+0000","last_peered":"2024-09-22T04:02:29.820716+0000","last_clean":"2024-09-22T04:02:29.820716+0000","last_became_active":"2024-09-22T03:49:15.098420+0000","last_became_peered":"2024-09-22T03:49:15.098420+0000","last_unstale":"2024-09-22T04:02:29.820716+0000","last_undegraded":"2024-09-22T04:02:29.820716+0000","last_fullsized":"2024-09-22T04:02:29.820716+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1","version":"80'1425","reported_seq":1437,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:04:45.204302+0000","last_change":"2024-09-22T04:02:28.927518+0000","last_active":"2024-09-22T04:04:45.204302+0000","last_peered":"2024-09-22T04:04:45.204302+0000","last_clean":"2024-09-22T04:04:45.204302+0000","last_became_active":"2024-09-22T04:02:28.919323+0000","last_became_peered":"2024-09-22T04:02:28.919323+0000","last_unstale":"2024-09-22T04:04:45.204302+0000","last_undegraded":"2024-09-22T04:04:45.204302+0000","last_fullsized":"2024-09-22T04:04:45.204302+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1425,"log_dups_size":0,"ondisk_log_size":1425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32702464,"num_objects":499,"num_object_clones":0,"num_object_copies":1497,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1425,"num_write_kb":61568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":208,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:29.823311+0000","last_change":"2024-09-22T03:49:17.036954+0000","last_active":"2024-09-22T04:02:29.823311+0000","last_peered":"2024-09-22T04:02:29.823311+0000","last_clean":"2024-09-22T04:02:29.823311+0000","last_became_active":"2024-09-22T03:49:15.110506+0000","last_became_peered":"2024-09-22T03:49:15.110506+0000","last_unstale":"2024-09-22T04:02:29.823311+0000","last_undegraded":"2024-09-22T04:02:29.823311+0000","last_fullsized":"2024-09-22T04:02:29.823311+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"80'1543","reported_seq":1555,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:04:46.223520+0000","last_change":"2024-09-22T04:02:28.954190+0000","last_active":"2024-09-22T04:04:46.223520+0000","last_peered":"2024-09-22T04:04:46.223520+0000","last_clean":"2024-09-22T04:04:46.223520+0000","last_became_active":"2024-09-22T04:02:28.946807+0000","last_became_peered":"2024-09-22T04:02:28.946807+0000","last_unstale":"2024-09-22T04:04:46.223520+0000","last_undegraded":"2024-09-22T04:04:46.223520+0000","last_fullsized":"2024-09-22T04:04:46.223520+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1543,"log_dups_size":0,"ondisk_log_size":1543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33357824,"num_objects":509,"num_object_clones":0,"num_object_copies":1527,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1543,"num_write_kb":65664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":208,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:29.820857+0000","last_change":"2024-09-22T03:49:17.032989+0000","last_active":"2024-09-22T04:02:29.820857+0000","last_peered":"2024-09-22T04:02:29.820857+0000","last_clean":"2024-09-22T04:02:29.820857+0000","last_became_active":"2024-09-22T03:49:15.079260+0000","last_became_peered":"2024-09-22T03:49:15.079260+0000","last_unstale":"2024-09-22T04:02:29.820857+0000","last_undegraded":"2024-09-22T04:02:29.820857+0000","last_fullsized":"2024-09-22T04:02:29.820857+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3","version":"80'1406","reported_seq":1418,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:04:45.242812+0000","last_change":"2024-09-22T04:02:28.924084+0000","last_active":"2024-09-22T04:04:45.242812+0000","last_peered":"2024-09-22T04:04:45.242812+0000","last_clean":"2024-09-22T04:04:45.242812+0000","last_became_active":"2024-09-22T04:02:28.898697+0000","last_became_peered":"2024-09-22T04:02:28.898697+0000","last_unstale":"2024-09-22T04:04:45.242812+0000","last_undegraded":"2024-09-22T04:04:45.242812+0000","last_fullsized":"2024-09-22T04:04:45.242812+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1406,"log_dups_size":0,"ondisk_log_size":1406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":480,"num_object_clones":0,"num_object_copies":1440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1406,"num_write_kb":60352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":208,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:29.823587+0000","last_change":"2024-09-22T03:49:17.036402+0000","last_active":"2024-09-22T04:02:29.823587+0000","last_peered":"2024-09-22T04:02:29.823587+0000","last_clean":"2024-09-22T04:02:29.823587+0000","last_became_active":"2024-09-22T03:49:15.108430+0000","last_became_peered":"2024-09-22T03:49:15.108430+0000","last_unstale":"2024-09-22T04:02:29.823587+0000","last_undegraded":"2024-09-22T04:02:29.823587+0000","last_fullsized":"2024-09-22T04:02:29.823587+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"80'1447","reported_seq":1459,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:04:45.005040+0000","last_change":"2024-09-22T04:02:29.018532+0000","last_active":"2024-09-22T04:04:45.005040+0000","last_peered":"2024-09-22T04:04:45.005040+0000","last_clean":"2024-09-22T04:04:45.005040+0000","last_became_active":"2024-09-22T04:02:29.006046+0000","last_became_peered":"2024-09-22T04:02:29.006046+0000","last_unstale":"2024-09-22T04:04:45.005040+0000","last_undegraded":"2024-09-22T04:04:45.005040+0000","last_fullsized":"2024-09-22T04:04:45.005040+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1447,"log_dups_size":0,"ondisk_log_size":1447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33619968,"num_objects":513,"num_object_clones":0,"num_object_copies":1539,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1447,"num_write_kb":62720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":208,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:29.815415+0000","last_change":"2024-09-22T03:49:17.029128+0000","last_active":"2024-09-22T04:02:29.815415+0000","last_peered":"2024-09-22T04:02:29.815415+0000","last_clean":"2024-09-22T04:02:29.815415+0000","last_became_active":"2024-09-22T03:49:15.113396+0000","last_became_peered":"2024-09-22T03:49:15.113396+0000","last_unstale":"2024-09-22T04:02:29.815415+0000","last_undegraded":"2024-09-22T04:02:29.815415+0000","last_fullsized":"2024-09-22T04:02:29.815415+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":519438360,"num_objects":7927,"num_object_clones":0,"num_object_copies":23781,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":23469,"num_write_kb":1004609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":97579008,"data_stored":1561067592,"data_compressed":74127837,"data_compressed_allocated":97566720,"data_compressed_original":1561067520,"omap_allocated":0,"internal_metadata":0},"log_size":23469,"ondisk_log_size":23469,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949673893,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":139404,"kb_used_data":18168,"kb_used_omap":0,"kb_used_meta":121216,"kb_avail":94232436,"statfs":{"total":96636764160,"available":96494014464,"internally_reserved":0,"allocated":18604032,"data_stored":286578530,"data_compressed":13598375,"data_compressed_allocated":17899520,"data_compressed_original":286310400,"omap_allocated":0,"internal_metadata":124125184},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654706597,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":69780,"kb_used_data":26948,"kb_used_omap":0,"kb_used_meta":42816,"kb_avail":94302060,"statfs":{"total":96636764160,"available":96565309440,"internally_reserved":0,"allocated":27594752,"data_stored":430822722,"data_compressed":20445840,"data_compressed_allocated":26910720,"data_compressed_original":430571520,"omap_allocated":0,"internal_metadata":43843584},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706596,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":62136,"kb_used_data":23208,"kb_used_omap":0,"kb_used_meta":38912,"kb_avail":94309704,"statfs":{"total":96636764160,"available":96573136896,"internally_reserved":0,"allocated":23764992,"data_stored":369219402,"data_compressed":17522607,"data_compressed_allocated":23064576,"data_compressed_original":368951296,"omap_allocated":0,"internal_metadata":39845888},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706596,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":70372,"kb_used_data":30992,"kb_used_omap":0,"kb_used_meta":39360,"kb_avail":94301468,"statfs":{"total":96636764160,"available":96564703232,"internally_reserved":0,"allocated":31735808,"data_stored":496752463,"data_compressed":23578559,"data_compressed_allocated":31035392,"data_compressed_original":496484352,"omap_allocated":0,"internal_metadata":40304640},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":30543872,"data_stored":488636440,"data_compressed":23203071,"data_compressed_allocated":30539776,"data_compressed_original":488636416,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":17813504,"data_stored":284950552,"data_compressed":13530975,"data_compressed_allocated":17809408,"data_compressed_original":284950528,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":22589440,"data_stored":361431040,"data_compressed":17162679,"data_compressed_allocated":22589440,"data_compressed_original":361431040,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":26632192,"data_stored":426049560,"data_compressed":20231112,"data_compressed_allocated":26628096,"data_compressed_original":426049536,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T04:04:51.583 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T04:04:51.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:04:51.738+0000 7f6b5debd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:04:51.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:04:51.749+0000 7f6b5debd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:04:54.056 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T04:04:54.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:04:54.212+0000 7faa48791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:04:54.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:04:54.222+0000 7faa48791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:04:54.799 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T04:04:54.799 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T04:04:54.799 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T04:04:54.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:04:54.950+0000 7fa549b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:04:54.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:04:54.961+0000 7fa549b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:04:55.226 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T04:04:55.227 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-22T04:04:55.246 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":546,"stamp":"2024-09-22T04:04:55.161867+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":466420299,"num_objects":7113,"num_object_clones":0,"num_object_copies":21339,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":24368,"num_write_kb":1005717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24342,"ondisk_log_size":24342,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":327828,"kb_used_data":89620,"kb_used_omap":0,"kb_used_meta":238144,"kb_avail":377159532,"statfs":{"total":386547056640,"available":386211360768,"internally_reserved":0,"allocated":91770880,"data_stored":1424513853,"data_compressed":67601893,"data_compressed_allocated":88981504,"data_compressed_original":1423458304,"omap_allocated":0,"internal_metadata":243859456},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-108396544,"num_objects":-1654,"num_object_clones":0,"num_object_copies":-4962,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1654,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002428"},"pg_stats":[{"pgid":"7.f","version":"80'1456","reported_seq":1468,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:04:50.328898+0000","last_change":"2024-09-22T04:02:28.979477+0000","last_active":"2024-09-22T04:04:50.328898+0000","last_peered":"2024-09-22T04:04:50.328898+0000","last_clean":"2024-09-22T04:04:50.328898+0000","last_became_active":"2024-09-22T04:02:28.971367+0000","last_became_peered":"2024-09-22T04:02:28.971367+0000","last_unstale":"2024-09-22T04:04:50.328898+0000","last_undegraded":"2024-09-22T04:04:50.328898+0000","last_fullsized":"2024-09-22T04:04:50.328898+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1456,"log_dups_size":0,"ondisk_log_size":1456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26607616,"num_objects":406,"num_object_clones":0,"num_object_copies":1218,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1456,"num_write_kb":59584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"80'1504","reported_seq":1516,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:04:50.124045+0000","last_change":"2024-09-22T04:02:28.872853+0000","last_active":"2024-09-22T04:04:50.124045+0000","last_peered":"2024-09-22T04:04:50.124045+0000","last_clean":"2024-09-22T04:04:50.124045+0000","last_became_active":"2024-09-22T04:02:28.865538+0000","last_became_peered":"2024-09-22T04:02:28.865538+0000","last_unstale":"2024-09-22T04:04:50.124045+0000","last_undegraded":"2024-09-22T04:04:50.124045+0000","last_fullsized":"2024-09-22T04:04:50.124045+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1504,"log_dups_size":0,"ondisk_log_size":1504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30015488,"num_objects":458,"num_object_clones":0,"num_object_copies":1374,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1504,"num_write_kb":62784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.d","version":"80'1545","reported_seq":1558,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:04:51.043843+0000","last_change":"2024-09-22T04:02:28.967443+0000","last_active":"2024-09-22T04:04:51.043843+0000","last_peered":"2024-09-22T04:04:51.043843+0000","last_clean":"2024-09-22T04:04:51.043843+0000","last_became_active":"2024-09-22T04:02:28.959444+0000","last_became_peered":"2024-09-22T04:02:28.959444+0000","last_unstale":"2024-09-22T04:04:51.043843+0000","last_undegraded":"2024-09-22T04:04:51.043843+0000","last_fullsized":"2024-09-22T04:04:51.043843+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1545,"log_dups_size":0,"ondisk_log_size":1545,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29229080,"num_objects":447,"num_object_clones":0,"num_object_copies":1341,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1545,"num_write_kb":63681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"80'1493","reported_seq":1505,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:04:49.866720+0000","last_change":"2024-09-22T04:02:28.963918+0000","last_active":"2024-09-22T04:04:49.866720+0000","last_peered":"2024-09-22T04:04:49.866720+0000","last_clean":"2024-09-22T04:04:49.866720+0000","last_became_active":"2024-09-22T04:02:28.948540+0000","last_became_peered":"2024-09-22T04:02:28.948540+0000","last_unstale":"2024-09-22T04:04:49.866720+0000","last_undegraded":"2024-09-22T04:04:49.866720+0000","last_fullsized":"2024-09-22T04:04:49.866720+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1493,"log_dups_size":0,"ondisk_log_size":1493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28377088,"num_objects":433,"num_object_clones":0,"num_object_copies":1299,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1493,"num_write_kb":61632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"80'1546","reported_seq":1558,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:04:51.220231+0000","last_change":"2024-09-22T04:02:28.971728+0000","last_active":"2024-09-22T04:04:51.220231+0000","last_peered":"2024-09-22T04:04:51.220231+0000","last_clean":"2024-09-22T04:04:51.220231+0000","last_became_active":"2024-09-22T04:02:28.960293+0000","last_became_peered":"2024-09-22T04:02:28.960293+0000","last_unstale":"2024-09-22T04:04:51.220231+0000","last_undegraded":"2024-09-22T04:04:51.220231+0000","last_fullsized":"2024-09-22T04:04:51.220231+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1546,"log_dups_size":0,"ondisk_log_size":1546,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28573696,"num_objects":436,"num_object_clones":0,"num_object_copies":1308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1546,"num_write_kb":63424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"80'1450","reported_seq":1462,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:04:51.105915+0000","last_change":"2024-09-22T04:02:29.026441+0000","last_active":"2024-09-22T04:04:51.105915+0000","last_peered":"2024-09-22T04:04:51.105915+0000","last_clean":"2024-09-22T04:04:51.105915+0000","last_became_active":"2024-09-22T04:02:28.991656+0000","last_became_peered":"2024-09-22T04:02:28.991656+0000","last_unstale":"2024-09-22T04:04:51.105915+0000","last_undegraded":"2024-09-22T04:04:51.105915+0000","last_fullsized":"2024-09-22T04:04:51.105915+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1450,"log_dups_size":0,"ondisk_log_size":1450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28704768,"num_objects":438,"num_object_clones":0,"num_object_copies":1314,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1450,"num_write_kb":60416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.9","version":"80'1625","reported_seq":1637,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:04:50.147698+0000","last_change":"2024-09-22T04:02:28.996162+0000","last_active":"2024-09-22T04:04:50.147698+0000","last_peered":"2024-09-22T04:04:50.147698+0000","last_clean":"2024-09-22T04:04:50.147698+0000","last_became_active":"2024-09-22T04:02:28.990154+0000","last_became_peered":"2024-09-22T04:02:28.990154+0000","last_unstale":"2024-09-22T04:04:50.147698+0000","last_undegraded":"2024-09-22T04:04:50.147698+0000","last_fullsized":"2024-09-22T04:04:50.147698+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1625,"log_dups_size":0,"ondisk_log_size":1625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30474240,"num_objects":465,"num_object_clones":0,"num_object_copies":1395,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1625,"num_write_kb":66880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"80'1622","reported_seq":1634,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:04:50.223404+0000","last_change":"2024-09-22T04:02:28.902123+0000","last_active":"2024-09-22T04:04:50.223404+0000","last_peered":"2024-09-22T04:04:50.223404+0000","last_clean":"2024-09-22T04:04:50.223404+0000","last_became_active":"2024-09-22T04:02:28.895508+0000","last_became_peered":"2024-09-22T04:02:28.895508+0000","last_unstale":"2024-09-22T04:04:50.223404+0000","last_undegraded":"2024-09-22T04:04:50.223404+0000","last_fullsized":"2024-09-22T04:04:50.223404+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1622,"log_dups_size":0,"ondisk_log_size":1622,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31981568,"num_objects":488,"num_object_clones":0,"num_object_copies":1464,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1622,"num_write_kb":67520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.6","version":"80'1451","reported_seq":1463,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:04:50.127929+0000","last_change":"2024-09-22T04:02:29.024059+0000","last_active":"2024-09-22T04:04:50.127929+0000","last_peered":"2024-09-22T04:04:50.127929+0000","last_clean":"2024-09-22T04:04:50.127929+0000","last_became_active":"2024-09-22T04:02:29.013699+0000","last_became_peered":"2024-09-22T04:02:29.013699+0000","last_unstale":"2024-09-22T04:04:50.127929+0000","last_undegraded":"2024-09-22T04:04:50.127929+0000","last_fullsized":"2024-09-22T04:04:50.127929+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1451,"log_dups_size":0,"ondisk_log_size":1451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26542080,"num_objects":405,"num_object_clones":0,"num_object_copies":1215,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1451,"num_write_kb":59392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":283,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:29.819502+0000","last_change":"2024-09-22T03:49:12.034704+0000","last_active":"2024-09-22T04:02:29.819502+0000","last_peered":"2024-09-22T04:02:29.819502+0000","last_clean":"2024-09-22T04:02:29.819502+0000","last_became_active":"2024-09-22T03:49:12.027470+0000","last_became_peered":"2024-09-22T03:49:12.027470+0000","last_unstale":"2024-09-22T04:02:29.819502+0000","last_undegraded":"2024-09-22T04:02:29.819502+0000","last_fullsized":"2024-09-22T04:02:29.819502+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_clean_scrub_stamp":"2024-09-22T03:49:10.979949+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":209,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:29.818606+0000","last_change":"2024-09-22T03:49:17.031458+0000","last_active":"2024-09-22T04:02:29.818606+0000","last_peered":"2024-09-22T04:02:29.818606+0000","last_clean":"2024-09-22T04:02:29.818606+0000","last_became_active":"2024-09-22T03:49:15.125490+0000","last_became_peered":"2024-09-22T03:49:15.125490+0000","last_unstale":"2024-09-22T04:02:29.818606+0000","last_undegraded":"2024-09-22T04:02:29.818606+0000","last_fullsized":"2024-09-22T04:02:29.818606+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"80'1532","reported_seq":1544,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:04:50.161813+0000","last_change":"2024-09-22T04:02:28.912870+0000","last_active":"2024-09-22T04:04:50.161813+0000","last_peered":"2024-09-22T04:04:50.161813+0000","last_clean":"2024-09-22T04:04:50.161813+0000","last_became_active":"2024-09-22T04:02:28.905573+0000","last_became_peered":"2024-09-22T04:02:28.905573+0000","last_unstale":"2024-09-22T04:04:50.161813+0000","last_undegraded":"2024-09-22T04:04:50.161813+0000","last_fullsized":"2024-09-22T04:04:50.161813+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1532,"log_dups_size":0,"ondisk_log_size":1532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29753344,"num_objects":454,"num_object_clones":0,"num_object_copies":1362,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1532,"num_write_kb":63552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":208,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:29.815930+0000","last_change":"2024-09-22T03:49:17.029339+0000","last_active":"2024-09-22T04:02:29.815930+0000","last_peered":"2024-09-22T04:02:29.815930+0000","last_clean":"2024-09-22T04:02:29.815930+0000","last_became_active":"2024-09-22T03:49:15.097304+0000","last_became_peered":"2024-09-22T03:49:15.097304+0000","last_unstale":"2024-09-22T04:02:29.815930+0000","last_undegraded":"2024-09-22T04:02:29.815930+0000","last_fullsized":"2024-09-22T04:02:29.815930+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"80'1510","reported_seq":1522,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:04:50.287435+0000","last_change":"2024-09-22T04:02:28.928198+0000","last_active":"2024-09-22T04:04:50.287435+0000","last_peered":"2024-09-22T04:04:50.287435+0000","last_clean":"2024-09-22T04:04:50.287435+0000","last_became_active":"2024-09-22T04:02:28.909503+0000","last_became_peered":"2024-09-22T04:02:28.909503+0000","last_unstale":"2024-09-22T04:04:50.287435+0000","last_undegraded":"2024-09-22T04:04:50.287435+0000","last_fullsized":"2024-09-22T04:04:50.287435+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1510,"log_dups_size":0,"ondisk_log_size":1510,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28442624,"num_objects":434,"num_object_clones":0,"num_object_copies":1302,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1510,"num_write_kb":62208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":208,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:29.822286+0000","last_change":"2024-09-22T03:49:17.029349+0000","last_active":"2024-09-22T04:02:29.822286+0000","last_peered":"2024-09-22T04:02:29.822286+0000","last_clean":"2024-09-22T04:02:29.822286+0000","last_became_active":"2024-09-22T03:49:15.094890+0000","last_became_peered":"2024-09-22T03:49:15.094890+0000","last_unstale":"2024-09-22T04:02:29.822286+0000","last_undegraded":"2024-09-22T04:02:29.822286+0000","last_fullsized":"2024-09-22T04:02:29.822286+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.7","version":"80'1535","reported_seq":1547,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:04:50.134243+0000","last_change":"2024-09-22T04:02:28.945388+0000","last_active":"2024-09-22T04:04:50.134243+0000","last_peered":"2024-09-22T04:04:50.134243+0000","last_clean":"2024-09-22T04:04:50.134243+0000","last_became_active":"2024-09-22T04:02:28.939479+0000","last_became_peered":"2024-09-22T04:02:28.939479+0000","last_unstale":"2024-09-22T04:04:50.134243+0000","last_undegraded":"2024-09-22T04:04:50.134243+0000","last_fullsized":"2024-09-22T04:04:50.134243+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1535,"log_dups_size":0,"ondisk_log_size":1535,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28901376,"num_objects":441,"num_object_clones":0,"num_object_copies":1323,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1535,"num_write_kb":63232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":210,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:29.820716+0000","last_change":"2024-09-22T03:49:17.031466+0000","last_active":"2024-09-22T04:02:29.820716+0000","last_peered":"2024-09-22T04:02:29.820716+0000","last_clean":"2024-09-22T04:02:29.820716+0000","last_became_active":"2024-09-22T03:49:15.098420+0000","last_became_peered":"2024-09-22T03:49:15.098420+0000","last_unstale":"2024-09-22T04:02:29.820716+0000","last_undegraded":"2024-09-22T04:02:29.820716+0000","last_fullsized":"2024-09-22T04:02:29.820716+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1","version":"80'1467","reported_seq":1479,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:04:50.068889+0000","last_change":"2024-09-22T04:02:28.927518+0000","last_active":"2024-09-22T04:04:50.068889+0000","last_peered":"2024-09-22T04:04:50.068889+0000","last_clean":"2024-09-22T04:04:50.068889+0000","last_became_active":"2024-09-22T04:02:28.919323+0000","last_became_peered":"2024-09-22T04:02:28.919323+0000","last_unstale":"2024-09-22T04:04:50.068889+0000","last_undegraded":"2024-09-22T04:04:50.068889+0000","last_fullsized":"2024-09-22T04:04:50.068889+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1467,"log_dups_size":0,"ondisk_log_size":1467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29949952,"num_objects":457,"num_object_clones":0,"num_object_copies":1371,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1467,"num_write_kb":61568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":208,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:29.823311+0000","last_change":"2024-09-22T03:49:17.036954+0000","last_active":"2024-09-22T04:02:29.823311+0000","last_peered":"2024-09-22T04:02:29.823311+0000","last_clean":"2024-09-22T04:02:29.823311+0000","last_became_active":"2024-09-22T03:49:15.110506+0000","last_became_peered":"2024-09-22T03:49:15.110506+0000","last_unstale":"2024-09-22T04:02:29.823311+0000","last_undegraded":"2024-09-22T04:02:29.823311+0000","last_fullsized":"2024-09-22T04:02:29.823311+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"80'1594","reported_seq":1606,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:04:50.888671+0000","last_change":"2024-09-22T04:02:28.954190+0000","last_active":"2024-09-22T04:04:50.888671+0000","last_peered":"2024-09-22T04:04:50.888671+0000","last_clean":"2024-09-22T04:04:50.888671+0000","last_became_active":"2024-09-22T04:02:28.946807+0000","last_became_peered":"2024-09-22T04:02:28.946807+0000","last_unstale":"2024-09-22T04:04:50.888671+0000","last_undegraded":"2024-09-22T04:04:50.888671+0000","last_fullsized":"2024-09-22T04:04:50.888671+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1594,"log_dups_size":0,"ondisk_log_size":1594,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30015488,"num_objects":458,"num_object_clones":0,"num_object_copies":1374,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1594,"num_write_kb":65664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":208,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:29.820857+0000","last_change":"2024-09-22T03:49:17.032989+0000","last_active":"2024-09-22T04:02:29.820857+0000","last_peered":"2024-09-22T04:02:29.820857+0000","last_clean":"2024-09-22T04:02:29.820857+0000","last_became_active":"2024-09-22T03:49:15.079260+0000","last_became_peered":"2024-09-22T03:49:15.079260+0000","last_unstale":"2024-09-22T04:02:29.820857+0000","last_undegraded":"2024-09-22T04:02:29.820857+0000","last_fullsized":"2024-09-22T04:02:29.820857+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3","version":"80'1453","reported_seq":1465,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:04:50.063554+0000","last_change":"2024-09-22T04:02:28.924084+0000","last_active":"2024-09-22T04:04:50.063554+0000","last_peered":"2024-09-22T04:04:50.063554+0000","last_clean":"2024-09-22T04:04:50.063554+0000","last_became_active":"2024-09-22T04:02:28.898697+0000","last_became_peered":"2024-09-22T04:02:28.898697+0000","last_unstale":"2024-09-22T04:04:50.063554+0000","last_undegraded":"2024-09-22T04:04:50.063554+0000","last_fullsized":"2024-09-22T04:04:50.063554+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1453,"log_dups_size":0,"ondisk_log_size":1453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28377088,"num_objects":433,"num_object_clones":0,"num_object_copies":1299,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1453,"num_write_kb":60352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":208,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:29.823587+0000","last_change":"2024-09-22T03:49:17.036402+0000","last_active":"2024-09-22T04:02:29.823587+0000","last_peered":"2024-09-22T04:02:29.823587+0000","last_clean":"2024-09-22T04:02:29.823587+0000","last_became_active":"2024-09-22T03:49:15.108430+0000","last_became_peered":"2024-09-22T03:49:15.108430+0000","last_unstale":"2024-09-22T04:02:29.823587+0000","last_undegraded":"2024-09-22T04:02:29.823587+0000","last_fullsized":"2024-09-22T04:02:29.823587+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"80'1504","reported_seq":1516,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:04:50.314673+0000","last_change":"2024-09-22T04:02:29.018532+0000","last_active":"2024-09-22T04:04:50.314673+0000","last_peered":"2024-09-22T04:04:50.314673+0000","last_clean":"2024-09-22T04:04:50.314673+0000","last_became_active":"2024-09-22T04:02:29.006046+0000","last_became_peered":"2024-09-22T04:02:29.006046+0000","last_unstale":"2024-09-22T04:04:50.314673+0000","last_undegraded":"2024-09-22T04:04:50.314673+0000","last_fullsized":"2024-09-22T04:04:50.314673+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1504,"log_dups_size":0,"ondisk_log_size":1504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29884416,"num_objects":456,"num_object_clones":0,"num_object_copies":1368,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1504,"num_write_kb":62720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":208,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:29.815415+0000","last_change":"2024-09-22T03:49:17.029128+0000","last_active":"2024-09-22T04:02:29.815415+0000","last_peered":"2024-09-22T04:02:29.815415+0000","last_clean":"2024-09-22T04:02:29.815415+0000","last_became_active":"2024-09-22T03:49:15.113396+0000","last_became_peered":"2024-09-22T03:49:15.113396+0000","last_unstale":"2024-09-22T04:02:29.815415+0000","last_undegraded":"2024-09-22T04:02:29.815415+0000","last_fullsized":"2024-09-22T04:02:29.815415+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":465829912,"num_objects":7109,"num_object_clones":0,"num_object_copies":21327,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":24287,"num_write_kb":1004609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":87597056,"data_stored":1401356360,"data_compressed":66543893,"data_compressed_allocated":87584768,"data_compressed_original":1401356288,"omap_allocated":0,"internal_metadata":0},"log_size":24287,"ondisk_log_size":24287,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949673898,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":137568,"kb_used_data":16336,"kb_used_omap":0,"kb_used_meta":121216,"kb_avail":94234272,"statfs":{"total":96636764160,"available":96495894528,"internally_reserved":0,"allocated":16728064,"data_stored":256563042,"data_compressed":12173079,"data_compressed_allocated":16023552,"data_compressed_original":256294912,"omap_allocated":0,"internal_metadata":124125184},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654706602,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":54748,"kb_used_data":24396,"kb_used_omap":0,"kb_used_meta":30336,"kb_avail":94317092,"statfs":{"total":96636764160,"available":96580702208,"internally_reserved":0,"allocated":24981504,"data_stored":389010754,"data_compressed":18460384,"data_compressed_allocated":24297472,"data_compressed_original":388759552,"omap_allocated":0,"internal_metadata":31064064},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706601,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":64032,"kb_used_data":20944,"kb_used_omap":0,"kb_used_meta":43072,"kb_avail":94307808,"statfs":{"total":96636764160,"available":96571195392,"internally_reserved":0,"allocated":21446656,"data_stored":332126026,"data_compressed":15761215,"data_compressed_allocated":20746240,"data_compressed_original":331857920,"omap_allocated":0,"internal_metadata":44105728},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706601,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":71480,"kb_used_data":27944,"kb_used_omap":0,"kb_used_meta":43520,"kb_avail":94300360,"statfs":{"total":96636764160,"available":96563568640,"internally_reserved":0,"allocated":28614656,"data_stored":446814031,"data_compressed":21207215,"data_compressed_allocated":27914240,"data_compressed_original":446545920,"omap_allocated":0,"internal_metadata":44564480},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":27422720,"data_stored":438698008,"data_compressed":20831727,"data_compressed_allocated":27418624,"data_compressed_original":438697984,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":15949824,"data_stored":255131672,"data_compressed":12115015,"data_compressed_allocated":15945728,"data_compressed_original":255131648,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20246528,"data_stored":323944448,"data_compressed":15382615,"data_compressed_allocated":20246528,"data_compressed_original":323944448,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":23977984,"data_stored":383582232,"data_compressed":18214536,"data_compressed_allocated":23973888,"data_compressed_original":383582208,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T04:04:56.582 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T04:04:56.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:04:56.738+0000 7f6ecd28e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:04:56.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:04:56.746+0000 7f6ecd28e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:04:59.370 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T04:04:59.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:04:59.516+0000 7fb2376ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:04:59.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:04:59.527+0000 7fb23644a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:00.248 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T04:05:00.248 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T04:05:00.249 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T04:05:00.249 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T04:05:00.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:00.412+0000 7f0861b11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:00.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:00.426+0000 7f0861b11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:00.667 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:05:00.667 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:05:00.667 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:05:00.667 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:05:00.667 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:05:00.667 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:05:00.667 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:05:00.667 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:05:00.667 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:05:00.668 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:05:00.668 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:05:00.668 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:05:00.670 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:05:00.671 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:05:00.671 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T04:05:00.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:00.829+0000 7f54ffb51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:00.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:00.844+0000 7f54ffb51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:00.892 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:05:00.892 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:05:00.892 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:05:00.892 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:05:00.892 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:05:00.892 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:05:00.893 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:05:00.893 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:05:00.893 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:05:00.893 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:05:00.893 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:05:00.893 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:05:00.897 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:05:00.897 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:05:00.897 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T04:05:01.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:01.044+0000 7fc5822d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:01.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:01.061+0000 7fc5822d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:01.084 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:05:01.084 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:05:01.084 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:05:01.084 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:05:01.084 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:05:01.084 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:05:01.084 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:05:01.084 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:05:01.084 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:05:01.085 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:05:01.085 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:05:01.085 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:05:01.088 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:05:01.088 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:05:01.088 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T04:05:01.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:01.227+0000 7f9b8cf91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:01.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:01.240+0000 7f9b8cf91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:01.387 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:05:01.387 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:05:01.387 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:05:01.387 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:05:01.387 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:05:01.387 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:05:01.387 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:05:01.387 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:05:01.387 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:05:01.387 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:05:01.387 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:05:01.388 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:05:01.390 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:05:01.390 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:05:02.080 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T04:05:02.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:02.254+0000 7fed5b0d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:02.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:02.263+0000 7fed5b0d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:04.787 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T04:05:04.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:04.954+0000 7f3ddf751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:04.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:04.967+0000 7f3ddf751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:06.391 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T04:05:06.392 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-22T04:05:06.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:06.546+0000 7f62f4151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:06.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:06.560+0000 7f62f4151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:07.218 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T04:05:07.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:07.373+0000 7ff2b54b4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:07.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:07.383+0000 7ff2b54b4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:07.803 INFO:teuthology.orchestra.run.smithi037.stderr:reweighted osd.0 to 1 (10000) 2024-09-22T04:05:07.829 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-22T04:05:08.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:08.017+0000 7fa6fdb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:08.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:08.037+0000 7fa6fdb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:08.810 INFO:teuthology.orchestra.run.smithi037.stderr:reweighted osd.1 to 1 (10000) 2024-09-22T04:05:08.832 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-22T04:05:09.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:09.035+0000 7f2e22151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:09.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:09.058+0000 7f2e22151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:09.816 INFO:teuthology.orchestra.run.smithi037.stderr:reweighted osd.2 to 1 (10000) 2024-09-22T04:05:09.837 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-22T04:05:09.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:09.983+0000 7f73f1d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:09.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:09.998+0000 7f73f1d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:10.016 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T04:05:10.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:10.185+0000 7f619fd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:10.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:10.195+0000 7f619eb2f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:10.826 INFO:teuthology.orchestra.run.smithi037.stderr:reweighted osd.3 to 1 (10000) 2024-09-22T04:05:10.851 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-22T04:05:10.851 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T04:05:11.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:11.060+0000 7f1b5cb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:11.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:11.072+0000 7f1b5cb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:11.427 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T04:05:11.427 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-22T04:05:11.449 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":558,"stamp":"2024-09-22T04:05:11.165066+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":275645003,"num_objects":4202,"num_object_clones":0,"num_object_copies":12606,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":27279,"num_write_kb":1005717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":27253,"ondisk_log_size":27253,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":205168,"kb_used_data":52908,"kb_used_omap":0,"kb_used_meta":151744,"kb_avail":377282192,"statfs":{"total":386547056640,"available":386336964608,"internally_reserved":0,"allocated":54177792,"data_stored":833038583,"data_compressed":39525431,"data_compressed_allocated":52027392,"data_compressed_original":832192512,"omap_allocated":0,"internal_metadata":155385856},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-37617664,"num_objects":-574,"num_object_clones":0,"num_object_copies":-1722,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":574,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000743"},"pg_stats":[{"pgid":"7.f","version":"83'1622","reported_seq":1643,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-22T04:05:10.330153+0000","last_change":"2024-09-22T04:02:28.979477+0000","last_active":"2024-09-22T04:05:10.330153+0000","last_peered":"2024-09-22T04:05:10.330153+0000","last_clean":"2024-09-22T04:05:10.330153+0000","last_became_active":"2024-09-22T04:02:28.971367+0000","last_became_peered":"2024-09-22T04:02:28.971367+0000","last_unstale":"2024-09-22T04:05:10.330153+0000","last_undegraded":"2024-09-22T04:05:10.330153+0000","last_fullsized":"2024-09-22T04:05:10.330153+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1622,"log_dups_size":0,"ondisk_log_size":1622,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15728640,"num_objects":240,"num_object_clones":0,"num_object_copies":720,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1622,"num_write_kb":59584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"83'1694","reported_seq":1715,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-22T04:05:10.104584+0000","last_change":"2024-09-22T04:02:28.872853+0000","last_active":"2024-09-22T04:05:10.104584+0000","last_peered":"2024-09-22T04:05:10.104584+0000","last_clean":"2024-09-22T04:05:10.104584+0000","last_became_active":"2024-09-22T04:02:28.865538+0000","last_became_peered":"2024-09-22T04:02:28.865538+0000","last_unstale":"2024-09-22T04:05:10.104584+0000","last_undegraded":"2024-09-22T04:05:10.104584+0000","last_fullsized":"2024-09-22T04:05:10.104584+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1694,"log_dups_size":0,"ondisk_log_size":1694,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17563648,"num_objects":268,"num_object_clones":0,"num_object_copies":804,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1694,"num_write_kb":62784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.d","version":"80'1697","reported_seq":1710,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:05:06.270987+0000","last_change":"2024-09-22T04:02:28.967443+0000","last_active":"2024-09-22T04:05:06.270987+0000","last_peered":"2024-09-22T04:05:06.270987+0000","last_clean":"2024-09-22T04:05:06.270987+0000","last_became_active":"2024-09-22T04:02:28.959444+0000","last_became_peered":"2024-09-22T04:02:28.959444+0000","last_unstale":"2024-09-22T04:05:06.270987+0000","last_undegraded":"2024-09-22T04:05:06.270987+0000","last_fullsized":"2024-09-22T04:05:06.270987+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1697,"log_dups_size":0,"ondisk_log_size":1697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19267608,"num_objects":295,"num_object_clones":0,"num_object_copies":885,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1697,"num_write_kb":63681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"83'1691","reported_seq":1712,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-22T04:05:10.127489+0000","last_change":"2024-09-22T04:02:28.963918+0000","last_active":"2024-09-22T04:05:10.127489+0000","last_peered":"2024-09-22T04:05:10.127489+0000","last_clean":"2024-09-22T04:05:10.127489+0000","last_became_active":"2024-09-22T04:02:28.948540+0000","last_became_peered":"2024-09-22T04:02:28.948540+0000","last_unstale":"2024-09-22T04:05:10.127489+0000","last_undegraded":"2024-09-22T04:05:10.127489+0000","last_fullsized":"2024-09-22T04:05:10.127489+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1691,"log_dups_size":0,"ondisk_log_size":1691,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15400960,"num_objects":235,"num_object_clones":0,"num_object_copies":705,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1691,"num_write_kb":61632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"80'1698","reported_seq":1710,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:05:06.118132+0000","last_change":"2024-09-22T04:02:28.971728+0000","last_active":"2024-09-22T04:05:06.118132+0000","last_peered":"2024-09-22T04:05:06.118132+0000","last_clean":"2024-09-22T04:05:06.118132+0000","last_became_active":"2024-09-22T04:02:28.960293+0000","last_became_peered":"2024-09-22T04:02:28.960293+0000","last_unstale":"2024-09-22T04:05:06.118132+0000","last_undegraded":"2024-09-22T04:05:06.118132+0000","last_fullsized":"2024-09-22T04:05:06.118132+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1698,"log_dups_size":0,"ondisk_log_size":1698,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18612224,"num_objects":284,"num_object_clones":0,"num_object_copies":852,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1698,"num_write_kb":63424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"80'1572","reported_seq":1584,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:05:06.009397+0000","last_change":"2024-09-22T04:02:29.026441+0000","last_active":"2024-09-22T04:05:06.009397+0000","last_peered":"2024-09-22T04:05:06.009397+0000","last_clean":"2024-09-22T04:05:06.009397+0000","last_became_active":"2024-09-22T04:02:28.991656+0000","last_became_peered":"2024-09-22T04:02:28.991656+0000","last_unstale":"2024-09-22T04:05:06.009397+0000","last_undegraded":"2024-09-22T04:05:06.009397+0000","last_fullsized":"2024-09-22T04:05:06.009397+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1572,"log_dups_size":0,"ondisk_log_size":1572,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20709376,"num_objects":316,"num_object_clones":0,"num_object_copies":948,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1572,"num_write_kb":60416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.9","version":"82'1827","reported_seq":1848,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-22T04:05:09.897289+0000","last_change":"2024-09-22T04:02:28.996162+0000","last_active":"2024-09-22T04:05:09.897289+0000","last_peered":"2024-09-22T04:05:09.897289+0000","last_clean":"2024-09-22T04:05:09.897289+0000","last_became_active":"2024-09-22T04:02:28.990154+0000","last_became_peered":"2024-09-22T04:02:28.990154+0000","last_unstale":"2024-09-22T04:05:09.897289+0000","last_undegraded":"2024-09-22T04:05:09.897289+0000","last_fullsized":"2024-09-22T04:05:09.897289+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1827,"log_dups_size":0,"ondisk_log_size":1827,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17235968,"num_objects":263,"num_object_clones":0,"num_object_copies":789,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1827,"num_write_kb":66880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"83'1841","reported_seq":1862,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-22T04:05:10.151362+0000","last_change":"2024-09-22T04:02:28.902123+0000","last_active":"2024-09-22T04:05:10.151362+0000","last_peered":"2024-09-22T04:05:10.151362+0000","last_clean":"2024-09-22T04:05:10.151362+0000","last_became_active":"2024-09-22T04:02:28.895508+0000","last_became_peered":"2024-09-22T04:02:28.895508+0000","last_unstale":"2024-09-22T04:05:10.151362+0000","last_undegraded":"2024-09-22T04:05:10.151362+0000","last_fullsized":"2024-09-22T04:05:10.151362+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1841,"log_dups_size":0,"ondisk_log_size":1841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17629184,"num_objects":269,"num_object_clones":0,"num_object_copies":807,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1841,"num_write_kb":67520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.6","version":"83'1625","reported_seq":1646,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-22T04:05:10.233169+0000","last_change":"2024-09-22T04:02:29.024059+0000","last_active":"2024-09-22T04:05:10.233169+0000","last_peered":"2024-09-22T04:05:10.233169+0000","last_clean":"2024-09-22T04:05:10.233169+0000","last_became_active":"2024-09-22T04:02:29.013699+0000","last_became_peered":"2024-09-22T04:02:29.013699+0000","last_unstale":"2024-09-22T04:05:10.233169+0000","last_undegraded":"2024-09-22T04:05:10.233169+0000","last_fullsized":"2024-09-22T04:05:10.233169+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1625,"log_dups_size":0,"ondisk_log_size":1625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15138816,"num_objects":231,"num_object_clones":0,"num_object_copies":693,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1625,"num_write_kb":59392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":283,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:29.819502+0000","last_change":"2024-09-22T03:49:12.034704+0000","last_active":"2024-09-22T04:02:29.819502+0000","last_peered":"2024-09-22T04:02:29.819502+0000","last_clean":"2024-09-22T04:02:29.819502+0000","last_became_active":"2024-09-22T03:49:12.027470+0000","last_became_peered":"2024-09-22T03:49:12.027470+0000","last_unstale":"2024-09-22T04:02:29.819502+0000","last_undegraded":"2024-09-22T04:02:29.819502+0000","last_fullsized":"2024-09-22T04:02:29.819502+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_clean_scrub_stamp":"2024-09-22T03:49:10.979949+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":218,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-22T04:05:09.850182+0000","last_change":"2024-09-22T03:49:17.031458+0000","last_active":"2024-09-22T04:05:09.850182+0000","last_peered":"2024-09-22T04:05:09.850182+0000","last_clean":"2024-09-22T04:05:09.850182+0000","last_became_active":"2024-09-22T03:49:15.125490+0000","last_became_peered":"2024-09-22T03:49:15.125490+0000","last_unstale":"2024-09-22T04:05:09.850182+0000","last_undegraded":"2024-09-22T04:05:09.850182+0000","last_fullsized":"2024-09-22T04:05:09.850182+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"83'1732","reported_seq":1753,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-22T04:05:09.983418+0000","last_change":"2024-09-22T04:02:28.912870+0000","last_active":"2024-09-22T04:05:09.983418+0000","last_peered":"2024-09-22T04:05:09.983418+0000","last_clean":"2024-09-22T04:05:09.983418+0000","last_became_active":"2024-09-22T04:02:28.905573+0000","last_became_peered":"2024-09-22T04:02:28.905573+0000","last_unstale":"2024-09-22T04:05:09.983418+0000","last_undegraded":"2024-09-22T04:05:09.983418+0000","last_fullsized":"2024-09-22T04:05:09.983418+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1732,"log_dups_size":0,"ondisk_log_size":1732,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16646144,"num_objects":254,"num_object_clones":0,"num_object_copies":762,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1732,"num_write_kb":63552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":217,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-22T04:05:09.848107+0000","last_change":"2024-09-22T03:49:17.029339+0000","last_active":"2024-09-22T04:05:09.848107+0000","last_peered":"2024-09-22T04:05:09.848107+0000","last_clean":"2024-09-22T04:05:09.848107+0000","last_became_active":"2024-09-22T03:49:15.097304+0000","last_became_peered":"2024-09-22T03:49:15.097304+0000","last_unstale":"2024-09-22T04:05:09.848107+0000","last_undegraded":"2024-09-22T04:05:09.848107+0000","last_fullsized":"2024-09-22T04:05:09.848107+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"83'1709","reported_seq":1730,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-22T04:05:10.275400+0000","last_change":"2024-09-22T04:02:28.928198+0000","last_active":"2024-09-22T04:05:10.275400+0000","last_peered":"2024-09-22T04:05:10.275400+0000","last_clean":"2024-09-22T04:05:10.275400+0000","last_became_active":"2024-09-22T04:02:28.909503+0000","last_became_peered":"2024-09-22T04:02:28.909503+0000","last_unstale":"2024-09-22T04:05:10.275400+0000","last_undegraded":"2024-09-22T04:05:10.275400+0000","last_fullsized":"2024-09-22T04:05:10.275400+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1709,"log_dups_size":0,"ondisk_log_size":1709,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15400960,"num_objects":235,"num_object_clones":0,"num_object_copies":705,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1709,"num_write_kb":62208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":217,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-22T04:05:09.855011+0000","last_change":"2024-09-22T03:49:17.029349+0000","last_active":"2024-09-22T04:05:09.855011+0000","last_peered":"2024-09-22T04:05:09.855011+0000","last_clean":"2024-09-22T04:05:09.855011+0000","last_became_active":"2024-09-22T03:49:15.094890+0000","last_became_peered":"2024-09-22T03:49:15.094890+0000","last_unstale":"2024-09-22T04:05:09.855011+0000","last_undegraded":"2024-09-22T04:05:09.855011+0000","last_fullsized":"2024-09-22T04:05:09.855011+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.7","version":"83'1735","reported_seq":1756,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-22T04:05:09.996049+0000","last_change":"2024-09-22T04:02:28.945388+0000","last_active":"2024-09-22T04:05:09.996049+0000","last_peered":"2024-09-22T04:05:09.996049+0000","last_clean":"2024-09-22T04:05:09.996049+0000","last_became_active":"2024-09-22T04:02:28.939479+0000","last_became_peered":"2024-09-22T04:02:28.939479+0000","last_unstale":"2024-09-22T04:05:09.996049+0000","last_undegraded":"2024-09-22T04:05:09.996049+0000","last_fullsized":"2024-09-22T04:05:09.996049+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1735,"log_dups_size":0,"ondisk_log_size":1735,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15794176,"num_objects":241,"num_object_clones":0,"num_object_copies":723,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1735,"num_write_kb":63232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":219,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-22T04:05:09.850892+0000","last_change":"2024-09-22T03:49:17.031466+0000","last_active":"2024-09-22T04:05:09.850892+0000","last_peered":"2024-09-22T04:05:09.850892+0000","last_clean":"2024-09-22T04:05:09.850892+0000","last_became_active":"2024-09-22T03:49:15.098420+0000","last_became_peered":"2024-09-22T03:49:15.098420+0000","last_unstale":"2024-09-22T04:05:09.850892+0000","last_undegraded":"2024-09-22T04:05:09.850892+0000","last_fullsized":"2024-09-22T04:05:09.850892+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1","version":"83'1652","reported_seq":1673,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-22T04:05:09.853013+0000","last_change":"2024-09-22T04:02:28.927518+0000","last_active":"2024-09-22T04:05:09.853013+0000","last_peered":"2024-09-22T04:05:09.853013+0000","last_clean":"2024-09-22T04:05:09.853013+0000","last_became_active":"2024-09-22T04:02:28.919323+0000","last_became_peered":"2024-09-22T04:02:28.919323+0000","last_unstale":"2024-09-22T04:05:09.853013+0000","last_undegraded":"2024-09-22T04:05:09.853013+0000","last_fullsized":"2024-09-22T04:05:09.853013+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1652,"log_dups_size":0,"ondisk_log_size":1652,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17825792,"num_objects":272,"num_object_clones":0,"num_object_copies":816,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1652,"num_write_kb":61568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":208,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:29.823311+0000","last_change":"2024-09-22T03:49:17.036954+0000","last_active":"2024-09-22T04:02:29.823311+0000","last_peered":"2024-09-22T04:02:29.823311+0000","last_clean":"2024-09-22T04:02:29.823311+0000","last_became_active":"2024-09-22T03:49:15.110506+0000","last_became_peered":"2024-09-22T03:49:15.110506+0000","last_unstale":"2024-09-22T04:02:29.823311+0000","last_undegraded":"2024-09-22T04:02:29.823311+0000","last_fullsized":"2024-09-22T04:02:29.823311+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"80'1749","reported_seq":1761,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:05:06.230467+0000","last_change":"2024-09-22T04:02:28.954190+0000","last_active":"2024-09-22T04:05:06.230467+0000","last_peered":"2024-09-22T04:05:06.230467+0000","last_clean":"2024-09-22T04:05:06.230467+0000","last_became_active":"2024-09-22T04:02:28.946807+0000","last_became_peered":"2024-09-22T04:02:28.946807+0000","last_unstale":"2024-09-22T04:05:06.230467+0000","last_undegraded":"2024-09-22T04:05:06.230467+0000","last_fullsized":"2024-09-22T04:05:06.230467+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1749,"log_dups_size":0,"ondisk_log_size":1749,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19857408,"num_objects":303,"num_object_clones":0,"num_object_copies":909,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1749,"num_write_kb":65664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":208,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:29.820857+0000","last_change":"2024-09-22T03:49:17.032989+0000","last_active":"2024-09-22T04:02:29.820857+0000","last_peered":"2024-09-22T04:02:29.820857+0000","last_clean":"2024-09-22T04:02:29.820857+0000","last_became_active":"2024-09-22T03:49:15.079260+0000","last_became_peered":"2024-09-22T03:49:15.079260+0000","last_unstale":"2024-09-22T04:02:29.820857+0000","last_undegraded":"2024-09-22T04:02:29.820857+0000","last_fullsized":"2024-09-22T04:02:29.820857+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3","version":"83'1634","reported_seq":1655,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-22T04:05:10.064960+0000","last_change":"2024-09-22T04:02:28.924084+0000","last_active":"2024-09-22T04:05:10.064960+0000","last_peered":"2024-09-22T04:05:10.064960+0000","last_clean":"2024-09-22T04:05:10.064960+0000","last_became_active":"2024-09-22T04:02:28.898697+0000","last_became_peered":"2024-09-22T04:02:28.898697+0000","last_unstale":"2024-09-22T04:05:10.064960+0000","last_undegraded":"2024-09-22T04:05:10.064960+0000","last_fullsized":"2024-09-22T04:05:10.064960+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1634,"log_dups_size":0,"ondisk_log_size":1634,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16515072,"num_objects":252,"num_object_clones":0,"num_object_copies":756,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1634,"num_write_kb":60352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":208,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:29.823587+0000","last_change":"2024-09-22T03:49:17.036402+0000","last_active":"2024-09-22T04:02:29.823587+0000","last_peered":"2024-09-22T04:02:29.823587+0000","last_clean":"2024-09-22T04:02:29.823587+0000","last_became_active":"2024-09-22T03:49:15.108430+0000","last_became_peered":"2024-09-22T03:49:15.108430+0000","last_unstale":"2024-09-22T04:02:29.823587+0000","last_undegraded":"2024-09-22T04:02:29.823587+0000","last_fullsized":"2024-09-22T04:02:29.823587+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"83'1720","reported_seq":1741,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-22T04:05:10.255405+0000","last_change":"2024-09-22T04:02:29.018532+0000","last_active":"2024-09-22T04:05:10.255405+0000","last_peered":"2024-09-22T04:05:10.255405+0000","last_clean":"2024-09-22T04:05:10.255405+0000","last_became_active":"2024-09-22T04:02:29.006046+0000","last_became_peered":"2024-09-22T04:02:29.006046+0000","last_unstale":"2024-09-22T04:05:10.255405+0000","last_undegraded":"2024-09-22T04:05:10.255405+0000","last_fullsized":"2024-09-22T04:05:10.255405+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1720,"log_dups_size":0,"ondisk_log_size":1720,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15728640,"num_objects":240,"num_object_clones":0,"num_object_copies":720,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1720,"num_write_kb":62720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":217,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-22T04:05:09.847161+0000","last_change":"2024-09-22T03:49:17.029128+0000","last_active":"2024-09-22T04:05:09.847161+0000","last_peered":"2024-09-22T04:05:09.847161+0000","last_clean":"2024-09-22T04:05:09.847161+0000","last_became_active":"2024-09-22T03:49:15.113396+0000","last_became_peered":"2024-09-22T03:49:15.113396+0000","last_unstale":"2024-09-22T04:05:09.847161+0000","last_undegraded":"2024-09-22T04:05:09.847161+0000","last_fullsized":"2024-09-22T04:05:09.847161+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":275054616,"num_objects":4198,"num_object_clones":0,"num_object_copies":12594,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":27198,"num_write_kb":1004609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":51040256,"data_stored":816447560,"data_compressed":38769295,"data_compressed_allocated":51027968,"data_compressed_original":816447488,"omap_allocated":0,"internal_metadata":0},"log_size":27198,"ondisk_log_size":27198,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949673913,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":54324,"kb_used_data":11172,"kb_used_omap":0,"kb_used_meta":43136,"kb_avail":94317516,"statfs":{"total":96636764160,"available":96581136384,"internally_reserved":0,"allocated":11440128,"data_stored":171956066,"data_compressed":8155487,"data_compressed_allocated":10735616,"data_compressed_original":171687936,"omap_allocated":0,"internal_metadata":44171264},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654706622,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":52816,"kb_used_data":13920,"kb_used_omap":0,"kb_used_meta":38656,"kb_avail":94319024,"statfs":{"total":96636764160,"available":96582680576,"internally_reserved":0,"allocated":14254080,"data_stored":220710016,"data_compressed":10471880,"data_compressed_allocated":13783040,"data_compressed_original":220528640,"omap_allocated":0,"internal_metadata":39583744},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706621,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":46832,"kb_used_data":11952,"kb_used_omap":0,"kb_used_meta":34752,"kb_avail":94325008,"statfs":{"total":96636764160,"available":96588808192,"internally_reserved":0,"allocated":12238848,"data_stored":188139144,"data_compressed":8927264,"data_compressed_allocated":11751424,"data_compressed_original":187940864,"omap_allocated":0,"internal_metadata":35586048},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706621,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":51196,"kb_used_data":15864,"kb_used_omap":0,"kb_used_meta":35200,"kb_avail":94320644,"statfs":{"total":96636764160,"available":96584339456,"internally_reserved":0,"allocated":16244736,"data_stored":252233357,"data_compressed":11970800,"data_compressed_allocated":15757312,"data_compressed_original":252035072,"omap_allocated":0,"internal_metadata":36044800},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":15425536,"data_stored":246743064,"data_compressed":11716680,"data_compressed_allocated":15421440,"data_compressed_original":246743040,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":10665984,"data_stored":170590232,"data_compressed":8100535,"data_compressed_allocated":10661888,"data_compressed_original":170590208,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":11366400,"data_stored":181862400,"data_compressed":8635800,"data_compressed_allocated":11366400,"data_compressed_original":181862400,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":13582336,"data_stored":217251864,"data_compressed":10316280,"data_compressed_allocated":13578240,"data_compressed_original":217251840,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T04:05:11.450 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T04:05:11.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:11.596+0000 7ff918f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:11.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:11.609+0000 7ff918f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:11.962 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T04:05:11.962 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-22T04:05:11.982 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":558,"stamp":"2024-09-22T04:05:11.165066+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":275645003,"num_objects":4202,"num_object_clones":0,"num_object_copies":12606,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":27279,"num_write_kb":1005717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":27253,"ondisk_log_size":27253,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":205168,"kb_used_data":52908,"kb_used_omap":0,"kb_used_meta":151744,"kb_avail":377282192,"statfs":{"total":386547056640,"available":386336964608,"internally_reserved":0,"allocated":54177792,"data_stored":833038583,"data_compressed":39525431,"data_compressed_allocated":52027392,"data_compressed_original":832192512,"omap_allocated":0,"internal_metadata":155385856},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-37617664,"num_objects":-574,"num_object_clones":0,"num_object_copies":-1722,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":574,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000743"},"pg_stats":[{"pgid":"7.f","version":"83'1622","reported_seq":1643,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-22T04:05:10.330153+0000","last_change":"2024-09-22T04:02:28.979477+0000","last_active":"2024-09-22T04:05:10.330153+0000","last_peered":"2024-09-22T04:05:10.330153+0000","last_clean":"2024-09-22T04:05:10.330153+0000","last_became_active":"2024-09-22T04:02:28.971367+0000","last_became_peered":"2024-09-22T04:02:28.971367+0000","last_unstale":"2024-09-22T04:05:10.330153+0000","last_undegraded":"2024-09-22T04:05:10.330153+0000","last_fullsized":"2024-09-22T04:05:10.330153+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1622,"log_dups_size":0,"ondisk_log_size":1622,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15728640,"num_objects":240,"num_object_clones":0,"num_object_copies":720,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1622,"num_write_kb":59584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"83'1694","reported_seq":1715,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-22T04:05:10.104584+0000","last_change":"2024-09-22T04:02:28.872853+0000","last_active":"2024-09-22T04:05:10.104584+0000","last_peered":"2024-09-22T04:05:10.104584+0000","last_clean":"2024-09-22T04:05:10.104584+0000","last_became_active":"2024-09-22T04:02:28.865538+0000","last_became_peered":"2024-09-22T04:02:28.865538+0000","last_unstale":"2024-09-22T04:05:10.104584+0000","last_undegraded":"2024-09-22T04:05:10.104584+0000","last_fullsized":"2024-09-22T04:05:10.104584+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1694,"log_dups_size":0,"ondisk_log_size":1694,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17563648,"num_objects":268,"num_object_clones":0,"num_object_copies":804,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1694,"num_write_kb":62784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.d","version":"80'1697","reported_seq":1710,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:05:06.270987+0000","last_change":"2024-09-22T04:02:28.967443+0000","last_active":"2024-09-22T04:05:06.270987+0000","last_peered":"2024-09-22T04:05:06.270987+0000","last_clean":"2024-09-22T04:05:06.270987+0000","last_became_active":"2024-09-22T04:02:28.959444+0000","last_became_peered":"2024-09-22T04:02:28.959444+0000","last_unstale":"2024-09-22T04:05:06.270987+0000","last_undegraded":"2024-09-22T04:05:06.270987+0000","last_fullsized":"2024-09-22T04:05:06.270987+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1697,"log_dups_size":0,"ondisk_log_size":1697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19267608,"num_objects":295,"num_object_clones":0,"num_object_copies":885,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1697,"num_write_kb":63681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"83'1691","reported_seq":1712,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-22T04:05:10.127489+0000","last_change":"2024-09-22T04:02:28.963918+0000","last_active":"2024-09-22T04:05:10.127489+0000","last_peered":"2024-09-22T04:05:10.127489+0000","last_clean":"2024-09-22T04:05:10.127489+0000","last_became_active":"2024-09-22T04:02:28.948540+0000","last_became_peered":"2024-09-22T04:02:28.948540+0000","last_unstale":"2024-09-22T04:05:10.127489+0000","last_undegraded":"2024-09-22T04:05:10.127489+0000","last_fullsized":"2024-09-22T04:05:10.127489+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1691,"log_dups_size":0,"ondisk_log_size":1691,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15400960,"num_objects":235,"num_object_clones":0,"num_object_copies":705,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1691,"num_write_kb":61632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"80'1698","reported_seq":1710,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:05:06.118132+0000","last_change":"2024-09-22T04:02:28.971728+0000","last_active":"2024-09-22T04:05:06.118132+0000","last_peered":"2024-09-22T04:05:06.118132+0000","last_clean":"2024-09-22T04:05:06.118132+0000","last_became_active":"2024-09-22T04:02:28.960293+0000","last_became_peered":"2024-09-22T04:02:28.960293+0000","last_unstale":"2024-09-22T04:05:06.118132+0000","last_undegraded":"2024-09-22T04:05:06.118132+0000","last_fullsized":"2024-09-22T04:05:06.118132+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1698,"log_dups_size":0,"ondisk_log_size":1698,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18612224,"num_objects":284,"num_object_clones":0,"num_object_copies":852,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1698,"num_write_kb":63424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"80'1572","reported_seq":1584,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:05:06.009397+0000","last_change":"2024-09-22T04:02:29.026441+0000","last_active":"2024-09-22T04:05:06.009397+0000","last_peered":"2024-09-22T04:05:06.009397+0000","last_clean":"2024-09-22T04:05:06.009397+0000","last_became_active":"2024-09-22T04:02:28.991656+0000","last_became_peered":"2024-09-22T04:02:28.991656+0000","last_unstale":"2024-09-22T04:05:06.009397+0000","last_undegraded":"2024-09-22T04:05:06.009397+0000","last_fullsized":"2024-09-22T04:05:06.009397+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1572,"log_dups_size":0,"ondisk_log_size":1572,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20709376,"num_objects":316,"num_object_clones":0,"num_object_copies":948,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1572,"num_write_kb":60416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.9","version":"82'1827","reported_seq":1848,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-22T04:05:09.897289+0000","last_change":"2024-09-22T04:02:28.996162+0000","last_active":"2024-09-22T04:05:09.897289+0000","last_peered":"2024-09-22T04:05:09.897289+0000","last_clean":"2024-09-22T04:05:09.897289+0000","last_became_active":"2024-09-22T04:02:28.990154+0000","last_became_peered":"2024-09-22T04:02:28.990154+0000","last_unstale":"2024-09-22T04:05:09.897289+0000","last_undegraded":"2024-09-22T04:05:09.897289+0000","last_fullsized":"2024-09-22T04:05:09.897289+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1827,"log_dups_size":0,"ondisk_log_size":1827,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17235968,"num_objects":263,"num_object_clones":0,"num_object_copies":789,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1827,"num_write_kb":66880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"83'1841","reported_seq":1862,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-22T04:05:10.151362+0000","last_change":"2024-09-22T04:02:28.902123+0000","last_active":"2024-09-22T04:05:10.151362+0000","last_peered":"2024-09-22T04:05:10.151362+0000","last_clean":"2024-09-22T04:05:10.151362+0000","last_became_active":"2024-09-22T04:02:28.895508+0000","last_became_peered":"2024-09-22T04:02:28.895508+0000","last_unstale":"2024-09-22T04:05:10.151362+0000","last_undegraded":"2024-09-22T04:05:10.151362+0000","last_fullsized":"2024-09-22T04:05:10.151362+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1841,"log_dups_size":0,"ondisk_log_size":1841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17629184,"num_objects":269,"num_object_clones":0,"num_object_copies":807,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1841,"num_write_kb":67520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.6","version":"83'1625","reported_seq":1646,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-22T04:05:10.233169+0000","last_change":"2024-09-22T04:02:29.024059+0000","last_active":"2024-09-22T04:05:10.233169+0000","last_peered":"2024-09-22T04:05:10.233169+0000","last_clean":"2024-09-22T04:05:10.233169+0000","last_became_active":"2024-09-22T04:02:29.013699+0000","last_became_peered":"2024-09-22T04:02:29.013699+0000","last_unstale":"2024-09-22T04:05:10.233169+0000","last_undegraded":"2024-09-22T04:05:10.233169+0000","last_fullsized":"2024-09-22T04:05:10.233169+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1625,"log_dups_size":0,"ondisk_log_size":1625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15138816,"num_objects":231,"num_object_clones":0,"num_object_copies":693,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1625,"num_write_kb":59392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":283,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:29.819502+0000","last_change":"2024-09-22T03:49:12.034704+0000","last_active":"2024-09-22T04:02:29.819502+0000","last_peered":"2024-09-22T04:02:29.819502+0000","last_clean":"2024-09-22T04:02:29.819502+0000","last_became_active":"2024-09-22T03:49:12.027470+0000","last_became_peered":"2024-09-22T03:49:12.027470+0000","last_unstale":"2024-09-22T04:02:29.819502+0000","last_undegraded":"2024-09-22T04:02:29.819502+0000","last_fullsized":"2024-09-22T04:02:29.819502+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_clean_scrub_stamp":"2024-09-22T03:49:10.979949+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":218,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-22T04:05:09.850182+0000","last_change":"2024-09-22T03:49:17.031458+0000","last_active":"2024-09-22T04:05:09.850182+0000","last_peered":"2024-09-22T04:05:09.850182+0000","last_clean":"2024-09-22T04:05:09.850182+0000","last_became_active":"2024-09-22T03:49:15.125490+0000","last_became_peered":"2024-09-22T03:49:15.125490+0000","last_unstale":"2024-09-22T04:05:09.850182+0000","last_undegraded":"2024-09-22T04:05:09.850182+0000","last_fullsized":"2024-09-22T04:05:09.850182+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"83'1732","reported_seq":1753,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-22T04:05:09.983418+0000","last_change":"2024-09-22T04:02:28.912870+0000","last_active":"2024-09-22T04:05:09.983418+0000","last_peered":"2024-09-22T04:05:09.983418+0000","last_clean":"2024-09-22T04:05:09.983418+0000","last_became_active":"2024-09-22T04:02:28.905573+0000","last_became_peered":"2024-09-22T04:02:28.905573+0000","last_unstale":"2024-09-22T04:05:09.983418+0000","last_undegraded":"2024-09-22T04:05:09.983418+0000","last_fullsized":"2024-09-22T04:05:09.983418+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1732,"log_dups_size":0,"ondisk_log_size":1732,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16646144,"num_objects":254,"num_object_clones":0,"num_object_copies":762,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1732,"num_write_kb":63552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":217,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-22T04:05:09.848107+0000","last_change":"2024-09-22T03:49:17.029339+0000","last_active":"2024-09-22T04:05:09.848107+0000","last_peered":"2024-09-22T04:05:09.848107+0000","last_clean":"2024-09-22T04:05:09.848107+0000","last_became_active":"2024-09-22T03:49:15.097304+0000","last_became_peered":"2024-09-22T03:49:15.097304+0000","last_unstale":"2024-09-22T04:05:09.848107+0000","last_undegraded":"2024-09-22T04:05:09.848107+0000","last_fullsized":"2024-09-22T04:05:09.848107+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"83'1709","reported_seq":1730,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-22T04:05:10.275400+0000","last_change":"2024-09-22T04:02:28.928198+0000","last_active":"2024-09-22T04:05:10.275400+0000","last_peered":"2024-09-22T04:05:10.275400+0000","last_clean":"2024-09-22T04:05:10.275400+0000","last_became_active":"2024-09-22T04:02:28.909503+0000","last_became_peered":"2024-09-22T04:02:28.909503+0000","last_unstale":"2024-09-22T04:05:10.275400+0000","last_undegraded":"2024-09-22T04:05:10.275400+0000","last_fullsized":"2024-09-22T04:05:10.275400+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1709,"log_dups_size":0,"ondisk_log_size":1709,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15400960,"num_objects":235,"num_object_clones":0,"num_object_copies":705,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1709,"num_write_kb":62208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":217,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-22T04:05:09.855011+0000","last_change":"2024-09-22T03:49:17.029349+0000","last_active":"2024-09-22T04:05:09.855011+0000","last_peered":"2024-09-22T04:05:09.855011+0000","last_clean":"2024-09-22T04:05:09.855011+0000","last_became_active":"2024-09-22T03:49:15.094890+0000","last_became_peered":"2024-09-22T03:49:15.094890+0000","last_unstale":"2024-09-22T04:05:09.855011+0000","last_undegraded":"2024-09-22T04:05:09.855011+0000","last_fullsized":"2024-09-22T04:05:09.855011+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.7","version":"83'1735","reported_seq":1756,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-22T04:05:09.996049+0000","last_change":"2024-09-22T04:02:28.945388+0000","last_active":"2024-09-22T04:05:09.996049+0000","last_peered":"2024-09-22T04:05:09.996049+0000","last_clean":"2024-09-22T04:05:09.996049+0000","last_became_active":"2024-09-22T04:02:28.939479+0000","last_became_peered":"2024-09-22T04:02:28.939479+0000","last_unstale":"2024-09-22T04:05:09.996049+0000","last_undegraded":"2024-09-22T04:05:09.996049+0000","last_fullsized":"2024-09-22T04:05:09.996049+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1735,"log_dups_size":0,"ondisk_log_size":1735,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15794176,"num_objects":241,"num_object_clones":0,"num_object_copies":723,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1735,"num_write_kb":63232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":219,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-22T04:05:09.850892+0000","last_change":"2024-09-22T03:49:17.031466+0000","last_active":"2024-09-22T04:05:09.850892+0000","last_peered":"2024-09-22T04:05:09.850892+0000","last_clean":"2024-09-22T04:05:09.850892+0000","last_became_active":"2024-09-22T03:49:15.098420+0000","last_became_peered":"2024-09-22T03:49:15.098420+0000","last_unstale":"2024-09-22T04:05:09.850892+0000","last_undegraded":"2024-09-22T04:05:09.850892+0000","last_fullsized":"2024-09-22T04:05:09.850892+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1","version":"83'1652","reported_seq":1673,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-22T04:05:09.853013+0000","last_change":"2024-09-22T04:02:28.927518+0000","last_active":"2024-09-22T04:05:09.853013+0000","last_peered":"2024-09-22T04:05:09.853013+0000","last_clean":"2024-09-22T04:05:09.853013+0000","last_became_active":"2024-09-22T04:02:28.919323+0000","last_became_peered":"2024-09-22T04:02:28.919323+0000","last_unstale":"2024-09-22T04:05:09.853013+0000","last_undegraded":"2024-09-22T04:05:09.853013+0000","last_fullsized":"2024-09-22T04:05:09.853013+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1652,"log_dups_size":0,"ondisk_log_size":1652,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17825792,"num_objects":272,"num_object_clones":0,"num_object_copies":816,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1652,"num_write_kb":61568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":208,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:29.823311+0000","last_change":"2024-09-22T03:49:17.036954+0000","last_active":"2024-09-22T04:02:29.823311+0000","last_peered":"2024-09-22T04:02:29.823311+0000","last_clean":"2024-09-22T04:02:29.823311+0000","last_became_active":"2024-09-22T03:49:15.110506+0000","last_became_peered":"2024-09-22T03:49:15.110506+0000","last_unstale":"2024-09-22T04:02:29.823311+0000","last_undegraded":"2024-09-22T04:02:29.823311+0000","last_fullsized":"2024-09-22T04:02:29.823311+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"80'1749","reported_seq":1761,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:05:06.230467+0000","last_change":"2024-09-22T04:02:28.954190+0000","last_active":"2024-09-22T04:05:06.230467+0000","last_peered":"2024-09-22T04:05:06.230467+0000","last_clean":"2024-09-22T04:05:06.230467+0000","last_became_active":"2024-09-22T04:02:28.946807+0000","last_became_peered":"2024-09-22T04:02:28.946807+0000","last_unstale":"2024-09-22T04:05:06.230467+0000","last_undegraded":"2024-09-22T04:05:06.230467+0000","last_fullsized":"2024-09-22T04:05:06.230467+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1749,"log_dups_size":0,"ondisk_log_size":1749,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19857408,"num_objects":303,"num_object_clones":0,"num_object_copies":909,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1749,"num_write_kb":65664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":208,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:29.820857+0000","last_change":"2024-09-22T03:49:17.032989+0000","last_active":"2024-09-22T04:02:29.820857+0000","last_peered":"2024-09-22T04:02:29.820857+0000","last_clean":"2024-09-22T04:02:29.820857+0000","last_became_active":"2024-09-22T03:49:15.079260+0000","last_became_peered":"2024-09-22T03:49:15.079260+0000","last_unstale":"2024-09-22T04:02:29.820857+0000","last_undegraded":"2024-09-22T04:02:29.820857+0000","last_fullsized":"2024-09-22T04:02:29.820857+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3","version":"83'1634","reported_seq":1655,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-22T04:05:10.064960+0000","last_change":"2024-09-22T04:02:28.924084+0000","last_active":"2024-09-22T04:05:10.064960+0000","last_peered":"2024-09-22T04:05:10.064960+0000","last_clean":"2024-09-22T04:05:10.064960+0000","last_became_active":"2024-09-22T04:02:28.898697+0000","last_became_peered":"2024-09-22T04:02:28.898697+0000","last_unstale":"2024-09-22T04:05:10.064960+0000","last_undegraded":"2024-09-22T04:05:10.064960+0000","last_fullsized":"2024-09-22T04:05:10.064960+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1634,"log_dups_size":0,"ondisk_log_size":1634,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16515072,"num_objects":252,"num_object_clones":0,"num_object_copies":756,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1634,"num_write_kb":60352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":208,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-22T04:02:29.823587+0000","last_change":"2024-09-22T03:49:17.036402+0000","last_active":"2024-09-22T04:02:29.823587+0000","last_peered":"2024-09-22T04:02:29.823587+0000","last_clean":"2024-09-22T04:02:29.823587+0000","last_became_active":"2024-09-22T03:49:15.108430+0000","last_became_peered":"2024-09-22T03:49:15.108430+0000","last_unstale":"2024-09-22T04:02:29.823587+0000","last_undegraded":"2024-09-22T04:02:29.823587+0000","last_fullsized":"2024-09-22T04:02:29.823587+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"83'1720","reported_seq":1741,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-22T04:05:10.255405+0000","last_change":"2024-09-22T04:02:29.018532+0000","last_active":"2024-09-22T04:05:10.255405+0000","last_peered":"2024-09-22T04:05:10.255405+0000","last_clean":"2024-09-22T04:05:10.255405+0000","last_became_active":"2024-09-22T04:02:29.006046+0000","last_became_peered":"2024-09-22T04:02:29.006046+0000","last_unstale":"2024-09-22T04:05:10.255405+0000","last_undegraded":"2024-09-22T04:05:10.255405+0000","last_fullsized":"2024-09-22T04:05:10.255405+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1720,"log_dups_size":0,"ondisk_log_size":1720,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15728640,"num_objects":240,"num_object_clones":0,"num_object_copies":720,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1720,"num_write_kb":62720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":217,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-22T04:05:09.847161+0000","last_change":"2024-09-22T03:49:17.029128+0000","last_active":"2024-09-22T04:05:09.847161+0000","last_peered":"2024-09-22T04:05:09.847161+0000","last_clean":"2024-09-22T04:05:09.847161+0000","last_became_active":"2024-09-22T03:49:15.113396+0000","last_became_peered":"2024-09-22T03:49:15.113396+0000","last_unstale":"2024-09-22T04:05:09.847161+0000","last_undegraded":"2024-09-22T04:05:09.847161+0000","last_fullsized":"2024-09-22T04:05:09.847161+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":275054616,"num_objects":4198,"num_object_clones":0,"num_object_copies":12594,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":27198,"num_write_kb":1004609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":51040256,"data_stored":816447560,"data_compressed":38769295,"data_compressed_allocated":51027968,"data_compressed_original":816447488,"omap_allocated":0,"internal_metadata":0},"log_size":27198,"ondisk_log_size":27198,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949673913,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":54324,"kb_used_data":11172,"kb_used_omap":0,"kb_used_meta":43136,"kb_avail":94317516,"statfs":{"total":96636764160,"available":96581136384,"internally_reserved":0,"allocated":11440128,"data_stored":171956066,"data_compressed":8155487,"data_compressed_allocated":10735616,"data_compressed_original":171687936,"omap_allocated":0,"internal_metadata":44171264},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654706622,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":52816,"kb_used_data":13920,"kb_used_omap":0,"kb_used_meta":38656,"kb_avail":94319024,"statfs":{"total":96636764160,"available":96582680576,"internally_reserved":0,"allocated":14254080,"data_stored":220710016,"data_compressed":10471880,"data_compressed_allocated":13783040,"data_compressed_original":220528640,"omap_allocated":0,"internal_metadata":39583744},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706621,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":46832,"kb_used_data":11952,"kb_used_omap":0,"kb_used_meta":34752,"kb_avail":94325008,"statfs":{"total":96636764160,"available":96588808192,"internally_reserved":0,"allocated":12238848,"data_stored":188139144,"data_compressed":8927264,"data_compressed_allocated":11751424,"data_compressed_original":187940864,"omap_allocated":0,"internal_metadata":35586048},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706621,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":51196,"kb_used_data":15864,"kb_used_omap":0,"kb_used_meta":35200,"kb_avail":94320644,"statfs":{"total":96636764160,"available":96584339456,"internally_reserved":0,"allocated":16244736,"data_stored":252233357,"data_compressed":11970800,"data_compressed_allocated":15757312,"data_compressed_original":252035072,"omap_allocated":0,"internal_metadata":36044800},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":15425536,"data_stored":246743064,"data_compressed":11716680,"data_compressed_allocated":15421440,"data_compressed_original":246743040,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":10665984,"data_stored":170590232,"data_compressed":8100535,"data_compressed_allocated":10661888,"data_compressed_original":170590208,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":11366400,"data_stored":181862400,"data_compressed":8635800,"data_compressed_allocated":11366400,"data_compressed_original":181862400,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":13582336,"data_stored":217251864,"data_compressed":10316280,"data_compressed_allocated":13578240,"data_compressed_original":217251840,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T04:05:11.983 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-22T04:05:11.983 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T04:05:11.984 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T04:05:11.984 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T04:05:12.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:12.147+0000 7f303d26c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:12.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:12.159+0000 7f303d26c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:12.412 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:05:12.412 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:05:12.412 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:05:12.412 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:05:12.412 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:05:12.412 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:05:12.412 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:05:12.412 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:05:12.413 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:05:12.413 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:05:12.413 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:05:12.413 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:05:12.416 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:05:12.416 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:05:12.416 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T04:05:12.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:12.575+0000 7fb7a4191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:12.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:12.587+0000 7fb7a4191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:12.643 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:05:12.643 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:05:12.643 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:05:12.643 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:05:12.643 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:05:12.643 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:05:12.643 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:05:12.643 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:05:12.643 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:05:12.643 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:05:12.643 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:05:12.643 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:05:12.647 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:05:12.648 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:05:12.648 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T04:05:12.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:12.790+0000 7f061e311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:12.805 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T04:05:12.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:12.806+0000 7f061e311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:12.876 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:05:12.876 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:05:12.876 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:05:12.876 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:05:12.876 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:05:12.876 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:05:12.876 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:05:12.876 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:05:12.876 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:05:12.876 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:05:12.876 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:05:12.876 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:05:12.880 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:05:12.880 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:05:12.881 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T04:05:12.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:12.956+0000 7f0d28a74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:12.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:12.964+0000 7f0d28a74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:13.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:13.038+0000 7fe3d424f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:13.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:13.057+0000 7fe3d424f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:13.089 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:05:13.089 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:05:13.089 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:05:13.089 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:05:13.089 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:05:13.090 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:05:13.090 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:05:13.090 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:05:13.090 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:05:13.090 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:05:13.090 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:05:13.090 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:05:13.092 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:05:13.093 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:05:15.634 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T04:05:15.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:15.783+0000 7efd130d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:15.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:15.792+0000 7efd130d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:18.094 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T04:05:18.094 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T04:05:18.094 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T04:05:18.094 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T04:05:18.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:18.237+0000 7fd4b3191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:18.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:18.254+0000 7fd4b3191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:18.580 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:05:18.580 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:05:18.580 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:05:18.580 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:05:18.580 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:05:18.580 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:05:18.580 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:05:18.580 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:05:18.580 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:05:18.581 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:05:18.581 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:05:18.581 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:05:18.584 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:05:18.584 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:05:18.584 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T04:05:18.636 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T04:05:18.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:18.729+0000 7f9f53791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:18.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:18.748+0000 7f9f53791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:18.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:18.792+0000 7f9e57b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:18.797 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:05:18.797 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:05:18.797 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:05:18.798 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:05:18.798 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:05:18.798 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:05:18.798 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:05:18.798 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:05:18.798 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:05:18.798 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:05:18.798 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:05:18.798 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:05:18.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:18.800+0000 7f9e57b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:18.802 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:05:18.802 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:05:18.803 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T04:05:18.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:18.957+0000 7fb962c74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:18.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:18.974+0000 7fb962c74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:19.014 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:05:19.014 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:05:19.014 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:05:19.014 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:05:19.015 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:05:19.015 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:05:19.015 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:05:19.015 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:05:19.015 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:05:19.015 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:05:19.015 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:05:19.015 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:05:19.017 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:05:19.018 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:05:19.018 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T04:05:19.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:19.186+0000 7f96f4d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:19.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:19.204+0000 7f96f4d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:19.234 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:05:19.235 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:05:19.235 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:05:19.235 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:05:19.235 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:05:19.235 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:05:19.235 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:05:19.235 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:05:19.235 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:05:19.235 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:05:19.235 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:05:19.235 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:05:19.240 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:05:19.240 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:05:21.202 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T04:05:21.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:21.363+0000 7f62ce591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:21.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:21.371+0000 7f62ce591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:23.794 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T04:05:23.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:23.942+0000 7f4c31391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:23.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:23.950+0000 7f4c31391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:24.241 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T04:05:24.241 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T04:05:24.242 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T04:05:24.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:24.406+0000 7f6d204c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:24.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:24.423+0000 7f6d204c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:24.758 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T04:05:24.758 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-22T04:05:24.778 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":564,"stamp":"2024-09-22T04:05:23.167369+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":161088075,"num_objects":2454,"num_object_clones":0,"num_object_copies":7362,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":29027,"num_write_kb":1005717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29001,"ondisk_log_size":29001,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":188452,"kb_used_data":32480,"kb_used_omap":0,"kb_used_meta":155904,"kb_avail":377298908,"statfs":{"total":386547056640,"available":386354081792,"internally_reserved":0,"allocated":33259520,"data_stored":501173081,"data_compressed":23769376,"data_compressed_allocated":31289344,"data_compressed_original":500383744,"omap_allocated":0,"internal_metadata":159645696},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-114556928,"num_objects":-1748,"num_object_clones":0,"num_object_copies":-5244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1748,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002302"},"pg_stats":[{"pgid":"7.f","version":"84'1707","reported_seq":1731,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-22T04:05:20.031340+0000","last_change":"2024-09-22T04:02:28.979477+0000","last_active":"2024-09-22T04:05:20.031340+0000","last_peered":"2024-09-22T04:05:20.031340+0000","last_clean":"2024-09-22T04:05:20.031340+0000","last_became_active":"2024-09-22T04:02:28.971367+0000","last_became_peered":"2024-09-22T04:02:28.971367+0000","last_unstale":"2024-09-22T04:05:20.031340+0000","last_undegraded":"2024-09-22T04:05:20.031340+0000","last_fullsized":"2024-09-22T04:05:20.031340+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1707,"log_dups_size":0,"ondisk_log_size":1707,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10158080,"num_objects":155,"num_object_clones":0,"num_object_copies":465,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1707,"num_write_kb":59584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"84'1794","reported_seq":1818,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-22T04:05:20.018346+0000","last_change":"2024-09-22T04:02:28.872853+0000","last_active":"2024-09-22T04:05:20.018346+0000","last_peered":"2024-09-22T04:05:20.018346+0000","last_clean":"2024-09-22T04:05:20.018346+0000","last_became_active":"2024-09-22T04:02:28.865538+0000","last_became_peered":"2024-09-22T04:02:28.865538+0000","last_unstale":"2024-09-22T04:05:20.018346+0000","last_undegraded":"2024-09-22T04:05:20.018346+0000","last_fullsized":"2024-09-22T04:05:20.018346+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1794,"log_dups_size":0,"ondisk_log_size":1794,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11010048,"num_objects":168,"num_object_clones":0,"num_object_copies":504,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1794,"num_write_kb":62784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.d","version":"84'1852","reported_seq":1877,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-22T04:05:20.986796+0000","last_change":"2024-09-22T04:02:28.967443+0000","last_active":"2024-09-22T04:05:20.986796+0000","last_peered":"2024-09-22T04:05:20.986796+0000","last_clean":"2024-09-22T04:05:20.986796+0000","last_became_active":"2024-09-22T04:02:28.959444+0000","last_became_peered":"2024-09-22T04:02:28.959444+0000","last_unstale":"2024-09-22T04:05:20.986796+0000","last_undegraded":"2024-09-22T04:05:20.986796+0000","last_fullsized":"2024-09-22T04:05:20.986796+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1852,"log_dups_size":0,"ondisk_log_size":1852,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9109528,"num_objects":140,"num_object_clones":0,"num_object_copies":420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1852,"num_write_kb":63681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"84'1774","reported_seq":1798,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-22T04:05:20.145025+0000","last_change":"2024-09-22T04:02:28.963918+0000","last_active":"2024-09-22T04:05:20.145025+0000","last_peered":"2024-09-22T04:05:20.145025+0000","last_clean":"2024-09-22T04:05:20.145025+0000","last_became_active":"2024-09-22T04:02:28.948540+0000","last_became_peered":"2024-09-22T04:02:28.948540+0000","last_unstale":"2024-09-22T04:05:20.145025+0000","last_undegraded":"2024-09-22T04:05:20.145025+0000","last_fullsized":"2024-09-22T04:05:20.145025+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1774,"log_dups_size":0,"ondisk_log_size":1774,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9961472,"num_objects":152,"num_object_clones":0,"num_object_copies":456,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1774,"num_write_kb":61632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"84'1835","reported_seq":1859,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-22T04:05:21.070538+0000","last_change":"2024-09-22T04:02:28.971728+0000","last_active":"2024-09-22T04:05:21.070538+0000","last_peered":"2024-09-22T04:05:21.070538+0000","last_clean":"2024-09-22T04:05:21.070538+0000","last_became_active":"2024-09-22T04:02:28.960293+0000","last_became_peered":"2024-09-22T04:02:28.960293+0000","last_unstale":"2024-09-22T04:05:21.070538+0000","last_undegraded":"2024-09-22T04:05:21.070538+0000","last_fullsized":"2024-09-22T04:05:21.070538+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1835,"log_dups_size":0,"ondisk_log_size":1835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9633792,"num_objects":147,"num_object_clones":0,"num_object_copies":441,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1835,"num_write_kb":63424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"84'1731","reported_seq":1755,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-22T04:05:21.241757+0000","last_change":"2024-09-22T04:02:29.026441+0000","last_active":"2024-09-22T04:05:21.241757+0000","last_peered":"2024-09-22T04:05:21.241757+0000","last_clean":"2024-09-22T04:05:21.241757+0000","last_became_active":"2024-09-22T04:02:28.991656+0000","last_became_peered":"2024-09-22T04:02:28.991656+0000","last_unstale":"2024-09-22T04:05:21.241757+0000","last_undegraded":"2024-09-22T04:05:21.241757+0000","last_fullsized":"2024-09-22T04:05:21.241757+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1731,"log_dups_size":0,"ondisk_log_size":1731,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10289152,"num_objects":157,"num_object_clones":0,"num_object_copies":471,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1731,"num_write_kb":60416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.9","version":"84'1926","reported_seq":1950,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-22T04:05:20.210628+0000","last_change":"2024-09-22T04:02:28.996162+0000","last_active":"2024-09-22T04:05:20.210628+0000","last_peered":"2024-09-22T04:05:20.210628+0000","last_clean":"2024-09-22T04:05:20.210628+0000","last_became_active":"2024-09-22T04:02:28.990154+0000","last_became_peered":"2024-09-22T04:02:28.990154+0000","last_unstale":"2024-09-22T04:05:20.210628+0000","last_undegraded":"2024-09-22T04:05:20.210628+0000","last_fullsized":"2024-09-22T04:05:20.210628+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1926,"log_dups_size":0,"ondisk_log_size":1926,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10747904,"num_objects":164,"num_object_clones":0,"num_object_copies":492,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1926,"num_write_kb":66880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"84'1937","reported_seq":1961,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-22T04:05:20.155686+0000","last_change":"2024-09-22T04:02:28.902123+0000","last_active":"2024-09-22T04:05:20.155686+0000","last_peered":"2024-09-22T04:05:20.155686+0000","last_clean":"2024-09-22T04:05:20.155686+0000","last_became_active":"2024-09-22T04:02:28.895508+0000","last_became_peered":"2024-09-22T04:02:28.895508+0000","last_unstale":"2024-09-22T04:05:20.155686+0000","last_undegraded":"2024-09-22T04:05:20.155686+0000","last_fullsized":"2024-09-22T04:05:20.155686+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1937,"log_dups_size":0,"ondisk_log_size":1937,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11337728,"num_objects":173,"num_object_clones":0,"num_object_copies":519,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1937,"num_write_kb":67520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.6","version":"84'1730","reported_seq":1754,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-22T04:05:20.311875+0000","last_change":"2024-09-22T04:02:29.024059+0000","last_active":"2024-09-22T04:05:20.311875+0000","last_peered":"2024-09-22T04:05:20.311875+0000","last_clean":"2024-09-22T04:05:20.311875+0000","last_became_active":"2024-09-22T04:02:29.013699+0000","last_became_peered":"2024-09-22T04:02:29.013699+0000","last_unstale":"2024-09-22T04:05:20.311875+0000","last_undegraded":"2024-09-22T04:05:20.311875+0000","last_fullsized":"2024-09-22T04:05:20.311875+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1730,"log_dups_size":0,"ondisk_log_size":1730,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8257536,"num_objects":126,"num_object_clones":0,"num_object_copies":378,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1730,"num_write_kb":59392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":295,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-22T04:05:10.846024+0000","last_change":"2024-09-22T03:49:12.034704+0000","last_active":"2024-09-22T04:05:10.846024+0000","last_peered":"2024-09-22T04:05:10.846024+0000","last_clean":"2024-09-22T04:05:10.846024+0000","last_became_active":"2024-09-22T03:49:12.027470+0000","last_became_peered":"2024-09-22T03:49:12.027470+0000","last_unstale":"2024-09-22T04:05:10.846024+0000","last_undegraded":"2024-09-22T04:05:10.846024+0000","last_fullsized":"2024-09-22T04:05:10.846024+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_clean_scrub_stamp":"2024-09-22T03:49:10.979949+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":221,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-22T04:05:10.872801+0000","last_change":"2024-09-22T03:49:17.031458+0000","last_active":"2024-09-22T04:05:10.872801+0000","last_peered":"2024-09-22T04:05:10.872801+0000","last_clean":"2024-09-22T04:05:10.872801+0000","last_became_active":"2024-09-22T03:49:15.125490+0000","last_became_peered":"2024-09-22T03:49:15.125490+0000","last_unstale":"2024-09-22T04:05:10.872801+0000","last_undegraded":"2024-09-22T04:05:10.872801+0000","last_fullsized":"2024-09-22T04:05:10.872801+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"84'1836","reported_seq":1860,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-22T04:05:19.938281+0000","last_change":"2024-09-22T04:02:28.912870+0000","last_active":"2024-09-22T04:05:19.938281+0000","last_peered":"2024-09-22T04:05:19.938281+0000","last_clean":"2024-09-22T04:05:19.938281+0000","last_became_active":"2024-09-22T04:02:28.905573+0000","last_became_peered":"2024-09-22T04:02:28.905573+0000","last_unstale":"2024-09-22T04:05:19.938281+0000","last_undegraded":"2024-09-22T04:05:19.938281+0000","last_fullsized":"2024-09-22T04:05:19.938281+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1836,"log_dups_size":0,"ondisk_log_size":1836,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9830400,"num_objects":150,"num_object_clones":0,"num_object_copies":450,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1836,"num_write_kb":63552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":220,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-22T04:05:10.858441+0000","last_change":"2024-09-22T03:49:17.029339+0000","last_active":"2024-09-22T04:05:10.858441+0000","last_peered":"2024-09-22T04:05:10.858441+0000","last_clean":"2024-09-22T04:05:10.858441+0000","last_became_active":"2024-09-22T03:49:15.097304+0000","last_became_peered":"2024-09-22T03:49:15.097304+0000","last_unstale":"2024-09-22T04:05:10.858441+0000","last_undegraded":"2024-09-22T04:05:10.858441+0000","last_fullsized":"2024-09-22T04:05:10.858441+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"84'1798","reported_seq":1822,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-22T04:05:19.663381+0000","last_change":"2024-09-22T04:02:28.928198+0000","last_active":"2024-09-22T04:05:19.663381+0000","last_peered":"2024-09-22T04:05:19.663381+0000","last_clean":"2024-09-22T04:05:19.663381+0000","last_became_active":"2024-09-22T04:02:28.909503+0000","last_became_peered":"2024-09-22T04:02:28.909503+0000","last_unstale":"2024-09-22T04:05:19.663381+0000","last_undegraded":"2024-09-22T04:05:19.663381+0000","last_fullsized":"2024-09-22T04:05:19.663381+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1798,"log_dups_size":0,"ondisk_log_size":1798,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9568256,"num_objects":146,"num_object_clones":0,"num_object_copies":438,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1798,"num_write_kb":62208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":220,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-22T04:05:10.871635+0000","last_change":"2024-09-22T03:49:17.029349+0000","last_active":"2024-09-22T04:05:10.871635+0000","last_peered":"2024-09-22T04:05:10.871635+0000","last_clean":"2024-09-22T04:05:10.871635+0000","last_became_active":"2024-09-22T03:49:15.094890+0000","last_became_peered":"2024-09-22T03:49:15.094890+0000","last_unstale":"2024-09-22T04:05:10.871635+0000","last_undegraded":"2024-09-22T04:05:10.871635+0000","last_fullsized":"2024-09-22T04:05:10.871635+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.7","version":"84'1830","reported_seq":1854,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-22T04:05:20.149826+0000","last_change":"2024-09-22T04:02:28.945388+0000","last_active":"2024-09-22T04:05:20.149826+0000","last_peered":"2024-09-22T04:05:20.149826+0000","last_clean":"2024-09-22T04:05:20.149826+0000","last_became_active":"2024-09-22T04:02:28.939479+0000","last_became_peered":"2024-09-22T04:02:28.939479+0000","last_unstale":"2024-09-22T04:05:20.149826+0000","last_undegraded":"2024-09-22T04:05:20.149826+0000","last_fullsized":"2024-09-22T04:05:20.149826+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1830,"log_dups_size":0,"ondisk_log_size":1830,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9568256,"num_objects":146,"num_object_clones":0,"num_object_copies":438,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1830,"num_write_kb":63232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":222,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-22T04:05:10.865142+0000","last_change":"2024-09-22T03:49:17.031466+0000","last_active":"2024-09-22T04:05:10.865142+0000","last_peered":"2024-09-22T04:05:10.865142+0000","last_clean":"2024-09-22T04:05:10.865142+0000","last_became_active":"2024-09-22T03:49:15.098420+0000","last_became_peered":"2024-09-22T03:49:15.098420+0000","last_unstale":"2024-09-22T04:05:10.865142+0000","last_undegraded":"2024-09-22T04:05:10.865142+0000","last_fullsized":"2024-09-22T04:05:10.865142+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1","version":"84'1759","reported_seq":1783,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-22T04:05:20.238874+0000","last_change":"2024-09-22T04:02:28.927518+0000","last_active":"2024-09-22T04:05:20.238874+0000","last_peered":"2024-09-22T04:05:20.238874+0000","last_clean":"2024-09-22T04:05:20.238874+0000","last_became_active":"2024-09-22T04:02:28.919323+0000","last_became_peered":"2024-09-22T04:02:28.919323+0000","last_unstale":"2024-09-22T04:05:20.238874+0000","last_undegraded":"2024-09-22T04:05:20.238874+0000","last_fullsized":"2024-09-22T04:05:20.238874+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1759,"log_dups_size":0,"ondisk_log_size":1759,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10813440,"num_objects":165,"num_object_clones":0,"num_object_copies":495,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1759,"num_write_kb":61568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":220,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-22T04:05:10.855536+0000","last_change":"2024-09-22T03:49:17.036954+0000","last_active":"2024-09-22T04:05:10.855536+0000","last_peered":"2024-09-22T04:05:10.855536+0000","last_clean":"2024-09-22T04:05:10.855536+0000","last_became_active":"2024-09-22T03:49:15.110506+0000","last_became_peered":"2024-09-22T03:49:15.110506+0000","last_unstale":"2024-09-22T04:05:10.855536+0000","last_undegraded":"2024-09-22T04:05:10.855536+0000","last_fullsized":"2024-09-22T04:05:10.855536+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"84'1883","reported_seq":1907,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-22T04:05:21.223751+0000","last_change":"2024-09-22T04:02:28.954190+0000","last_active":"2024-09-22T04:05:21.223751+0000","last_peered":"2024-09-22T04:05:21.223751+0000","last_clean":"2024-09-22T04:05:21.223751+0000","last_became_active":"2024-09-22T04:02:28.946807+0000","last_became_peered":"2024-09-22T04:02:28.946807+0000","last_unstale":"2024-09-22T04:05:21.223751+0000","last_undegraded":"2024-09-22T04:05:21.223751+0000","last_fullsized":"2024-09-22T04:05:21.223751+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1883,"log_dups_size":0,"ondisk_log_size":1883,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11075584,"num_objects":169,"num_object_clones":0,"num_object_copies":507,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1883,"num_write_kb":65664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":220,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-22T04:05:10.851461+0000","last_change":"2024-09-22T03:49:17.032989+0000","last_active":"2024-09-22T04:05:10.851461+0000","last_peered":"2024-09-22T04:05:10.851461+0000","last_clean":"2024-09-22T04:05:10.851461+0000","last_became_active":"2024-09-22T03:49:15.079260+0000","last_became_peered":"2024-09-22T03:49:15.079260+0000","last_unstale":"2024-09-22T04:05:10.851461+0000","last_undegraded":"2024-09-22T04:05:10.851461+0000","last_fullsized":"2024-09-22T04:05:10.851461+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3","version":"84'1746","reported_seq":1770,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-22T04:05:20.239684+0000","last_change":"2024-09-22T04:02:28.924084+0000","last_active":"2024-09-22T04:05:20.239684+0000","last_peered":"2024-09-22T04:05:20.239684+0000","last_clean":"2024-09-22T04:05:20.239684+0000","last_became_active":"2024-09-22T04:02:28.898697+0000","last_became_peered":"2024-09-22T04:02:28.898697+0000","last_unstale":"2024-09-22T04:05:20.239684+0000","last_undegraded":"2024-09-22T04:05:20.239684+0000","last_fullsized":"2024-09-22T04:05:20.239684+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1746,"log_dups_size":0,"ondisk_log_size":1746,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9175040,"num_objects":140,"num_object_clones":0,"num_object_copies":420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1746,"num_write_kb":60352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":220,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-22T04:05:10.857046+0000","last_change":"2024-09-22T03:49:17.036402+0000","last_active":"2024-09-22T04:05:10.857046+0000","last_peered":"2024-09-22T04:05:10.857046+0000","last_clean":"2024-09-22T04:05:10.857046+0000","last_became_active":"2024-09-22T03:49:15.108430+0000","last_became_peered":"2024-09-22T03:49:15.108430+0000","last_unstale":"2024-09-22T04:05:10.857046+0000","last_undegraded":"2024-09-22T04:05:10.857046+0000","last_fullsized":"2024-09-22T04:05:10.857046+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"84'1808","reported_seq":1832,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-22T04:05:19.891091+0000","last_change":"2024-09-22T04:02:29.018532+0000","last_active":"2024-09-22T04:05:19.891091+0000","last_peered":"2024-09-22T04:05:19.891091+0000","last_clean":"2024-09-22T04:05:19.891091+0000","last_became_active":"2024-09-22T04:02:29.006046+0000","last_became_peered":"2024-09-22T04:02:29.006046+0000","last_unstale":"2024-09-22T04:05:19.891091+0000","last_undegraded":"2024-09-22T04:05:19.891091+0000","last_fullsized":"2024-09-22T04:05:19.891091+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1808,"log_dups_size":0,"ondisk_log_size":1808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9961472,"num_objects":152,"num_object_clones":0,"num_object_copies":456,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1808,"num_write_kb":62720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":220,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-22T04:05:10.861351+0000","last_change":"2024-09-22T03:49:17.029128+0000","last_active":"2024-09-22T04:05:10.861351+0000","last_peered":"2024-09-22T04:05:10.861351+0000","last_clean":"2024-09-22T04:05:10.861351+0000","last_became_active":"2024-09-22T03:49:15.113396+0000","last_became_peered":"2024-09-22T03:49:15.113396+0000","last_unstale":"2024-09-22T04:05:10.861351+0000","last_undegraded":"2024-09-22T04:05:10.861351+0000","last_fullsized":"2024-09-22T04:05:10.861351+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":160497688,"num_objects":2450,"num_object_clones":0,"num_object_copies":7350,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":28946,"num_write_kb":1004609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":30269440,"data_stored":484114504,"data_compressed":22988344,"data_compressed_allocated":30257152,"data_compressed_original":484114432,"omap_allocated":0,"internal_metadata":0},"log_size":28946,"ondisk_log_size":28946,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949673928,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36520,"kb_used_data":5848,"kb_used_omap":0,"kb_used_meta":30656,"kb_avail":94335320,"statfs":{"total":96636764160,"available":96599367680,"internally_reserved":0,"allocated":5988352,"data_stored":87937897,"data_compressed":4169016,"data_compressed_allocated":5488640,"data_compressed_original":87736320,"omap_allocated":0,"internal_metadata":31391744},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654706632,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":51752,"kb_used_data":8920,"kb_used_omap":0,"kb_used_meta":42816,"kb_avail":94320088,"statfs":{"total":96636764160,"available":96583770112,"internally_reserved":0,"allocated":9134080,"data_stored":138662217,"data_compressed":6575656,"data_compressed_allocated":8654848,"data_compressed_original":138477568,"omap_allocated":0,"internal_metadata":43843584},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706631,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":46564,"kb_used_data":7636,"kb_used_omap":0,"kb_used_meta":38912,"kb_avail":94325276,"statfs":{"total":96636764160,"available":96589082624,"internally_reserved":0,"allocated":7819264,"data_stored":117298001,"data_compressed":5563192,"data_compressed_allocated":7323648,"data_compressed_original":117096448,"omap_allocated":0,"internal_metadata":39845888},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706631,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":53616,"kb_used_data":10076,"kb_used_omap":0,"kb_used_meta":43520,"kb_avail":94318224,"statfs":{"total":96636764160,"available":96581861376,"internally_reserved":0,"allocated":10317824,"data_stored":157274966,"data_compressed":7461512,"data_compressed_allocated":9822208,"data_compressed_original":157073408,"omap_allocated":0,"internal_metadata":44564480},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":9482240,"data_stored":151650328,"data_compressed":7201168,"data_compressed_allocated":9478144,"data_compressed_original":151650304,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5435392,"data_stored":86900760,"data_compressed":4126512,"data_compressed_allocated":5431296,"data_compressed_original":86900736,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6922240,"data_stored":110755840,"data_compressed":5259280,"data_compressed_allocated":6922240,"data_compressed_original":110755840,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8429568,"data_stored":134807576,"data_compressed":6401384,"data_compressed_allocated":8425472,"data_compressed_original":134807552,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T04:05:26.504 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T04:05:26.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:26.653+0000 7f2582a57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:26.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:26.660+0000 7f2582a57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:29.159 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T04:05:29.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:29.310+0000 7fba1fd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:29.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:29.322+0000 7fba1fd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:29.780 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T04:05:29.780 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T04:05:29.780 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T04:05:29.781 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T04:05:29.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:29.935+0000 7f56d86bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:29.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:29.949+0000 7f56d86bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:30.186 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:05:30.186 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:05:30.186 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:05:30.186 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:05:30.186 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:05:30.186 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:05:30.186 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:05:30.186 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:05:30.186 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:05:30.187 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:05:30.187 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:05:30.187 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:05:30.189 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:05:30.190 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:05:30.190 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T04:05:30.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:30.385+0000 7fb3e10d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:30.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:30.399+0000 7fb3e10d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:30.443 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:05:30.443 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:05:30.443 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:05:30.443 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:05:30.443 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:05:30.443 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:05:30.443 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:05:30.444 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:05:30.444 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:05:30.444 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:05:30.444 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:05:30.444 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:05:30.448 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:05:30.449 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:05:30.449 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T04:05:30.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:30.611+0000 7f4d58911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:30.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:30.634+0000 7f4d58911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:30.678 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:05:30.679 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:05:30.679 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:05:30.679 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:05:30.679 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:05:30.679 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:05:30.679 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:05:30.679 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:05:30.679 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:05:30.679 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:05:30.679 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:05:30.679 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:05:30.683 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:05:30.683 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:05:30.683 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T04:05:30.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:30.833+0000 7fbfb7991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:30.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:30.849+0000 7fbfb7991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:30.888 INFO:teuthology.orchestra.run.smithi037.stderr:no valid command found; 10 closest matches: 2024-09-22T04:05:30.889 INFO:teuthology.orchestra.run.smithi037.stderr:bench [] [] [] [] 2024-09-22T04:05:30.889 INFO:teuthology.orchestra.run.smithi037.stderr:config get 2024-09-22T04:05:30.889 INFO:teuthology.orchestra.run.smithi037.stderr:config help 2024-09-22T04:05:30.889 INFO:teuthology.orchestra.run.smithi037.stderr:config set ... 2024-09-22T04:05:30.889 INFO:teuthology.orchestra.run.smithi037.stderr:config show 2024-09-22T04:05:30.889 INFO:teuthology.orchestra.run.smithi037.stderr:deep_scrub 2024-09-22T04:05:30.889 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_ops 2024-09-22T04:05:30.889 INFO:teuthology.orchestra.run.smithi037.stderr:dump_historic_slow_ops 2024-09-22T04:05:30.889 INFO:teuthology.orchestra.run.smithi037.stderr:dump_metrics [] 2024-09-22T04:05:30.889 INFO:teuthology.orchestra.run.smithi037.stderr:dump_ops_in_flight 2024-09-22T04:05:30.889 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: invalid command 2024-09-22T04:05:30.892 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T04:05:30.893 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T04:05:31.931 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T04:05:32.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:32.096+0000 7f06f9b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:32.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:32.105+0000 7f06f9b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:34.615 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T04:05:34.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:34.766+0000 7fb177b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:34.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:34.777+0000 7fb177b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:35.893 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T04:05:35.894 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T04:05:35.894 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T04:05:36.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:36.044+0000 7f5fd24fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:36.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:36.062+0000 7f5fd24fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:36.351 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T04:05:36.351 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-22T04:05:36.369 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":570,"stamp":"2024-09-22T04:05:35.169859+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":60293707,"num_objects":916,"num_object_clones":0,"num_object_copies":2748,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":30565,"num_write_kb":1005717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30539,"ondisk_log_size":30539,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":157560,"kb_used_data":14072,"kb_used_omap":0,"kb_used_meta":143424,"kb_avail":377329800,"statfs":{"total":386547056640,"available":386385715200,"internally_reserved":0,"allocated":14409728,"data_stored":199576409,"data_compressed":9447952,"data_compressed_allocated":12439552,"data_compressed_original":198787072,"omap_allocated":0,"internal_metadata":146866176},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-100794368,"num_objects":-1538,"num_object_clones":0,"num_object_copies":-4614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1538,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002490"},"pg_stats":[{"pgid":"7.f","version":"84'1803","reported_seq":1827,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-22T04:05:30.329129+0000","last_change":"2024-09-22T04:02:28.979477+0000","last_active":"2024-09-22T04:05:30.329129+0000","last_peered":"2024-09-22T04:05:30.329129+0000","last_clean":"2024-09-22T04:05:30.329129+0000","last_became_active":"2024-09-22T04:02:28.971367+0000","last_became_peered":"2024-09-22T04:02:28.971367+0000","last_unstale":"2024-09-22T04:05:30.329129+0000","last_undegraded":"2024-09-22T04:05:30.329129+0000","last_fullsized":"2024-09-22T04:05:30.329129+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1803,"log_dups_size":0,"ondisk_log_size":1803,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3866624,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1803,"num_write_kb":59584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"84'1885","reported_seq":1909,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-22T04:05:30.212107+0000","last_change":"2024-09-22T04:02:28.872853+0000","last_active":"2024-09-22T04:05:30.212107+0000","last_peered":"2024-09-22T04:05:30.212107+0000","last_clean":"2024-09-22T04:05:30.212107+0000","last_became_active":"2024-09-22T04:02:28.865538+0000","last_became_peered":"2024-09-22T04:02:28.865538+0000","last_unstale":"2024-09-22T04:05:30.212107+0000","last_undegraded":"2024-09-22T04:05:30.212107+0000","last_fullsized":"2024-09-22T04:05:30.212107+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1885,"log_dups_size":0,"ondisk_log_size":1885,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5046272,"num_objects":77,"num_object_clones":0,"num_object_copies":231,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1885,"num_write_kb":62784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.d","version":"84'1949","reported_seq":1974,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-22T04:05:31.249127+0000","last_change":"2024-09-22T04:02:28.967443+0000","last_active":"2024-09-22T04:05:31.249127+0000","last_peered":"2024-09-22T04:05:31.249127+0000","last_clean":"2024-09-22T04:05:31.249127+0000","last_became_active":"2024-09-22T04:02:28.959444+0000","last_became_peered":"2024-09-22T04:02:28.959444+0000","last_unstale":"2024-09-22T04:05:31.249127+0000","last_undegraded":"2024-09-22T04:05:31.249127+0000","last_fullsized":"2024-09-22T04:05:31.249127+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1949,"log_dups_size":0,"ondisk_log_size":1949,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2752536,"num_objects":43,"num_object_clones":0,"num_object_copies":129,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1949,"num_write_kb":63681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"84'1878","reported_seq":1902,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-22T04:05:30.275602+0000","last_change":"2024-09-22T04:02:28.963918+0000","last_active":"2024-09-22T04:05:30.275602+0000","last_peered":"2024-09-22T04:05:30.275602+0000","last_clean":"2024-09-22T04:05:30.275602+0000","last_became_active":"2024-09-22T04:02:28.948540+0000","last_became_peered":"2024-09-22T04:02:28.948540+0000","last_unstale":"2024-09-22T04:05:30.275602+0000","last_undegraded":"2024-09-22T04:05:30.275602+0000","last_fullsized":"2024-09-22T04:05:30.275602+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1878,"log_dups_size":0,"ondisk_log_size":1878,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":48,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1878,"num_write_kb":61632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"84'1925","reported_seq":1949,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-22T04:05:31.233311+0000","last_change":"2024-09-22T04:02:28.971728+0000","last_active":"2024-09-22T04:05:31.233311+0000","last_peered":"2024-09-22T04:05:31.233311+0000","last_clean":"2024-09-22T04:05:31.233311+0000","last_became_active":"2024-09-22T04:02:28.960293+0000","last_became_peered":"2024-09-22T04:02:28.960293+0000","last_unstale":"2024-09-22T04:05:31.233311+0000","last_undegraded":"2024-09-22T04:05:31.233311+0000","last_fullsized":"2024-09-22T04:05:31.233311+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1925,"log_dups_size":0,"ondisk_log_size":1925,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3735552,"num_objects":57,"num_object_clones":0,"num_object_copies":171,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1925,"num_write_kb":63424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"84'1844","reported_seq":1868,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-22T04:05:31.228554+0000","last_change":"2024-09-22T04:02:29.026441+0000","last_active":"2024-09-22T04:05:31.228554+0000","last_peered":"2024-09-22T04:05:31.228554+0000","last_clean":"2024-09-22T04:05:31.228554+0000","last_became_active":"2024-09-22T04:02:28.991656+0000","last_became_peered":"2024-09-22T04:02:28.991656+0000","last_unstale":"2024-09-22T04:05:31.228554+0000","last_undegraded":"2024-09-22T04:05:31.228554+0000","last_fullsized":"2024-09-22T04:05:31.228554+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1844,"log_dups_size":0,"ondisk_log_size":1844,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2883584,"num_objects":44,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1844,"num_write_kb":60416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.9","version":"84'2026","reported_seq":2050,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-22T04:05:30.334012+0000","last_change":"2024-09-22T04:02:28.996162+0000","last_active":"2024-09-22T04:05:30.334012+0000","last_peered":"2024-09-22T04:05:30.334012+0000","last_clean":"2024-09-22T04:05:30.334012+0000","last_became_active":"2024-09-22T04:02:28.990154+0000","last_became_peered":"2024-09-22T04:02:28.990154+0000","last_unstale":"2024-09-22T04:05:30.334012+0000","last_undegraded":"2024-09-22T04:05:30.334012+0000","last_fullsized":"2024-09-22T04:05:30.334012+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":2026,"log_dups_size":0,"ondisk_log_size":2026,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2026,"num_write_kb":66880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"84'2037","reported_seq":2061,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-22T04:05:29.737063+0000","last_change":"2024-09-22T04:02:28.902123+0000","last_active":"2024-09-22T04:05:29.737063+0000","last_peered":"2024-09-22T04:05:29.737063+0000","last_clean":"2024-09-22T04:05:29.737063+0000","last_became_active":"2024-09-22T04:02:28.895508+0000","last_became_peered":"2024-09-22T04:02:28.895508+0000","last_unstale":"2024-09-22T04:05:29.737063+0000","last_undegraded":"2024-09-22T04:05:29.737063+0000","last_fullsized":"2024-09-22T04:05:29.737063+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":2037,"log_dups_size":0,"ondisk_log_size":2037,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4784128,"num_objects":73,"num_object_clones":0,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2037,"num_write_kb":67520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.6","version":"84'1811","reported_seq":1835,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-22T04:05:30.025802+0000","last_change":"2024-09-22T04:02:29.024059+0000","last_active":"2024-09-22T04:05:30.025802+0000","last_peered":"2024-09-22T04:05:30.025802+0000","last_clean":"2024-09-22T04:05:30.025802+0000","last_became_active":"2024-09-22T04:02:29.013699+0000","last_became_peered":"2024-09-22T04:02:29.013699+0000","last_unstale":"2024-09-22T04:05:30.025802+0000","last_undegraded":"2024-09-22T04:05:30.025802+0000","last_fullsized":"2024-09-22T04:05:30.025802+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1811,"log_dups_size":0,"ondisk_log_size":1811,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2949120,"num_objects":45,"num_object_clones":0,"num_object_copies":135,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1811,"num_write_kb":59392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":295,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-22T04:05:10.846024+0000","last_change":"2024-09-22T03:49:12.034704+0000","last_active":"2024-09-22T04:05:10.846024+0000","last_peered":"2024-09-22T04:05:10.846024+0000","last_clean":"2024-09-22T04:05:10.846024+0000","last_became_active":"2024-09-22T03:49:12.027470+0000","last_became_peered":"2024-09-22T03:49:12.027470+0000","last_unstale":"2024-09-22T04:05:10.846024+0000","last_undegraded":"2024-09-22T04:05:10.846024+0000","last_fullsized":"2024-09-22T04:05:10.846024+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_clean_scrub_stamp":"2024-09-22T03:49:10.979949+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":221,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-22T04:05:10.872801+0000","last_change":"2024-09-22T03:49:17.031458+0000","last_active":"2024-09-22T04:05:10.872801+0000","last_peered":"2024-09-22T04:05:10.872801+0000","last_clean":"2024-09-22T04:05:10.872801+0000","last_became_active":"2024-09-22T03:49:15.125490+0000","last_became_peered":"2024-09-22T03:49:15.125490+0000","last_unstale":"2024-09-22T04:05:10.872801+0000","last_undegraded":"2024-09-22T04:05:10.872801+0000","last_fullsized":"2024-09-22T04:05:10.872801+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"84'1921","reported_seq":1945,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-22T04:05:29.978292+0000","last_change":"2024-09-22T04:02:28.912870+0000","last_active":"2024-09-22T04:05:29.978292+0000","last_peered":"2024-09-22T04:05:29.978292+0000","last_clean":"2024-09-22T04:05:29.978292+0000","last_became_active":"2024-09-22T04:02:28.905573+0000","last_became_peered":"2024-09-22T04:02:28.905573+0000","last_unstale":"2024-09-22T04:05:29.978292+0000","last_undegraded":"2024-09-22T04:05:29.978292+0000","last_fullsized":"2024-09-22T04:05:29.978292+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1921,"log_dups_size":0,"ondisk_log_size":1921,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4259840,"num_objects":65,"num_object_clones":0,"num_object_copies":195,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1921,"num_write_kb":63552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":220,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-22T04:05:10.858441+0000","last_change":"2024-09-22T03:49:17.029339+0000","last_active":"2024-09-22T04:05:10.858441+0000","last_peered":"2024-09-22T04:05:10.858441+0000","last_clean":"2024-09-22T04:05:10.858441+0000","last_became_active":"2024-09-22T03:49:15.097304+0000","last_became_peered":"2024-09-22T03:49:15.097304+0000","last_unstale":"2024-09-22T04:05:10.858441+0000","last_undegraded":"2024-09-22T04:05:10.858441+0000","last_fullsized":"2024-09-22T04:05:10.858441+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"84'1885","reported_seq":1909,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-22T04:05:29.997976+0000","last_change":"2024-09-22T04:02:28.928198+0000","last_active":"2024-09-22T04:05:29.997976+0000","last_peered":"2024-09-22T04:05:29.997976+0000","last_clean":"2024-09-22T04:05:29.997976+0000","last_became_active":"2024-09-22T04:02:28.909503+0000","last_became_peered":"2024-09-22T04:02:28.909503+0000","last_unstale":"2024-09-22T04:05:29.997976+0000","last_undegraded":"2024-09-22T04:05:29.997976+0000","last_fullsized":"2024-09-22T04:05:29.997976+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1885,"log_dups_size":0,"ondisk_log_size":1885,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3866624,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1885,"num_write_kb":62208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":220,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-22T04:05:10.871635+0000","last_change":"2024-09-22T03:49:17.029349+0000","last_active":"2024-09-22T04:05:10.871635+0000","last_peered":"2024-09-22T04:05:10.871635+0000","last_clean":"2024-09-22T04:05:10.871635+0000","last_became_active":"2024-09-22T03:49:15.094890+0000","last_became_peered":"2024-09-22T03:49:15.094890+0000","last_unstale":"2024-09-22T04:05:10.871635+0000","last_undegraded":"2024-09-22T04:05:10.871635+0000","last_fullsized":"2024-09-22T04:05:10.871635+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.7","version":"84'1924","reported_seq":1948,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-22T04:05:30.002706+0000","last_change":"2024-09-22T04:02:28.945388+0000","last_active":"2024-09-22T04:05:30.002706+0000","last_peered":"2024-09-22T04:05:30.002706+0000","last_clean":"2024-09-22T04:05:30.002706+0000","last_became_active":"2024-09-22T04:02:28.939479+0000","last_became_peered":"2024-09-22T04:02:28.939479+0000","last_unstale":"2024-09-22T04:05:30.002706+0000","last_undegraded":"2024-09-22T04:05:30.002706+0000","last_fullsized":"2024-09-22T04:05:30.002706+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1924,"log_dups_size":0,"ondisk_log_size":1924,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3407872,"num_objects":52,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1924,"num_write_kb":63232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":222,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-22T04:05:10.865142+0000","last_change":"2024-09-22T03:49:17.031466+0000","last_active":"2024-09-22T04:05:10.865142+0000","last_peered":"2024-09-22T04:05:10.865142+0000","last_clean":"2024-09-22T04:05:10.865142+0000","last_became_active":"2024-09-22T03:49:15.098420+0000","last_became_peered":"2024-09-22T03:49:15.098420+0000","last_unstale":"2024-09-22T04:05:10.865142+0000","last_undegraded":"2024-09-22T04:05:10.865142+0000","last_fullsized":"2024-09-22T04:05:10.865142+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1","version":"84'1863","reported_seq":1887,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-22T04:05:30.069874+0000","last_change":"2024-09-22T04:02:28.927518+0000","last_active":"2024-09-22T04:05:30.069874+0000","last_peered":"2024-09-22T04:05:30.069874+0000","last_clean":"2024-09-22T04:05:30.069874+0000","last_became_active":"2024-09-22T04:02:28.919323+0000","last_became_peered":"2024-09-22T04:02:28.919323+0000","last_unstale":"2024-09-22T04:05:30.069874+0000","last_undegraded":"2024-09-22T04:05:30.069874+0000","last_fullsized":"2024-09-22T04:05:30.069874+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1863,"log_dups_size":0,"ondisk_log_size":1863,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3997696,"num_objects":61,"num_object_clones":0,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1863,"num_write_kb":61568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":220,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-22T04:05:10.855536+0000","last_change":"2024-09-22T03:49:17.036954+0000","last_active":"2024-09-22T04:05:10.855536+0000","last_peered":"2024-09-22T04:05:10.855536+0000","last_clean":"2024-09-22T04:05:10.855536+0000","last_became_active":"2024-09-22T03:49:15.110506+0000","last_became_peered":"2024-09-22T03:49:15.110506+0000","last_unstale":"2024-09-22T04:05:10.855536+0000","last_undegraded":"2024-09-22T04:05:10.855536+0000","last_fullsized":"2024-09-22T04:05:10.855536+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"84'1987","reported_seq":2011,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-22T04:05:31.105149+0000","last_change":"2024-09-22T04:02:28.954190+0000","last_active":"2024-09-22T04:05:31.105149+0000","last_peered":"2024-09-22T04:05:31.105149+0000","last_clean":"2024-09-22T04:05:31.105149+0000","last_became_active":"2024-09-22T04:02:28.946807+0000","last_became_peered":"2024-09-22T04:02:28.946807+0000","last_unstale":"2024-09-22T04:05:31.105149+0000","last_undegraded":"2024-09-22T04:05:31.105149+0000","last_fullsized":"2024-09-22T04:05:31.105149+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1987,"log_dups_size":0,"ondisk_log_size":1987,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4259840,"num_objects":65,"num_object_clones":0,"num_object_copies":195,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1987,"num_write_kb":65664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":220,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-22T04:05:10.851461+0000","last_change":"2024-09-22T03:49:17.032989+0000","last_active":"2024-09-22T04:05:10.851461+0000","last_peered":"2024-09-22T04:05:10.851461+0000","last_clean":"2024-09-22T04:05:10.851461+0000","last_became_active":"2024-09-22T03:49:15.079260+0000","last_became_peered":"2024-09-22T03:49:15.079260+0000","last_unstale":"2024-09-22T04:05:10.851461+0000","last_undegraded":"2024-09-22T04:05:10.851461+0000","last_fullsized":"2024-09-22T04:05:10.851461+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3","version":"84'1831","reported_seq":1855,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-22T04:05:30.114334+0000","last_change":"2024-09-22T04:02:28.924084+0000","last_active":"2024-09-22T04:05:30.114334+0000","last_peered":"2024-09-22T04:05:30.114334+0000","last_clean":"2024-09-22T04:05:30.114334+0000","last_became_active":"2024-09-22T04:02:28.898697+0000","last_became_peered":"2024-09-22T04:02:28.898697+0000","last_unstale":"2024-09-22T04:05:30.114334+0000","last_undegraded":"2024-09-22T04:05:30.114334+0000","last_fullsized":"2024-09-22T04:05:30.114334+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1831,"log_dups_size":0,"ondisk_log_size":1831,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3604480,"num_objects":55,"num_object_clones":0,"num_object_copies":165,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1831,"num_write_kb":60352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":220,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-22T04:05:10.857046+0000","last_change":"2024-09-22T03:49:17.036402+0000","last_active":"2024-09-22T04:05:10.857046+0000","last_peered":"2024-09-22T04:05:10.857046+0000","last_clean":"2024-09-22T04:05:10.857046+0000","last_became_active":"2024-09-22T03:49:15.108430+0000","last_became_peered":"2024-09-22T03:49:15.108430+0000","last_unstale":"2024-09-22T04:05:10.857046+0000","last_undegraded":"2024-09-22T04:05:10.857046+0000","last_fullsized":"2024-09-22T04:05:10.857046+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"84'1915","reported_seq":1939,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-22T04:05:30.239127+0000","last_change":"2024-09-22T04:02:29.018532+0000","last_active":"2024-09-22T04:05:30.239127+0000","last_peered":"2024-09-22T04:05:30.239127+0000","last_clean":"2024-09-22T04:05:30.239127+0000","last_became_active":"2024-09-22T04:02:29.006046+0000","last_became_peered":"2024-09-22T04:02:29.006046+0000","last_unstale":"2024-09-22T04:05:30.239127+0000","last_undegraded":"2024-09-22T04:05:30.239127+0000","last_fullsized":"2024-09-22T04:05:30.239127+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:02:27.756992+0000","last_clean_scrub_stamp":"2024-09-22T04:02:27.756992+0000","objects_scrubbed":0,"log_size":1915,"log_dups_size":0,"ondisk_log_size":1915,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2949120,"num_objects":45,"num_object_clones":0,"num_object_copies":135,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1915,"num_write_kb":62720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":220,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-22T04:05:10.861351+0000","last_change":"2024-09-22T03:49:17.029128+0000","last_active":"2024-09-22T04:05:10.861351+0000","last_peered":"2024-09-22T04:05:10.861351+0000","last_clean":"2024-09-22T04:05:10.861351+0000","last_became_active":"2024-09-22T03:49:15.113396+0000","last_became_peered":"2024-09-22T03:49:15.113396+0000","last_unstale":"2024-09-22T04:05:10.861351+0000","last_undegraded":"2024-09-22T04:05:10.861351+0000","last_fullsized":"2024-09-22T04:05:10.861351+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":59703320,"num_objects":912,"num_object_clones":0,"num_object_copies":2736,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":30484,"num_write_kb":1004609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":11542528,"data_stored":184483912,"data_compressed":8760280,"data_compressed_allocated":11530240,"data_compressed_original":184483840,"omap_allocated":0,"internal_metadata":0},"log_size":30484,"ondisk_log_size":30484,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949673938,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":37264,"kb_used_data":2432,"kb_used_omap":0,"kb_used_meta":34816,"kb_avail":94334576,"statfs":{"total":96636764160,"available":96598605824,"internally_reserved":0,"allocated":2490368,"data_stored":31970153,"data_compressed":1511368,"data_compressed_allocated":1990656,"data_compressed_original":31768576,"omap_allocated":0,"internal_metadata":35651584},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654706642,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":38340,"kb_used_data":3828,"kb_used_omap":0,"kb_used_meta":34496,"kb_avail":94333500,"statfs":{"total":96636764160,"available":96597504000,"internally_reserved":0,"allocated":3919872,"data_stored":55234889,"data_compressed":2614080,"data_compressed_allocated":3440640,"data_compressed_original":55050240,"omap_allocated":0,"internal_metadata":35323904},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706641,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":46592,"kb_used_data":3504,"kb_used_omap":0,"kb_used_meta":43072,"kb_avail":94325248,"statfs":{"total":96636764160,"available":96589053952,"internally_reserved":0,"allocated":3588096,"data_stored":49599313,"data_compressed":2348496,"data_compressed_allocated":3092480,"data_compressed_original":49397760,"omap_allocated":0,"internal_metadata":44105728},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706641,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35364,"kb_used_data":4308,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94336476,"statfs":{"total":96636764160,"available":96600551424,"internally_reserved":0,"allocated":4411392,"data_stored":62772054,"data_compressed":2974008,"data_compressed_allocated":3915776,"data_compressed_original":62570496,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":3596288,"data_stored":57475096,"data_compressed":2729224,"data_compressed_allocated":3592192,"data_compressed_original":57475072,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1937408,"data_stored":30933016,"data_compressed":1468864,"data_compressed_allocated":1933312,"data_compressed_original":30932992,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2740224,"data_stored":43843584,"data_compressed":2081928,"data_compressed_allocated":2740224,"data_compressed_original":43843584,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":3268608,"data_stored":52232216,"data_compressed":2480264,"data_compressed_allocated":3264512,"data_compressed_original":52232192,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T04:05:36.691 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Removed 15697 objects 2024-09-22T04:05:36.691 INFO:tasks.radosbench.radosbench.0.smithi037.stdout:Clean up completed and total clean up time :95.7734 2024-09-22T04:05:37.406 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T04:05:37.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:37.529+0000 7f791bea3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:37.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:37.536+0000 7f791bea3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:38.939 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_4 2024-09-22T04:05:38.939 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_4 unique_pool_4 --yes-i-really-really-mean-it 2024-09-22T04:05:39.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:39.064+0000 7f3763b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:39.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:39.077+0000 7f3763b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:39.642 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T04:05:39.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:39.755+0000 7f5c0c591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:39.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:39.762+0000 7f5c0c591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:39.809 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'unique_pool_4' removed 2024-09-22T04:05:39.827 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds 2024-09-22T04:05:39.837 INFO:tasks.thrashosds:joining thrashosds 2024-09-22T04:05:41.371 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=600 2024-09-22T04:05:41.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:41.489+0000 7f5cc4b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:41.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:41.496+0000 7f5cc4b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:41.512 INFO:teuthology.orchestra.run.smithi037.stdout:{} 2024-09-22T04:05:41.512 INFO:teuthology.orchestra.run.smithi037.stderr:mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-22T04:05:41.523 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-22T04:05:41.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:41.631+0000 7fd02529c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:41.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:41.642+0000 7fd02529c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:42.814 INFO:teuthology.orchestra.run.smithi037.stderr:reweighted osd.0 to 1 (10000) 2024-09-22T04:05:42.837 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 1 2024-09-22T04:05:42.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:42.950+0000 7fe38b391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:42.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:42.961+0000 7fe38b391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:43.820 INFO:teuthology.orchestra.run.smithi037.stderr:set osd.0 primary-affinity to 1 (8655362) 2024-09-22T04:05:43.847 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-22T04:05:43.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:43.963+0000 7f4ec0d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:43.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:43.974+0000 7f4ec0d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:44.826 INFO:teuthology.orchestra.run.smithi037.stderr:reweighted osd.1 to 1 (10000) 2024-09-22T04:05:44.851 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 1 2024-09-22T04:05:44.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:44.965+0000 7fa075191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:44.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:44.976+0000 7fa075191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:45.831 INFO:teuthology.orchestra.run.smithi037.stderr:set osd.1 primary-affinity to 1 (8655362) 2024-09-22T04:05:45.853 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-22T04:05:45.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:45.966+0000 7f87866fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:45.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:45.977+0000 7f87866fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:46.836 INFO:teuthology.orchestra.run.smithi037.stderr:reweighted osd.2 to 1 (10000) 2024-09-22T04:05:46.858 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 1 2024-09-22T04:05:46.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:46.969+0000 7f53b3311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:46.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:46.980+0000 7f53b3311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:47.842 INFO:teuthology.orchestra.run.smithi037.stderr:set osd.2 primary-affinity to 1 (8655362) 2024-09-22T04:05:47.862 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-22T04:05:47.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:47.973+0000 7f7a0c311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:47.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:47.984+0000 7f7a0c311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:48.848 INFO:teuthology.orchestra.run.smithi037.stderr:reweighted osd.3 to 1 (10000) 2024-09-22T04:05:48.876 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 3 1 2024-09-22T04:05:48.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:48.992+0000 7ff28ff51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:49.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:49.003+0000 7ff28ff51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:49.855 INFO:teuthology.orchestra.run.smithi037.stderr:set osd.3 primary-affinity to 1 (8655362) 2024-09-22T04:05:49.881 INFO:tasks.thrashosds.thrasher:joining the do_optrack_toggle greenlet 2024-09-22T04:05:49.881 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-22T04:05:49.881 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-22T04:05:50.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:49.996+0000 7fe27f2d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:50.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:50.005+0000 7fe27f2d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:50.207 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T04:05:50.207 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":93,"fsid":"9eda29d9-a2b0-48de-a9bc-7b5579d66932","created":"2024-09-22T03:49:02.654999+0000","modified":"2024-09-22T04:05:49.854204+0000","last_up_change":"2024-09-22T03:49:10.979949+0000","last_in_change":"2024-09-22T03:49:04.779488+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-22T03:49:10.979703+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.75,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-22T03:49:13.119488+0000","flags":270369,"flags_names":"hashpspool,nopgchange,selfmanaged_snaps,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":16,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"69ea14de-3fb4-408e-a111-1ad6fe1b1c18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":2258804031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6801","nonce":2258804031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":2258804031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6803","nonce":2258804031}]},"public_addr":"172.21.15.37:6800/2258804031","cluster_addr":"172.21.15.37:6801/2258804031","heartbeat_back_addr":"172.21.15.37:6802/2258804031","heartbeat_front_addr":"172.21.15.37:6803/2258804031","state":["exists","up"]},{"osd":1,"uuid":"868fe8cf-1915-4ae9-929b-c256a587d2ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1511839425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6807","nonce":1511839425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1511839425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6805","nonce":1511839425}]},"public_addr":"172.21.15.37:6808/1511839425","cluster_addr":"172.21.15.37:6807/1511839425","heartbeat_back_addr":"172.21.15.37:6804/1511839425","heartbeat_front_addr":"172.21.15.37:6805/1511839425","state":["exists","up"]},{"osd":2,"uuid":"68d5f134-2d34-4808-8747-59a974df8bd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":1340825941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6803","nonce":1340825941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":1340825941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6809","nonce":1340825941}]},"public_addr":"172.21.15.98:6804/1340825941","cluster_addr":"172.21.15.98:6803/1340825941","heartbeat_back_addr":"172.21.15.98:6808/1340825941","heartbeat_front_addr":"172.21.15.98:6809/1340825941","state":["exists","up"]},{"osd":3,"uuid":"9f81fabd-2b76-42a1-9e97-fc2087b5d32c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6805","nonce":3037275240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":3037275240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6807","nonce":3037275240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":3037275240}]},"public_addr":"172.21.15.98:6805/3037275240","cluster_addr":"172.21.15.98:6802/3037275240","heartbeat_back_addr":"172.21.15.98:6807/3037275240","heartbeat_front_addr":"172.21.15.98:6806/3037275240","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-22T04:05:50.221 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-22T04:05:50.221 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-22T04:05:50.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:50.329+0000 7f1c770fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:50.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:50.338+0000 7f1c770fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:50.538 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T04:05:50.538 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":93,"fsid":"9eda29d9-a2b0-48de-a9bc-7b5579d66932","created":"2024-09-22T03:49:02.654999+0000","modified":"2024-09-22T04:05:49.854204+0000","last_up_change":"2024-09-22T03:49:10.979949+0000","last_in_change":"2024-09-22T03:49:04.779488+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-22T03:49:10.979703+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.75,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-22T03:49:13.119488+0000","flags":270369,"flags_names":"hashpspool,nopgchange,selfmanaged_snaps,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":16,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"69ea14de-3fb4-408e-a111-1ad6fe1b1c18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":2258804031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6801","nonce":2258804031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":2258804031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6803","nonce":2258804031}]},"public_addr":"172.21.15.37:6800/2258804031","cluster_addr":"172.21.15.37:6801/2258804031","heartbeat_back_addr":"172.21.15.37:6802/2258804031","heartbeat_front_addr":"172.21.15.37:6803/2258804031","state":["exists","up"]},{"osd":1,"uuid":"868fe8cf-1915-4ae9-929b-c256a587d2ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1511839425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6807","nonce":1511839425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1511839425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6805","nonce":1511839425}]},"public_addr":"172.21.15.37:6808/1511839425","cluster_addr":"172.21.15.37:6807/1511839425","heartbeat_back_addr":"172.21.15.37:6804/1511839425","heartbeat_front_addr":"172.21.15.37:6805/1511839425","state":["exists","up"]},{"osd":2,"uuid":"68d5f134-2d34-4808-8747-59a974df8bd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":1340825941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6803","nonce":1340825941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":1340825941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6809","nonce":1340825941}]},"public_addr":"172.21.15.98:6804/1340825941","cluster_addr":"172.21.15.98:6803/1340825941","heartbeat_back_addr":"172.21.15.98:6808/1340825941","heartbeat_front_addr":"172.21.15.98:6809/1340825941","state":["exists","up"]},{"osd":3,"uuid":"9f81fabd-2b76-42a1-9e97-fc2087b5d32c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6805","nonce":3037275240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":3037275240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6807","nonce":3037275240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":3037275240}]},"public_addr":"172.21.15.98:6805/3037275240","cluster_addr":"172.21.15.98:6802/3037275240","heartbeat_back_addr":"172.21.15.98:6807/3037275240","heartbeat_front_addr":"172.21.15.98:6806/3037275240","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-22T04:05:50.552 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-22T04:05:50.552 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-22T04:05:50.553 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-22T04:05:50.553 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-22T04:05:50.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:50.673+0000 7f850fb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:50.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:50.673+0000 7f7722888640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:50.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:50.673+0000 7f81f5711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:50.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:50.673+0000 7f7328aa3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:50.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:50.684+0000 7f7722888640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:50.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:50.684+0000 7f850fb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:50.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:50.685+0000 7f81f5711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:50.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:50.685+0000 7f7328aa3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:50.727 INFO:teuthology.orchestra.run.smithi037.stdout:38654706662 2024-09-22T04:05:50.728 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-22T04:05:50.728 INFO:teuthology.orchestra.run.smithi037.stdout:38654706661 2024-09-22T04:05:50.728 INFO:teuthology.orchestra.run.smithi037.stdout:42949673957 2024-09-22T04:05:50.729 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-22T04:05:50.729 INFO:teuthology.orchestra.run.smithi037.stdout:38654706662 2024-09-22T04:05:50.730 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-22T04:05:50.730 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-22T04:05:50.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:50.888+0000 7f2d4e0fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:50.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:50.889+0000 7fafdc991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:50.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:50.889+0000 7f2cda191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:50.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:50.888+0000 7fd905874640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:50.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:50.900+0000 7f2d4e0fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:50.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:50.901+0000 7f2cda191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:50.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:50.901+0000 7fafdc991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:50.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:50.901+0000 7fd905874640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:51.108 INFO:teuthology.orchestra.run.smithi037.stdout:42949673953 2024-09-22T04:05:51.116 INFO:teuthology.orchestra.run.smithi037.stdout:38654706656 2024-09-22T04:05:51.118 INFO:teuthology.orchestra.run.smithi037.stdout:38654706656 2024-09-22T04:05:51.123 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673957 got 42949673953 for osd.1 2024-09-22T04:05:51.126 INFO:teuthology.orchestra.run.smithi037.stdout:38654706657 2024-09-22T04:05:51.131 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654706661 got 38654706656 for osd.0 2024-09-22T04:05:51.133 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654706662 got 38654706656 for osd.2 2024-09-22T04:05:51.140 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654706662 got 38654706657 for osd.3 2024-09-22T04:05:52.124 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-22T04:05:52.132 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-22T04:05:52.134 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-22T04:05:52.141 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-22T04:05:52.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:52.259+0000 7fcd7b288640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:52.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:52.271+0000 7fcd7b288640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:52.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:52.294+0000 7f63d5d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:52.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:52.294+0000 7f348ef91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:52.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:52.305+0000 7f348ef91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:52.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:52.306+0000 7f63d5d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:52.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:52.300+0000 7f2ecde7d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:52.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:52.313+0000 7f2ecde7d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:52.511 INFO:teuthology.orchestra.run.smithi037.stdout:42949673957 2024-09-22T04:05:52.515 INFO:teuthology.orchestra.run.smithi037.stdout:38654706662 2024-09-22T04:05:52.529 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654706662 got 38654706662 for osd.3 2024-09-22T04:05:52.530 DEBUG:teuthology.parallel:result is None 2024-09-22T04:05:52.530 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673957 got 42949673957 for osd.1 2024-09-22T04:05:52.530 DEBUG:teuthology.parallel:result is None 2024-09-22T04:05:52.543 INFO:teuthology.orchestra.run.smithi037.stdout:38654706662 2024-09-22T04:05:52.555 INFO:teuthology.orchestra.run.smithi037.stdout:38654706661 2024-09-22T04:05:52.556 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654706662 got 38654706662 for osd.2 2024-09-22T04:05:52.557 DEBUG:teuthology.parallel:result is None 2024-09-22T04:05:52.568 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654706661 got 38654706661 for osd.0 2024-09-22T04:05:52.569 DEBUG:teuthology.parallel:result is None 2024-09-22T04:05:52.569 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-22T04:05:52.569 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T04:05:52.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:52.717+0000 7f4f03f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:52.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:52.726+0000 7f4f03f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:52.927 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T04:05:52.927 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-22T04:05:52.940 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":587,"stamp":"2024-09-22T04:05:51.173618+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":176184,"kb_used_data":2008,"kb_used_omap":0,"kb_used_meta":173952,"kb_avail":377311176,"statfs":{"total":386547056640,"available":386366644224,"internally_reserved":0,"allocated":2056192,"data_stored":2479641,"data_compressed":90168,"data_compressed_allocated":122880,"data_compressed_original":1720320,"omap_allocated":0,"internal_metadata":178126848},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.336925"},"pg_stats":[{"pgid":"1.0","version":"11'52","reported_seq":322,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-22T04:05:49.867718+0000","last_change":"2024-09-22T03:49:12.034704+0000","last_active":"2024-09-22T04:05:49.867718+0000","last_peered":"2024-09-22T04:05:49.867718+0000","last_clean":"2024-09-22T04:05:49.867718+0000","last_became_active":"2024-09-22T03:49:12.027470+0000","last_became_peered":"2024-09-22T03:49:12.027470+0000","last_unstale":"2024-09-22T04:05:49.867718+0000","last_undegraded":"2024-09-22T04:05:49.867718+0000","last_fullsized":"2024-09-22T04:05:49.867718+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_clean_scrub_stamp":"2024-09-22T03:49:10.979949+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":248,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-22T04:05:49.869495+0000","last_change":"2024-09-22T03:49:17.031458+0000","last_active":"2024-09-22T04:05:49.869495+0000","last_peered":"2024-09-22T04:05:49.869495+0000","last_clean":"2024-09-22T04:05:49.869495+0000","last_became_active":"2024-09-22T03:49:15.125490+0000","last_became_peered":"2024-09-22T03:49:15.125490+0000","last_unstale":"2024-09-22T04:05:49.869495+0000","last_undegraded":"2024-09-22T04:05:49.869495+0000","last_fullsized":"2024-09-22T04:05:49.869495+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":247,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-22T04:05:49.866183+0000","last_change":"2024-09-22T03:49:17.029339+0000","last_active":"2024-09-22T04:05:49.866183+0000","last_peered":"2024-09-22T04:05:49.866183+0000","last_clean":"2024-09-22T04:05:49.866183+0000","last_became_active":"2024-09-22T03:49:15.097304+0000","last_became_peered":"2024-09-22T03:49:15.097304+0000","last_unstale":"2024-09-22T04:05:49.866183+0000","last_undegraded":"2024-09-22T04:05:49.866183+0000","last_fullsized":"2024-09-22T04:05:49.866183+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":247,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-22T04:05:49.868254+0000","last_change":"2024-09-22T03:49:17.029349+0000","last_active":"2024-09-22T04:05:49.868254+0000","last_peered":"2024-09-22T04:05:49.868254+0000","last_clean":"2024-09-22T04:05:49.868254+0000","last_became_active":"2024-09-22T03:49:15.094890+0000","last_became_peered":"2024-09-22T03:49:15.094890+0000","last_unstale":"2024-09-22T04:05:49.868254+0000","last_undegraded":"2024-09-22T04:05:49.868254+0000","last_fullsized":"2024-09-22T04:05:49.868254+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":249,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-22T04:05:49.869474+0000","last_change":"2024-09-22T03:49:17.031466+0000","last_active":"2024-09-22T04:05:49.869474+0000","last_peered":"2024-09-22T04:05:49.869474+0000","last_clean":"2024-09-22T04:05:49.869474+0000","last_became_active":"2024-09-22T03:49:15.098420+0000","last_became_peered":"2024-09-22T03:49:15.098420+0000","last_unstale":"2024-09-22T04:05:49.869474+0000","last_undegraded":"2024-09-22T04:05:49.869474+0000","last_fullsized":"2024-09-22T04:05:49.869474+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":247,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-22T04:05:49.873880+0000","last_change":"2024-09-22T03:49:17.036954+0000","last_active":"2024-09-22T04:05:49.873880+0000","last_peered":"2024-09-22T04:05:49.873880+0000","last_clean":"2024-09-22T04:05:49.873880+0000","last_became_active":"2024-09-22T03:49:15.110506+0000","last_became_peered":"2024-09-22T03:49:15.110506+0000","last_unstale":"2024-09-22T04:05:49.873880+0000","last_undegraded":"2024-09-22T04:05:49.873880+0000","last_fullsized":"2024-09-22T04:05:49.873880+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":247,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-22T04:05:49.869593+0000","last_change":"2024-09-22T03:49:17.032989+0000","last_active":"2024-09-22T04:05:49.869593+0000","last_peered":"2024-09-22T04:05:49.869593+0000","last_clean":"2024-09-22T04:05:49.869593+0000","last_became_active":"2024-09-22T03:49:15.079260+0000","last_became_peered":"2024-09-22T03:49:15.079260+0000","last_unstale":"2024-09-22T04:05:49.869593+0000","last_undegraded":"2024-09-22T04:05:49.869593+0000","last_fullsized":"2024-09-22T04:05:49.869593+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":247,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-22T04:05:49.878139+0000","last_change":"2024-09-22T03:49:17.036402+0000","last_active":"2024-09-22T04:05:49.878139+0000","last_peered":"2024-09-22T04:05:49.878139+0000","last_clean":"2024-09-22T04:05:49.878139+0000","last_became_active":"2024-09-22T03:49:15.108430+0000","last_became_peered":"2024-09-22T03:49:15.108430+0000","last_unstale":"2024-09-22T04:05:49.878139+0000","last_undegraded":"2024-09-22T04:05:49.878139+0000","last_fullsized":"2024-09-22T04:05:49.878139+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":247,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-22T04:05:49.867551+0000","last_change":"2024-09-22T03:49:17.029128+0000","last_active":"2024-09-22T04:05:49.867551+0000","last_peered":"2024-09-22T04:05:49.867551+0000","last_clean":"2024-09-22T04:05:49.867551+0000","last_became_active":"2024-09-22T03:49:15.113396+0000","last_became_peered":"2024-09-22T03:49:15.113396+0000","last_unstale":"2024-09-22T04:05:49.867551+0000","last_undegraded":"2024-09-22T04:05:49.867551+0000","last_fullsized":"2024-09-22T04:05:49.867551+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949673957,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35352,"kb_used_data":520,"kb_used_omap":0,"kb_used_meta":34816,"kb_avail":94336488,"statfs":{"total":96636764160,"available":96600563712,"internally_reserved":0,"allocated":532480,"data_stored":768238,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":35651584},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654706662,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":57252,"kb_used_data":452,"kb_used_omap":0,"kb_used_meta":56704,"kb_avail":94314588,"statfs":{"total":96636764160,"available":96578138112,"internally_reserved":0,"allocated":462848,"data_stored":174946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58064896},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706662,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":47768,"kb_used_data":520,"kb_used_omap":0,"kb_used_meta":47232,"kb_avail":94324072,"statfs":{"total":96636764160,"available":96587849728,"internally_reserved":0,"allocated":532480,"data_stored":768238,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":48365568},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706661,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35812,"kb_used_data":516,"kb_used_omap":0,"kb_used_meta":35200,"kb_avail":94336028,"statfs":{"total":96636764160,"available":96600092672,"internally_reserved":0,"allocated":528384,"data_stored":768219,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":36044800},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T04:05:52.942 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T04:05:53.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:53.050+0000 7fa58b751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:53.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:53.059+0000 7fa58b751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:53.262 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T04:05:53.262 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-22T04:05:53.275 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":588,"stamp":"2024-09-22T04:05:53.174180+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":176184,"kb_used_data":2008,"kb_used_omap":0,"kb_used_meta":173952,"kb_avail":377311176,"statfs":{"total":386547056640,"available":386366644224,"internally_reserved":0,"allocated":2056192,"data_stored":2479641,"data_compressed":90168,"data_compressed_allocated":122880,"data_compressed_original":1720320,"omap_allocated":0,"internal_metadata":178126848},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001404"},"pg_stats":[{"pgid":"1.0","version":"11'52","reported_seq":322,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-22T04:05:49.867718+0000","last_change":"2024-09-22T03:49:12.034704+0000","last_active":"2024-09-22T04:05:49.867718+0000","last_peered":"2024-09-22T04:05:49.867718+0000","last_clean":"2024-09-22T04:05:49.867718+0000","last_became_active":"2024-09-22T03:49:12.027470+0000","last_became_peered":"2024-09-22T03:49:12.027470+0000","last_unstale":"2024-09-22T04:05:49.867718+0000","last_undegraded":"2024-09-22T04:05:49.867718+0000","last_fullsized":"2024-09-22T04:05:49.867718+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_clean_scrub_stamp":"2024-09-22T03:49:10.979949+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":248,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-22T04:05:49.869495+0000","last_change":"2024-09-22T03:49:17.031458+0000","last_active":"2024-09-22T04:05:49.869495+0000","last_peered":"2024-09-22T04:05:49.869495+0000","last_clean":"2024-09-22T04:05:49.869495+0000","last_became_active":"2024-09-22T03:49:15.125490+0000","last_became_peered":"2024-09-22T03:49:15.125490+0000","last_unstale":"2024-09-22T04:05:49.869495+0000","last_undegraded":"2024-09-22T04:05:49.869495+0000","last_fullsized":"2024-09-22T04:05:49.869495+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":247,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-22T04:05:49.866183+0000","last_change":"2024-09-22T03:49:17.029339+0000","last_active":"2024-09-22T04:05:49.866183+0000","last_peered":"2024-09-22T04:05:49.866183+0000","last_clean":"2024-09-22T04:05:49.866183+0000","last_became_active":"2024-09-22T03:49:15.097304+0000","last_became_peered":"2024-09-22T03:49:15.097304+0000","last_unstale":"2024-09-22T04:05:49.866183+0000","last_undegraded":"2024-09-22T04:05:49.866183+0000","last_fullsized":"2024-09-22T04:05:49.866183+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":247,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-22T04:05:49.868254+0000","last_change":"2024-09-22T03:49:17.029349+0000","last_active":"2024-09-22T04:05:49.868254+0000","last_peered":"2024-09-22T04:05:49.868254+0000","last_clean":"2024-09-22T04:05:49.868254+0000","last_became_active":"2024-09-22T03:49:15.094890+0000","last_became_peered":"2024-09-22T03:49:15.094890+0000","last_unstale":"2024-09-22T04:05:49.868254+0000","last_undegraded":"2024-09-22T04:05:49.868254+0000","last_fullsized":"2024-09-22T04:05:49.868254+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":249,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-22T04:05:49.869474+0000","last_change":"2024-09-22T03:49:17.031466+0000","last_active":"2024-09-22T04:05:49.869474+0000","last_peered":"2024-09-22T04:05:49.869474+0000","last_clean":"2024-09-22T04:05:49.869474+0000","last_became_active":"2024-09-22T03:49:15.098420+0000","last_became_peered":"2024-09-22T03:49:15.098420+0000","last_unstale":"2024-09-22T04:05:49.869474+0000","last_undegraded":"2024-09-22T04:05:49.869474+0000","last_fullsized":"2024-09-22T04:05:49.869474+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":247,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-22T04:05:49.873880+0000","last_change":"2024-09-22T03:49:17.036954+0000","last_active":"2024-09-22T04:05:49.873880+0000","last_peered":"2024-09-22T04:05:49.873880+0000","last_clean":"2024-09-22T04:05:49.873880+0000","last_became_active":"2024-09-22T03:49:15.110506+0000","last_became_peered":"2024-09-22T03:49:15.110506+0000","last_unstale":"2024-09-22T04:05:49.873880+0000","last_undegraded":"2024-09-22T04:05:49.873880+0000","last_fullsized":"2024-09-22T04:05:49.873880+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":247,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-22T04:05:49.869593+0000","last_change":"2024-09-22T03:49:17.032989+0000","last_active":"2024-09-22T04:05:49.869593+0000","last_peered":"2024-09-22T04:05:49.869593+0000","last_clean":"2024-09-22T04:05:49.869593+0000","last_became_active":"2024-09-22T03:49:15.079260+0000","last_became_peered":"2024-09-22T03:49:15.079260+0000","last_unstale":"2024-09-22T04:05:49.869593+0000","last_undegraded":"2024-09-22T04:05:49.869593+0000","last_fullsized":"2024-09-22T04:05:49.869593+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":247,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-22T04:05:49.878139+0000","last_change":"2024-09-22T03:49:17.036402+0000","last_active":"2024-09-22T04:05:49.878139+0000","last_peered":"2024-09-22T04:05:49.878139+0000","last_clean":"2024-09-22T04:05:49.878139+0000","last_became_active":"2024-09-22T03:49:15.108430+0000","last_became_peered":"2024-09-22T03:49:15.108430+0000","last_unstale":"2024-09-22T04:05:49.878139+0000","last_undegraded":"2024-09-22T04:05:49.878139+0000","last_fullsized":"2024-09-22T04:05:49.878139+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":247,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-22T04:05:49.867551+0000","last_change":"2024-09-22T03:49:17.029128+0000","last_active":"2024-09-22T04:05:49.867551+0000","last_peered":"2024-09-22T04:05:49.867551+0000","last_clean":"2024-09-22T04:05:49.867551+0000","last_became_active":"2024-09-22T03:49:15.113396+0000","last_became_peered":"2024-09-22T03:49:15.113396+0000","last_unstale":"2024-09-22T04:05:49.867551+0000","last_undegraded":"2024-09-22T04:05:49.867551+0000","last_fullsized":"2024-09-22T04:05:49.867551+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949673958,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35352,"kb_used_data":520,"kb_used_omap":0,"kb_used_meta":34816,"kb_avail":94336488,"statfs":{"total":96636764160,"available":96600563712,"internally_reserved":0,"allocated":532480,"data_stored":768238,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":35651584},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654706662,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":57252,"kb_used_data":452,"kb_used_omap":0,"kb_used_meta":56704,"kb_avail":94314588,"statfs":{"total":96636764160,"available":96578138112,"internally_reserved":0,"allocated":462848,"data_stored":174946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58064896},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706662,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":47768,"kb_used_data":520,"kb_used_omap":0,"kb_used_meta":47232,"kb_avail":94324072,"statfs":{"total":96636764160,"available":96587849728,"internally_reserved":0,"allocated":532480,"data_stored":768238,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":48365568},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706661,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35812,"kb_used_data":516,"kb_used_omap":0,"kb_used_meta":35200,"kb_avail":94336028,"statfs":{"total":96636764160,"available":96600092672,"internally_reserved":0,"allocated":528384,"data_stored":768219,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":36044800},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T04:05:53.276 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-22T04:05:53.276 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr_debug_aggressive_pg_num_changes 2024-09-22T04:05:53.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:53.385+0000 7f17f1791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:53.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:53.396+0000 7f17f1791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:53.616 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-22T04:05:53.625 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-22T04:05:53.625 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T04:05:53.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:53.734+0000 7fce6ae7d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:53.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:53.742+0000 7fce6ae7d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:53.941 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T04:05:53.941 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-22T04:05:53.954 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":588,"stamp":"2024-09-22T04:05:53.174180+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":176184,"kb_used_data":2008,"kb_used_omap":0,"kb_used_meta":173952,"kb_avail":377311176,"statfs":{"total":386547056640,"available":386366644224,"internally_reserved":0,"allocated":2056192,"data_stored":2479641,"data_compressed":90168,"data_compressed_allocated":122880,"data_compressed_original":1720320,"omap_allocated":0,"internal_metadata":178126848},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001404"},"pg_stats":[{"pgid":"1.0","version":"11'52","reported_seq":322,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-22T04:05:49.867718+0000","last_change":"2024-09-22T03:49:12.034704+0000","last_active":"2024-09-22T04:05:49.867718+0000","last_peered":"2024-09-22T04:05:49.867718+0000","last_clean":"2024-09-22T04:05:49.867718+0000","last_became_active":"2024-09-22T03:49:12.027470+0000","last_became_peered":"2024-09-22T03:49:12.027470+0000","last_unstale":"2024-09-22T04:05:49.867718+0000","last_undegraded":"2024-09-22T04:05:49.867718+0000","last_fullsized":"2024-09-22T04:05:49.867718+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_clean_scrub_stamp":"2024-09-22T03:49:10.979949+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":248,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-22T04:05:49.869495+0000","last_change":"2024-09-22T03:49:17.031458+0000","last_active":"2024-09-22T04:05:49.869495+0000","last_peered":"2024-09-22T04:05:49.869495+0000","last_clean":"2024-09-22T04:05:49.869495+0000","last_became_active":"2024-09-22T03:49:15.125490+0000","last_became_peered":"2024-09-22T03:49:15.125490+0000","last_unstale":"2024-09-22T04:05:49.869495+0000","last_undegraded":"2024-09-22T04:05:49.869495+0000","last_fullsized":"2024-09-22T04:05:49.869495+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":247,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-22T04:05:49.866183+0000","last_change":"2024-09-22T03:49:17.029339+0000","last_active":"2024-09-22T04:05:49.866183+0000","last_peered":"2024-09-22T04:05:49.866183+0000","last_clean":"2024-09-22T04:05:49.866183+0000","last_became_active":"2024-09-22T03:49:15.097304+0000","last_became_peered":"2024-09-22T03:49:15.097304+0000","last_unstale":"2024-09-22T04:05:49.866183+0000","last_undegraded":"2024-09-22T04:05:49.866183+0000","last_fullsized":"2024-09-22T04:05:49.866183+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":247,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-22T04:05:49.868254+0000","last_change":"2024-09-22T03:49:17.029349+0000","last_active":"2024-09-22T04:05:49.868254+0000","last_peered":"2024-09-22T04:05:49.868254+0000","last_clean":"2024-09-22T04:05:49.868254+0000","last_became_active":"2024-09-22T03:49:15.094890+0000","last_became_peered":"2024-09-22T03:49:15.094890+0000","last_unstale":"2024-09-22T04:05:49.868254+0000","last_undegraded":"2024-09-22T04:05:49.868254+0000","last_fullsized":"2024-09-22T04:05:49.868254+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":249,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-22T04:05:49.869474+0000","last_change":"2024-09-22T03:49:17.031466+0000","last_active":"2024-09-22T04:05:49.869474+0000","last_peered":"2024-09-22T04:05:49.869474+0000","last_clean":"2024-09-22T04:05:49.869474+0000","last_became_active":"2024-09-22T03:49:15.098420+0000","last_became_peered":"2024-09-22T03:49:15.098420+0000","last_unstale":"2024-09-22T04:05:49.869474+0000","last_undegraded":"2024-09-22T04:05:49.869474+0000","last_fullsized":"2024-09-22T04:05:49.869474+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":247,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-22T04:05:49.873880+0000","last_change":"2024-09-22T03:49:17.036954+0000","last_active":"2024-09-22T04:05:49.873880+0000","last_peered":"2024-09-22T04:05:49.873880+0000","last_clean":"2024-09-22T04:05:49.873880+0000","last_became_active":"2024-09-22T03:49:15.110506+0000","last_became_peered":"2024-09-22T03:49:15.110506+0000","last_unstale":"2024-09-22T04:05:49.873880+0000","last_undegraded":"2024-09-22T04:05:49.873880+0000","last_fullsized":"2024-09-22T04:05:49.873880+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":247,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-22T04:05:49.869593+0000","last_change":"2024-09-22T03:49:17.032989+0000","last_active":"2024-09-22T04:05:49.869593+0000","last_peered":"2024-09-22T04:05:49.869593+0000","last_clean":"2024-09-22T04:05:49.869593+0000","last_became_active":"2024-09-22T03:49:15.079260+0000","last_became_peered":"2024-09-22T03:49:15.079260+0000","last_unstale":"2024-09-22T04:05:49.869593+0000","last_undegraded":"2024-09-22T04:05:49.869593+0000","last_fullsized":"2024-09-22T04:05:49.869593+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":247,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-22T04:05:49.878139+0000","last_change":"2024-09-22T03:49:17.036402+0000","last_active":"2024-09-22T04:05:49.878139+0000","last_peered":"2024-09-22T04:05:49.878139+0000","last_clean":"2024-09-22T04:05:49.878139+0000","last_became_active":"2024-09-22T03:49:15.108430+0000","last_became_peered":"2024-09-22T03:49:15.108430+0000","last_unstale":"2024-09-22T04:05:49.878139+0000","last_undegraded":"2024-09-22T04:05:49.878139+0000","last_fullsized":"2024-09-22T04:05:49.878139+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":247,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-22T04:05:49.867551+0000","last_change":"2024-09-22T03:49:17.029128+0000","last_active":"2024-09-22T04:05:49.867551+0000","last_peered":"2024-09-22T04:05:49.867551+0000","last_clean":"2024-09-22T04:05:49.867551+0000","last_became_active":"2024-09-22T03:49:15.113396+0000","last_became_peered":"2024-09-22T03:49:15.113396+0000","last_unstale":"2024-09-22T04:05:49.867551+0000","last_undegraded":"2024-09-22T04:05:49.867551+0000","last_fullsized":"2024-09-22T04:05:49.867551+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949673958,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35352,"kb_used_data":520,"kb_used_omap":0,"kb_used_meta":34816,"kb_avail":94336488,"statfs":{"total":96636764160,"available":96600563712,"internally_reserved":0,"allocated":532480,"data_stored":768238,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":35651584},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654706662,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":57252,"kb_used_data":452,"kb_used_omap":0,"kb_used_meta":56704,"kb_avail":94314588,"statfs":{"total":96636764160,"available":96578138112,"internally_reserved":0,"allocated":462848,"data_stored":174946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58064896},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706662,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":47768,"kb_used_data":520,"kb_used_omap":0,"kb_used_meta":47232,"kb_avail":94324072,"statfs":{"total":96636764160,"available":96587849728,"internally_reserved":0,"allocated":532480,"data_stored":768238,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":48365568},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706661,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35812,"kb_used_data":516,"kb_used_omap":0,"kb_used_meta":35200,"kb_avail":94336028,"statfs":{"total":96636764160,"available":96600092672,"internally_reserved":0,"allocated":528384,"data_stored":768219,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":36044800},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T04:05:53.955 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T04:05:54.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:54.064+0000 7fc0a569c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:54.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:54.072+0000 7fc0a569c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:54.274 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T04:05:54.274 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-22T04:05:54.287 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":588,"stamp":"2024-09-22T04:05:53.174180+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":176184,"kb_used_data":2008,"kb_used_omap":0,"kb_used_meta":173952,"kb_avail":377311176,"statfs":{"total":386547056640,"available":386366644224,"internally_reserved":0,"allocated":2056192,"data_stored":2479641,"data_compressed":90168,"data_compressed_allocated":122880,"data_compressed_original":1720320,"omap_allocated":0,"internal_metadata":178126848},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001404"},"pg_stats":[{"pgid":"1.0","version":"11'52","reported_seq":322,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-22T04:05:49.867718+0000","last_change":"2024-09-22T03:49:12.034704+0000","last_active":"2024-09-22T04:05:49.867718+0000","last_peered":"2024-09-22T04:05:49.867718+0000","last_clean":"2024-09-22T04:05:49.867718+0000","last_became_active":"2024-09-22T03:49:12.027470+0000","last_became_peered":"2024-09-22T03:49:12.027470+0000","last_unstale":"2024-09-22T04:05:49.867718+0000","last_undegraded":"2024-09-22T04:05:49.867718+0000","last_fullsized":"2024-09-22T04:05:49.867718+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_clean_scrub_stamp":"2024-09-22T03:49:10.979949+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":248,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-22T04:05:49.869495+0000","last_change":"2024-09-22T03:49:17.031458+0000","last_active":"2024-09-22T04:05:49.869495+0000","last_peered":"2024-09-22T04:05:49.869495+0000","last_clean":"2024-09-22T04:05:49.869495+0000","last_became_active":"2024-09-22T03:49:15.125490+0000","last_became_peered":"2024-09-22T03:49:15.125490+0000","last_unstale":"2024-09-22T04:05:49.869495+0000","last_undegraded":"2024-09-22T04:05:49.869495+0000","last_fullsized":"2024-09-22T04:05:49.869495+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":247,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-22T04:05:49.866183+0000","last_change":"2024-09-22T03:49:17.029339+0000","last_active":"2024-09-22T04:05:49.866183+0000","last_peered":"2024-09-22T04:05:49.866183+0000","last_clean":"2024-09-22T04:05:49.866183+0000","last_became_active":"2024-09-22T03:49:15.097304+0000","last_became_peered":"2024-09-22T03:49:15.097304+0000","last_unstale":"2024-09-22T04:05:49.866183+0000","last_undegraded":"2024-09-22T04:05:49.866183+0000","last_fullsized":"2024-09-22T04:05:49.866183+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":247,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-22T04:05:49.868254+0000","last_change":"2024-09-22T03:49:17.029349+0000","last_active":"2024-09-22T04:05:49.868254+0000","last_peered":"2024-09-22T04:05:49.868254+0000","last_clean":"2024-09-22T04:05:49.868254+0000","last_became_active":"2024-09-22T03:49:15.094890+0000","last_became_peered":"2024-09-22T03:49:15.094890+0000","last_unstale":"2024-09-22T04:05:49.868254+0000","last_undegraded":"2024-09-22T04:05:49.868254+0000","last_fullsized":"2024-09-22T04:05:49.868254+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":249,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-22T04:05:49.869474+0000","last_change":"2024-09-22T03:49:17.031466+0000","last_active":"2024-09-22T04:05:49.869474+0000","last_peered":"2024-09-22T04:05:49.869474+0000","last_clean":"2024-09-22T04:05:49.869474+0000","last_became_active":"2024-09-22T03:49:15.098420+0000","last_became_peered":"2024-09-22T03:49:15.098420+0000","last_unstale":"2024-09-22T04:05:49.869474+0000","last_undegraded":"2024-09-22T04:05:49.869474+0000","last_fullsized":"2024-09-22T04:05:49.869474+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":247,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-22T04:05:49.873880+0000","last_change":"2024-09-22T03:49:17.036954+0000","last_active":"2024-09-22T04:05:49.873880+0000","last_peered":"2024-09-22T04:05:49.873880+0000","last_clean":"2024-09-22T04:05:49.873880+0000","last_became_active":"2024-09-22T03:49:15.110506+0000","last_became_peered":"2024-09-22T03:49:15.110506+0000","last_unstale":"2024-09-22T04:05:49.873880+0000","last_undegraded":"2024-09-22T04:05:49.873880+0000","last_fullsized":"2024-09-22T04:05:49.873880+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":247,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-22T04:05:49.869593+0000","last_change":"2024-09-22T03:49:17.032989+0000","last_active":"2024-09-22T04:05:49.869593+0000","last_peered":"2024-09-22T04:05:49.869593+0000","last_clean":"2024-09-22T04:05:49.869593+0000","last_became_active":"2024-09-22T03:49:15.079260+0000","last_became_peered":"2024-09-22T03:49:15.079260+0000","last_unstale":"2024-09-22T04:05:49.869593+0000","last_undegraded":"2024-09-22T04:05:49.869593+0000","last_fullsized":"2024-09-22T04:05:49.869593+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":247,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-22T04:05:49.878139+0000","last_change":"2024-09-22T03:49:17.036402+0000","last_active":"2024-09-22T04:05:49.878139+0000","last_peered":"2024-09-22T04:05:49.878139+0000","last_clean":"2024-09-22T04:05:49.878139+0000","last_became_active":"2024-09-22T03:49:15.108430+0000","last_became_peered":"2024-09-22T03:49:15.108430+0000","last_unstale":"2024-09-22T04:05:49.878139+0000","last_undegraded":"2024-09-22T04:05:49.878139+0000","last_fullsized":"2024-09-22T04:05:49.878139+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":247,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-22T04:05:49.867551+0000","last_change":"2024-09-22T03:49:17.029128+0000","last_active":"2024-09-22T04:05:49.867551+0000","last_peered":"2024-09-22T04:05:49.867551+0000","last_clean":"2024-09-22T04:05:49.867551+0000","last_became_active":"2024-09-22T03:49:15.113396+0000","last_became_peered":"2024-09-22T03:49:15.113396+0000","last_unstale":"2024-09-22T04:05:49.867551+0000","last_undegraded":"2024-09-22T04:05:49.867551+0000","last_fullsized":"2024-09-22T04:05:49.867551+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949673958,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35352,"kb_used_data":520,"kb_used_omap":0,"kb_used_meta":34816,"kb_avail":94336488,"statfs":{"total":96636764160,"available":96600563712,"internally_reserved":0,"allocated":532480,"data_stored":768238,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":35651584},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654706662,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":57252,"kb_used_data":452,"kb_used_omap":0,"kb_used_meta":56704,"kb_avail":94314588,"statfs":{"total":96636764160,"available":96578138112,"internally_reserved":0,"allocated":462848,"data_stored":174946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58064896},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706662,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":47768,"kb_used_data":520,"kb_used_omap":0,"kb_used_meta":47232,"kb_avail":94324072,"statfs":{"total":96636764160,"available":96587849728,"internally_reserved":0,"allocated":532480,"data_stored":768238,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":48365568},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706661,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35812,"kb_used_data":516,"kb_used_omap":0,"kb_used_meta":35200,"kb_avail":94336028,"statfs":{"total":96636764160,"available":96600092672,"internally_reserved":0,"allocated":528384,"data_stored":768219,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":36044800},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T04:05:54.288 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-22T04:05:54.288 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T04:05:54.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:54.396+0000 7f5105e88640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:54.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:54.405+0000 7f5105e88640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:54.603 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T04:05:54.604 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-22T04:05:54.617 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":588,"stamp":"2024-09-22T04:05:53.174180+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":176184,"kb_used_data":2008,"kb_used_omap":0,"kb_used_meta":173952,"kb_avail":377311176,"statfs":{"total":386547056640,"available":386366644224,"internally_reserved":0,"allocated":2056192,"data_stored":2479641,"data_compressed":90168,"data_compressed_allocated":122880,"data_compressed_original":1720320,"omap_allocated":0,"internal_metadata":178126848},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001404"},"pg_stats":[{"pgid":"1.0","version":"11'52","reported_seq":322,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-22T04:05:49.867718+0000","last_change":"2024-09-22T03:49:12.034704+0000","last_active":"2024-09-22T04:05:49.867718+0000","last_peered":"2024-09-22T04:05:49.867718+0000","last_clean":"2024-09-22T04:05:49.867718+0000","last_became_active":"2024-09-22T03:49:12.027470+0000","last_became_peered":"2024-09-22T03:49:12.027470+0000","last_unstale":"2024-09-22T04:05:49.867718+0000","last_undegraded":"2024-09-22T04:05:49.867718+0000","last_fullsized":"2024-09-22T04:05:49.867718+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_clean_scrub_stamp":"2024-09-22T03:49:10.979949+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":248,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-22T04:05:49.869495+0000","last_change":"2024-09-22T03:49:17.031458+0000","last_active":"2024-09-22T04:05:49.869495+0000","last_peered":"2024-09-22T04:05:49.869495+0000","last_clean":"2024-09-22T04:05:49.869495+0000","last_became_active":"2024-09-22T03:49:15.125490+0000","last_became_peered":"2024-09-22T03:49:15.125490+0000","last_unstale":"2024-09-22T04:05:49.869495+0000","last_undegraded":"2024-09-22T04:05:49.869495+0000","last_fullsized":"2024-09-22T04:05:49.869495+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":247,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-22T04:05:49.866183+0000","last_change":"2024-09-22T03:49:17.029339+0000","last_active":"2024-09-22T04:05:49.866183+0000","last_peered":"2024-09-22T04:05:49.866183+0000","last_clean":"2024-09-22T04:05:49.866183+0000","last_became_active":"2024-09-22T03:49:15.097304+0000","last_became_peered":"2024-09-22T03:49:15.097304+0000","last_unstale":"2024-09-22T04:05:49.866183+0000","last_undegraded":"2024-09-22T04:05:49.866183+0000","last_fullsized":"2024-09-22T04:05:49.866183+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":247,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-22T04:05:49.868254+0000","last_change":"2024-09-22T03:49:17.029349+0000","last_active":"2024-09-22T04:05:49.868254+0000","last_peered":"2024-09-22T04:05:49.868254+0000","last_clean":"2024-09-22T04:05:49.868254+0000","last_became_active":"2024-09-22T03:49:15.094890+0000","last_became_peered":"2024-09-22T03:49:15.094890+0000","last_unstale":"2024-09-22T04:05:49.868254+0000","last_undegraded":"2024-09-22T04:05:49.868254+0000","last_fullsized":"2024-09-22T04:05:49.868254+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":249,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-22T04:05:49.869474+0000","last_change":"2024-09-22T03:49:17.031466+0000","last_active":"2024-09-22T04:05:49.869474+0000","last_peered":"2024-09-22T04:05:49.869474+0000","last_clean":"2024-09-22T04:05:49.869474+0000","last_became_active":"2024-09-22T03:49:15.098420+0000","last_became_peered":"2024-09-22T03:49:15.098420+0000","last_unstale":"2024-09-22T04:05:49.869474+0000","last_undegraded":"2024-09-22T04:05:49.869474+0000","last_fullsized":"2024-09-22T04:05:49.869474+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":247,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-22T04:05:49.873880+0000","last_change":"2024-09-22T03:49:17.036954+0000","last_active":"2024-09-22T04:05:49.873880+0000","last_peered":"2024-09-22T04:05:49.873880+0000","last_clean":"2024-09-22T04:05:49.873880+0000","last_became_active":"2024-09-22T03:49:15.110506+0000","last_became_peered":"2024-09-22T03:49:15.110506+0000","last_unstale":"2024-09-22T04:05:49.873880+0000","last_undegraded":"2024-09-22T04:05:49.873880+0000","last_fullsized":"2024-09-22T04:05:49.873880+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":247,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-22T04:05:49.869593+0000","last_change":"2024-09-22T03:49:17.032989+0000","last_active":"2024-09-22T04:05:49.869593+0000","last_peered":"2024-09-22T04:05:49.869593+0000","last_clean":"2024-09-22T04:05:49.869593+0000","last_became_active":"2024-09-22T03:49:15.079260+0000","last_became_peered":"2024-09-22T03:49:15.079260+0000","last_unstale":"2024-09-22T04:05:49.869593+0000","last_undegraded":"2024-09-22T04:05:49.869593+0000","last_fullsized":"2024-09-22T04:05:49.869593+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":247,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-22T04:05:49.878139+0000","last_change":"2024-09-22T03:49:17.036402+0000","last_active":"2024-09-22T04:05:49.878139+0000","last_peered":"2024-09-22T04:05:49.878139+0000","last_clean":"2024-09-22T04:05:49.878139+0000","last_became_active":"2024-09-22T03:49:15.108430+0000","last_became_peered":"2024-09-22T03:49:15.108430+0000","last_unstale":"2024-09-22T04:05:49.878139+0000","last_undegraded":"2024-09-22T04:05:49.878139+0000","last_fullsized":"2024-09-22T04:05:49.878139+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":247,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-22T04:05:49.867551+0000","last_change":"2024-09-22T03:49:17.029128+0000","last_active":"2024-09-22T04:05:49.867551+0000","last_peered":"2024-09-22T04:05:49.867551+0000","last_clean":"2024-09-22T04:05:49.867551+0000","last_became_active":"2024-09-22T03:49:15.113396+0000","last_became_peered":"2024-09-22T03:49:15.113396+0000","last_unstale":"2024-09-22T04:05:49.867551+0000","last_undegraded":"2024-09-22T04:05:49.867551+0000","last_fullsized":"2024-09-22T04:05:49.867551+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949673958,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35352,"kb_used_data":520,"kb_used_omap":0,"kb_used_meta":34816,"kb_avail":94336488,"statfs":{"total":96636764160,"available":96600563712,"internally_reserved":0,"allocated":532480,"data_stored":768238,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":35651584},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654706662,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":57252,"kb_used_data":452,"kb_used_omap":0,"kb_used_meta":56704,"kb_avail":94314588,"statfs":{"total":96636764160,"available":96578138112,"internally_reserved":0,"allocated":462848,"data_stored":174946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58064896},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706662,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":47768,"kb_used_data":520,"kb_used_omap":0,"kb_used_meta":47232,"kb_avail":94324072,"statfs":{"total":96636764160,"available":96587849728,"internally_reserved":0,"allocated":532480,"data_stored":768238,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":48365568},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706661,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35812,"kb_used_data":516,"kb_used_omap":0,"kb_used_meta":35200,"kb_avail":94336028,"statfs":{"total":96636764160,"available":96600092672,"internally_reserved":0,"allocated":528384,"data_stored":768219,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":36044800},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T04:05:54.618 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-22T04:05:54.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:54.726+0000 7f6dbf111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:54.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:54.734+0000 7f6dbf111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:54.937 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T04:05:54.937 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":93,"fsid":"9eda29d9-a2b0-48de-a9bc-7b5579d66932","created":"2024-09-22T03:49:02.654999+0000","modified":"2024-09-22T04:05:49.854204+0000","last_up_change":"2024-09-22T03:49:10.979949+0000","last_in_change":"2024-09-22T03:49:04.779488+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-22T03:49:10.979703+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.75,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-22T03:49:13.119488+0000","flags":270369,"flags_names":"hashpspool,nopgchange,selfmanaged_snaps,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":16,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"69ea14de-3fb4-408e-a111-1ad6fe1b1c18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":2258804031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6801","nonce":2258804031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":2258804031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6803","nonce":2258804031}]},"public_addr":"172.21.15.37:6800/2258804031","cluster_addr":"172.21.15.37:6801/2258804031","heartbeat_back_addr":"172.21.15.37:6802/2258804031","heartbeat_front_addr":"172.21.15.37:6803/2258804031","state":["exists","up"]},{"osd":1,"uuid":"868fe8cf-1915-4ae9-929b-c256a587d2ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1511839425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6807","nonce":1511839425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1511839425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6805","nonce":1511839425}]},"public_addr":"172.21.15.37:6808/1511839425","cluster_addr":"172.21.15.37:6807/1511839425","heartbeat_back_addr":"172.21.15.37:6804/1511839425","heartbeat_front_addr":"172.21.15.37:6805/1511839425","state":["exists","up"]},{"osd":2,"uuid":"68d5f134-2d34-4808-8747-59a974df8bd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":1340825941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6803","nonce":1340825941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":1340825941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6809","nonce":1340825941}]},"public_addr":"172.21.15.98:6804/1340825941","cluster_addr":"172.21.15.98:6803/1340825941","heartbeat_back_addr":"172.21.15.98:6808/1340825941","heartbeat_front_addr":"172.21.15.98:6809/1340825941","state":["exists","up"]},{"osd":3,"uuid":"9f81fabd-2b76-42a1-9e97-fc2087b5d32c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6805","nonce":3037275240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":3037275240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6807","nonce":3037275240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":3037275240}]},"public_addr":"172.21.15.98:6805/3037275240","cluster_addr":"172.21.15.98:6802/3037275240","heartbeat_back_addr":"172.21.15.98:6807/3037275240","heartbeat_front_addr":"172.21.15.98:6806/3037275240","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-22T04:05:55.951 INFO:tasks.ceph:Scrubbing osd.0 2024-09-22T04:05:55.951 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-22T04:05:56.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:56.075+0000 7f0376351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:56.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:56.088+0000 7f0376351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:56.107 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-22T04:05:56.107 INFO:teuthology.orchestra.run.smithi037.stdout: "success": "" 2024-09-22T04:05:56.107 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-22T04:05:56.119 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-22T04:05:56.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:56.228+0000 7fd157f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:56.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:56.237+0000 7fd157f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:56.443 INFO:teuthology.orchestra.run.smithi037.stderr:instructed osd(s) 0 to deep-scrub 2024-09-22T04:05:56.457 INFO:tasks.ceph:Scrubbing osd.1 2024-09-22T04:05:56.457 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-22T04:05:56.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:56.564+0000 7f6008b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:56.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:56.578+0000 7f6008b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:56.596 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-22T04:05:56.596 INFO:teuthology.orchestra.run.smithi037.stdout: "success": "" 2024-09-22T04:05:56.596 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-22T04:05:56.607 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-22T04:05:56.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:56.716+0000 7f55fb191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:56.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:56.726+0000 7f55fb191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:56.927 INFO:teuthology.orchestra.run.smithi037.stderr:instructed osd(s) 1 to deep-scrub 2024-09-22T04:05:56.948 INFO:tasks.ceph:Scrubbing osd.2 2024-09-22T04:05:56.948 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-22T04:05:57.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:57.057+0000 7f47ffd11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:57.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:57.071+0000 7f47ffd11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:57.091 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-22T04:05:57.091 INFO:teuthology.orchestra.run.smithi037.stdout: "success": "" 2024-09-22T04:05:57.091 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-22T04:05:57.102 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-22T04:05:57.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:57.210+0000 7f33060d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:57.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:57.221+0000 7f33060d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:57.428 INFO:teuthology.orchestra.run.smithi037.stderr:instructed osd(s) 2 to deep-scrub 2024-09-22T04:05:57.446 INFO:tasks.ceph:Scrubbing osd.3 2024-09-22T04:05:57.446 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-22T04:05:57.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:57.555+0000 7f6279c7d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:57.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:57.568+0000 7f6279c7d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:57.589 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-22T04:05:57.590 INFO:teuthology.orchestra.run.smithi037.stdout: "success": "" 2024-09-22T04:05:57.590 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-22T04:05:57.600 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-22T04:05:57.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:57.707+0000 7f28b2311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:57.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:57.717+0000 7f28b2311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:57.924 INFO:teuthology.orchestra.run.smithi037.stderr:instructed osd(s) 3 to deep-scrub 2024-09-22T04:05:57.940 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T04:05:58.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:58.048+0000 7f8a5ee74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:58.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:05:58.057+0000 7f8a5ee74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:05:58.256 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T04:05:58.256 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-22T04:05:58.268 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":590,"stamp":"2024-09-22T04:05:57.175190+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":176112,"kb_used_data":2016,"kb_used_omap":0,"kb_used_meta":173952,"kb_avail":377311248,"statfs":{"total":386547056640,"available":386366717952,"internally_reserved":0,"allocated":2064384,"data_stored":2482565,"data_compressed":90168,"data_compressed_allocated":122880,"data_compressed_original":1720320,"omap_allocated":0,"internal_metadata":178126848},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.326247"},"pg_stats":[{"pgid":"1.0","version":"11'52","reported_seq":322,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-22T04:05:49.867718+0000","last_change":"2024-09-22T03:49:12.034704+0000","last_active":"2024-09-22T04:05:49.867718+0000","last_peered":"2024-09-22T04:05:49.867718+0000","last_clean":"2024-09-22T04:05:49.867718+0000","last_became_active":"2024-09-22T03:49:12.027470+0000","last_became_peered":"2024-09-22T03:49:12.027470+0000","last_unstale":"2024-09-22T04:05:49.867718+0000","last_undegraded":"2024-09-22T04:05:49.867718+0000","last_fullsized":"2024-09-22T04:05:49.867718+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:10.979949+0000","last_clean_scrub_stamp":"2024-09-22T03:49:10.979949+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":248,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-22T04:05:49.869495+0000","last_change":"2024-09-22T03:49:17.031458+0000","last_active":"2024-09-22T04:05:49.869495+0000","last_peered":"2024-09-22T04:05:49.869495+0000","last_clean":"2024-09-22T04:05:49.869495+0000","last_became_active":"2024-09-22T03:49:15.125490+0000","last_became_peered":"2024-09-22T03:49:15.125490+0000","last_unstale":"2024-09-22T04:05:49.869495+0000","last_undegraded":"2024-09-22T04:05:49.869495+0000","last_fullsized":"2024-09-22T04:05:49.869495+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":247,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-22T04:05:49.866183+0000","last_change":"2024-09-22T03:49:17.029339+0000","last_active":"2024-09-22T04:05:49.866183+0000","last_peered":"2024-09-22T04:05:49.866183+0000","last_clean":"2024-09-22T04:05:49.866183+0000","last_became_active":"2024-09-22T03:49:15.097304+0000","last_became_peered":"2024-09-22T03:49:15.097304+0000","last_unstale":"2024-09-22T04:05:49.866183+0000","last_undegraded":"2024-09-22T04:05:49.866183+0000","last_fullsized":"2024-09-22T04:05:49.866183+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":247,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-22T04:05:49.868254+0000","last_change":"2024-09-22T03:49:17.029349+0000","last_active":"2024-09-22T04:05:49.868254+0000","last_peered":"2024-09-22T04:05:49.868254+0000","last_clean":"2024-09-22T04:05:49.868254+0000","last_became_active":"2024-09-22T03:49:15.094890+0000","last_became_peered":"2024-09-22T03:49:15.094890+0000","last_unstale":"2024-09-22T04:05:49.868254+0000","last_undegraded":"2024-09-22T04:05:49.868254+0000","last_fullsized":"2024-09-22T04:05:49.868254+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":249,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-22T04:05:49.869474+0000","last_change":"2024-09-22T03:49:17.031466+0000","last_active":"2024-09-22T04:05:49.869474+0000","last_peered":"2024-09-22T04:05:49.869474+0000","last_clean":"2024-09-22T04:05:49.869474+0000","last_became_active":"2024-09-22T03:49:15.098420+0000","last_became_peered":"2024-09-22T03:49:15.098420+0000","last_unstale":"2024-09-22T04:05:49.869474+0000","last_undegraded":"2024-09-22T04:05:49.869474+0000","last_fullsized":"2024-09-22T04:05:49.869474+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":247,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-22T04:05:49.873880+0000","last_change":"2024-09-22T03:49:17.036954+0000","last_active":"2024-09-22T04:05:49.873880+0000","last_peered":"2024-09-22T04:05:49.873880+0000","last_clean":"2024-09-22T04:05:49.873880+0000","last_became_active":"2024-09-22T03:49:15.110506+0000","last_became_peered":"2024-09-22T03:49:15.110506+0000","last_unstale":"2024-09-22T04:05:49.873880+0000","last_undegraded":"2024-09-22T04:05:49.873880+0000","last_fullsized":"2024-09-22T04:05:49.873880+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":247,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-22T04:05:49.869593+0000","last_change":"2024-09-22T03:49:17.032989+0000","last_active":"2024-09-22T04:05:49.869593+0000","last_peered":"2024-09-22T04:05:49.869593+0000","last_clean":"2024-09-22T04:05:49.869593+0000","last_became_active":"2024-09-22T03:49:15.079260+0000","last_became_peered":"2024-09-22T03:49:15.079260+0000","last_unstale":"2024-09-22T04:05:49.869593+0000","last_undegraded":"2024-09-22T04:05:49.869593+0000","last_fullsized":"2024-09-22T04:05:49.869593+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":247,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-22T04:05:49.878139+0000","last_change":"2024-09-22T03:49:17.036402+0000","last_active":"2024-09-22T04:05:49.878139+0000","last_peered":"2024-09-22T04:05:49.878139+0000","last_clean":"2024-09-22T04:05:49.878139+0000","last_became_active":"2024-09-22T03:49:15.108430+0000","last_became_peered":"2024-09-22T03:49:15.108430+0000","last_unstale":"2024-09-22T04:05:49.878139+0000","last_undegraded":"2024-09-22T04:05:49.878139+0000","last_fullsized":"2024-09-22T04:05:49.878139+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":247,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-22T04:05:49.867551+0000","last_change":"2024-09-22T03:49:17.029128+0000","last_active":"2024-09-22T04:05:49.867551+0000","last_peered":"2024-09-22T04:05:49.867551+0000","last_clean":"2024-09-22T04:05:49.867551+0000","last_became_active":"2024-09-22T03:49:15.113396+0000","last_became_peered":"2024-09-22T03:49:15.113396+0000","last_unstale":"2024-09-22T04:05:49.867551+0000","last_undegraded":"2024-09-22T04:05:49.867551+0000","last_fullsized":"2024-09-22T04:05:49.867551+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:49:13.994718+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949673963,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35352,"kb_used_data":520,"kb_used_omap":0,"kb_used_meta":34816,"kb_avail":94336488,"statfs":{"total":96636764160,"available":96600563712,"internally_reserved":0,"allocated":532480,"data_stored":768238,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":35651584},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654706667,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":57180,"kb_used_data":460,"kb_used_omap":0,"kb_used_meta":56704,"kb_avail":94314660,"statfs":{"total":96636764160,"available":96578211840,"internally_reserved":0,"allocated":471040,"data_stored":177870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58064896},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706666,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":47768,"kb_used_data":520,"kb_used_omap":0,"kb_used_meta":47232,"kb_avail":94324072,"statfs":{"total":96636764160,"available":96587849728,"internally_reserved":0,"allocated":532480,"data_stored":768238,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":48365568},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706666,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35812,"kb_used_data":516,"kb_used_omap":0,"kb_used_meta":35200,"kb_avail":94336028,"statfs":{"total":96636764160,"available":96600092672,"internally_reserved":0,"allocated":528384,"data_stored":768219,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":36044800},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T04:05:58.271 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-22T03:49:10.979949+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=3, tm_min=49, tm_sec=10, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=4, tm_min=5, tm_sec=54, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T04:05:58.271 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-22T03:49:13.994718+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=3, tm_min=49, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=4, tm_min=5, tm_sec=54, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T04:05:58.271 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-22T03:49:13.994718+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=3, tm_min=49, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=4, tm_min=5, tm_sec=54, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T04:05:58.271 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-22T03:49:13.994718+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=3, tm_min=49, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=4, tm_min=5, tm_sec=54, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T04:05:58.271 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-22T03:49:13.994718+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=3, tm_min=49, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=4, tm_min=5, tm_sec=54, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T04:05:58.272 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-22T03:49:13.994718+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=3, tm_min=49, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=4, tm_min=5, tm_sec=54, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T04:05:58.272 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-22T03:49:13.994718+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=3, tm_min=49, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=4, tm_min=5, tm_sec=54, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T04:05:58.272 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-22T03:49:13.994718+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=3, tm_min=49, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=4, tm_min=5, tm_sec=54, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T04:05:58.272 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-22T03:49:13.994718+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=3, tm_min=49, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=4, tm_min=5, tm_sec=54, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T04:05:58.272 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-22T04:06:18.273 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T04:06:18.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:06:18.397+0000 7f990f151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:06:18.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:06:18.405+0000 7f990f151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:06:18.606 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-22T04:06:18.606 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-22T04:06:18.619 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":600,"stamp":"2024-09-22T04:06:17.180286+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":176112,"kb_used_data":2016,"kb_used_omap":0,"kb_used_meta":173952,"kb_avail":377311248,"statfs":{"total":386547056640,"available":386366717952,"internally_reserved":0,"allocated":2064384,"data_stored":2482565,"data_compressed":90168,"data_compressed_allocated":122880,"data_compressed_original":1720320,"omap_allocated":0,"internal_metadata":178126848},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003118"},"pg_stats":[{"pgid":"1.0","version":"11'52","reported_seq":324,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-22T04:05:56.929469+0000","last_change":"2024-09-22T04:05:56.963939+0000","last_active":"2024-09-22T04:05:56.929469+0000","last_peered":"2024-09-22T04:05:56.929469+0000","last_clean":"2024-09-22T04:05:56.929469+0000","last_became_active":"2024-09-22T03:49:12.027470+0000","last_became_peered":"2024-09-22T03:49:12.027470+0000","last_unstale":"2024-09-22T04:05:56.929469+0000","last_undegraded":"2024-09-22T04:05:56.929469+0000","last_fullsized":"2024-09-22T04:05:56.929469+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"11'52","last_scrub_stamp":"2024-09-22T04:05:56.963691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:05:56.963691+0000","last_clean_scrub_stamp":"2024-09-22T03:49:10.979949+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":250,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-22T04:05:57.928083+0000","last_change":"2024-09-22T04:05:57.984419+0000","last_active":"2024-09-22T04:05:57.928083+0000","last_peered":"2024-09-22T04:05:57.928083+0000","last_clean":"2024-09-22T04:05:57.928083+0000","last_became_active":"2024-09-22T03:49:15.125490+0000","last_became_peered":"2024-09-22T03:49:15.125490+0000","last_unstale":"2024-09-22T04:05:57.928083+0000","last_undegraded":"2024-09-22T04:05:57.928083+0000","last_fullsized":"2024-09-22T04:05:57.928083+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"14'1","last_scrub_stamp":"2024-09-22T04:05:57.984220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:05:57.984220+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":249,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-22T04:05:57.926227+0000","last_change":"2024-09-22T04:05:57.941063+0000","last_active":"2024-09-22T04:05:57.926227+0000","last_peered":"2024-09-22T04:05:57.926227+0000","last_clean":"2024-09-22T04:05:57.926227+0000","last_became_active":"2024-09-22T03:49:15.097304+0000","last_became_peered":"2024-09-22T03:49:15.097304+0000","last_unstale":"2024-09-22T04:05:57.926227+0000","last_undegraded":"2024-09-22T04:05:57.926227+0000","last_fullsized":"2024-09-22T04:05:57.926227+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:05:57.940738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:05:57.940738+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":249,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-22T04:05:57.429976+0000","last_change":"2024-09-22T04:05:57.484640+0000","last_active":"2024-09-22T04:05:57.429976+0000","last_peered":"2024-09-22T04:05:57.429976+0000","last_clean":"2024-09-22T04:05:57.429976+0000","last_became_active":"2024-09-22T03:49:15.094890+0000","last_became_peered":"2024-09-22T03:49:15.094890+0000","last_unstale":"2024-09-22T04:05:57.429976+0000","last_undegraded":"2024-09-22T04:05:57.429976+0000","last_fullsized":"2024-09-22T04:05:57.429976+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:05:57.484426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:05:57.484426+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":251,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-22T04:05:57.928076+0000","last_change":"2024-09-22T04:05:57.946523+0000","last_active":"2024-09-22T04:05:57.928076+0000","last_peered":"2024-09-22T04:05:57.928076+0000","last_clean":"2024-09-22T04:05:57.928076+0000","last_became_active":"2024-09-22T03:49:15.098420+0000","last_became_peered":"2024-09-22T03:49:15.098420+0000","last_unstale":"2024-09-22T04:05:57.928076+0000","last_undegraded":"2024-09-22T04:05:57.928076+0000","last_fullsized":"2024-09-22T04:05:57.928076+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"16'2","last_scrub_stamp":"2024-09-22T04:05:57.946307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:05:57.946307+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":249,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-22T04:05:56.932234+0000","last_change":"2024-09-22T04:05:56.955048+0000","last_active":"2024-09-22T04:05:56.932234+0000","last_peered":"2024-09-22T04:05:56.932234+0000","last_clean":"2024-09-22T04:05:56.932234+0000","last_became_active":"2024-09-22T03:49:15.110506+0000","last_became_peered":"2024-09-22T03:49:15.110506+0000","last_unstale":"2024-09-22T04:05:56.932234+0000","last_undegraded":"2024-09-22T04:05:56.932234+0000","last_fullsized":"2024-09-22T04:05:56.932234+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:05:56.954735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:05:56.954735+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":249,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-22T04:05:56.931153+0000","last_change":"2024-09-22T04:05:56.965640+0000","last_active":"2024-09-22T04:05:56.931153+0000","last_peered":"2024-09-22T04:05:56.931153+0000","last_clean":"2024-09-22T04:05:56.931153+0000","last_became_active":"2024-09-22T03:49:15.079260+0000","last_became_peered":"2024-09-22T03:49:15.079260+0000","last_unstale":"2024-09-22T04:05:56.931153+0000","last_undegraded":"2024-09-22T04:05:56.931153+0000","last_fullsized":"2024-09-22T04:05:56.931153+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:05:56.965467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:05:56.965467+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":249,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-22T04:05:56.932212+0000","last_change":"2024-09-22T04:05:56.955056+0000","last_active":"2024-09-22T04:05:56.932212+0000","last_peered":"2024-09-22T04:05:56.932212+0000","last_clean":"2024-09-22T04:05:56.932212+0000","last_became_active":"2024-09-22T03:49:15.108430+0000","last_became_peered":"2024-09-22T03:49:15.108430+0000","last_unstale":"2024-09-22T04:05:56.932212+0000","last_undegraded":"2024-09-22T04:05:56.932212+0000","last_fullsized":"2024-09-22T04:05:56.932212+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:05:56.954723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:05:56.954723+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":249,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-22T04:05:57.928126+0000","last_change":"2024-09-22T04:05:57.977258+0000","last_active":"2024-09-22T04:05:57.928126+0000","last_peered":"2024-09-22T04:05:57.928126+0000","last_clean":"2024-09-22T04:05:57.928126+0000","last_became_active":"2024-09-22T03:49:15.113396+0000","last_became_peered":"2024-09-22T03:49:15.113396+0000","last_unstale":"2024-09-22T04:05:57.928126+0000","last_undegraded":"2024-09-22T04:05:57.928126+0000","last_fullsized":"2024-09-22T04:05:57.928126+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T04:05:57.976966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T04:05:57.976966+0000","last_clean_scrub_stamp":"2024-09-22T03:49:13.994718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949673983,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35352,"kb_used_data":520,"kb_used_omap":0,"kb_used_meta":34816,"kb_avail":94336488,"statfs":{"total":96636764160,"available":96600563712,"internally_reserved":0,"allocated":532480,"data_stored":768238,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":35651584},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654706687,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":57180,"kb_used_data":460,"kb_used_omap":0,"kb_used_meta":56704,"kb_avail":94314660,"statfs":{"total":96636764160,"available":96578211840,"internally_reserved":0,"allocated":471040,"data_stored":177870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58064896},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706686,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":47768,"kb_used_data":520,"kb_used_omap":0,"kb_used_meta":47232,"kb_avail":94324072,"statfs":{"total":96636764160,"available":96587849728,"internally_reserved":0,"allocated":532480,"data_stored":768238,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":48365568},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706686,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35812,"kb_used_data":516,"kb_used_omap":0,"kb_used_meta":35200,"kb_avail":94336028,"statfs":{"total":96636764160,"available":96600092672,"internally_reserved":0,"allocated":528384,"data_stored":768219,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":36044800},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30056,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T04:06:18.620 DEBUG:teuthology.orchestra.run.smithi037:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-22T04:06:18.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:06:18.725+0000 7f25c6951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:06:18.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-22T04:06:18.737+0000 7f25c6951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T04:06:18.958 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-22T04:06:18.958 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-22T04:06:18.958 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-22T04:06:18.958 INFO:teuthology.orchestra.run:waiting for 300 2024-09-22T04:06:23.383 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-09-22T04:06:25.060 INFO:tasks.ceph.osd.0:Stopped 2024-09-22T04:06:25.061 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-22T04:06:25.061 INFO:teuthology.orchestra.run:waiting for 300 2024-09-22T04:06:25.160 INFO:tasks.ceph.osd.1:Stopped 2024-09-22T04:06:25.160 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-22T04:06:25.160 INFO:teuthology.orchestra.run:waiting for 300 2024-09-22T04:06:25.258 INFO:tasks.ceph.osd.2:Stopped 2024-09-22T04:06:25.258 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-22T04:06:25.258 INFO:teuthology.orchestra.run:waiting for 300 2024-09-22T04:06:25.355 INFO:tasks.ceph.osd.3:Stopped 2024-09-22T04:06:25.355 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-22T04:06:25.355 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-22T04:06:25.355 INFO:teuthology.orchestra.run:waiting for 300 2024-09-22T04:06:25.383 INFO:tasks.ceph.mgr.x:Stopped 2024-09-22T04:06:25.383 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-22T04:06:25.383 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-22T04:06:25.383 INFO:teuthology.orchestra.run:waiting for 300 2024-09-22T04:06:25.398 INFO:tasks.ceph.mon.a:Stopped 2024-09-22T04:06:25.398 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-22T04:06:25.398 DEBUG:teuthology.orchestra.run.smithi037:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'but it is still running' | egrep -v 'objects unfound and apparently lost' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v SLOW_OPS | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'mons down' | egrep -v 'mon down' | egrep -v 'out of quorum' | egrep -v noscrub | egrep -v nodeep-scrub | head -n 1 2024-09-22T04:06:25.478 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi037.front.sepia.ceph.com 2024-09-22T04:06:25.478 DEBUG:teuthology.orchestra.run.smithi037:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-22T04:06:25.699 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi037.front.sepia.ceph.com 2024-09-22T04:06:25.700 DEBUG:teuthology.orchestra.run.smithi037:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-22T04:06:25.805 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi098.front.sepia.ceph.com 2024-09-22T04:06:25.805 DEBUG:teuthology.orchestra.run.smithi098:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-22T04:06:26.022 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi098.front.sepia.ceph.com 2024-09-22T04:06:26.023 DEBUG:teuthology.orchestra.run.smithi098:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-22T04:06:26.133 INFO:tasks.ceph:Archiving mon data... 2024-09-22T04:06:26.134 DEBUG:teuthology.misc:Transferring archived files from smithi037:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-09-21_20:56:02-crimson-rados-main-distro-crimson-smithi/7914381/data/mon.a.tgz 2024-09-22T04:06:26.134 DEBUG:teuthology.orchestra.run.smithi037:> mktemp 2024-09-22T04:06:26.154 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/tmp.XDEy7U5i2F 2024-09-22T04:06:26.154 DEBUG:teuthology.orchestra.run.smithi037:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.XDEy7U5i2F 2024-09-22T04:06:26.272 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 0666 /tmp/tmp.XDEy7U5i2F 2024-09-22T04:06:26.359 DEBUG:teuthology.orchestra.remote:smithi037:/tmp/tmp.XDEy7U5i2F is 248KB 2024-09-22T04:06:26.453 DEBUG:teuthology.orchestra.run.smithi037:> rm -fr /tmp/tmp.XDEy7U5i2F 2024-09-22T04:06:26.468 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-22T04:06:26.468 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-22T04:06:26.510 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-22T04:06:26.590 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-22T04:06:26.604 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-22T04:06:26.605 INFO:tasks.ceph:Archiving crash dumps... 2024-09-22T04:06:26.606 DEBUG:teuthology.misc:Transferring archived files from smithi037:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-21_20:56:02-crimson-rados-main-distro-crimson-smithi/7914381/remote/smithi037/crash 2024-09-22T04:06:26.607 DEBUG:teuthology.orchestra.run.smithi037:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-22T04:06:26.655 DEBUG:teuthology.misc:Transferring archived files from smithi098:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-21_20:56:02-crimson-rados-main-distro-crimson-smithi/7914381/remote/smithi098/crash 2024-09-22T04:06:26.656 DEBUG:teuthology.orchestra.run.smithi098:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-22T04:06:26.691 INFO:tasks.ceph:Compressing logs... 2024-09-22T04:06:26.692 DEBUG:teuthology.orchestra.run.smithi037:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-22T04:06:26.699 DEBUG:teuthology.orchestra.run.smithi098:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-22T04:06:26.722 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-22T04:06:26.722 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38267.log 2024-09-22T04:06:26.722 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46168.log 2024-09-22T04:06:26.765 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28231.log 2024-09-22T04:06:26.765 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28141.log 2024-09-22T04:06:26.765 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28271.log 2024-09-22T04:06:26.765 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.28231.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.28231.log.gz 2024-09-22T04:06:26.765 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.28141.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-22T04:06:26.765 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-22T04:06:26.765 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28191.log 2024-09-22T04:06:26.765 INFO:teuthology.orchestra.run.smithi098.stderr: 50.0%/var/log/ceph/ceph-client.admin.28271.log: -- replaced with /var/log/ceph/ceph-client.admin.28141.log.gz 2024-09-22T04:06:26.765 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-22T04:06:26.766 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-osd.2.log: /var/log/ceph/ceph-mgr.x.log: 49.6%/var/log/ceph/ceph-client.admin.28191.log: -- replaced with /var/log/ceph/ceph-client.admin.28271.log.gz 2024-09-22T04:06:26.766 INFO:teuthology.orchestra.run.smithi098.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.28191.log.gz 2024-09-22T04:06:26.902 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-osd.3.log: 92.1% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-22T04:06:27.030 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-osd.0.log: /var/log/ceph/ceph-client.admin.38267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55762.log 2024-09-22T04:06:27.030 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.38267.log.gz 2024-09-22T04:06:27.030 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.46168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46207.log 2024-09-22T04:06:27.031 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46168.log.gz 2024-09-22T04:06:27.031 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.55762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45357.log 2024-09-22T04:06:27.031 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.55762.log.gz 2024-09-22T04:06:27.031 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.46207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32441.log 2024-09-22T04:06:27.031 INFO:teuthology.orchestra.run.smithi037.stderr: 47.6% -- replaced with /var/log/ceph/ceph-client.admin.46207.log.gz 2024-09-22T04:06:27.031 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.45357.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55144.log 2024-09-22T04:06:27.031 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45357.log.gz 2024-09-22T04:06:27.031 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.32441.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39498.log 2024-09-22T04:06:27.031 INFO:teuthology.orchestra.run.smithi037.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.32441.log.gz 2024-09-22T04:06:27.031 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.55144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47523.log 2024-09-22T04:06:27.032 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.55144.log.gz 2024-09-22T04:06:27.032 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.39498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63160.log 2024-09-22T04:06:27.032 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.39498.log.gz 2024-09-22T04:06:27.032 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.47523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67833.log 2024-09-22T04:06:27.032 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.47523.log.gz 2024-09-22T04:06:27.032 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.63160.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58142.log 2024-09-22T04:06:27.032 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.63160.log.gz 2024-09-22T04:06:27.032 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.67833.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54964.log 2024-09-22T04:06:27.032 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.67833.log.gz 2024-09-22T04:06:27.032 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.58142.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29394.log 2024-09-22T04:06:27.032 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.58142.log.gz 2024-09-22T04:06:27.032 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.54964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42457.log 2024-09-22T04:06:27.032 INFO:teuthology.orchestra.run.smithi037.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.54964.log.gz 2024-09-22T04:06:27.032 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.29394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61890.log 2024-09-22T04:06:27.032 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29394.log.gz 2024-09-22T04:06:27.032 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.42457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49286.log 2024-09-22T04:06:27.033 INFO:teuthology.orchestra.run.smithi037.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.42457.log.gz 2024-09-22T04:06:27.033 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.61890.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44071.log 2024-09-22T04:06:27.033 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.61890.log.gz 2024-09-22T04:06:27.033 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.49286.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56754.log 2024-09-22T04:06:27.033 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.49286.log.gz 2024-09-22T04:06:27.033 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.44071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44776.log 2024-09-22T04:06:27.033 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44071.log.gz 2024-09-22T04:06:27.033 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5/var/log/ceph/ceph-client.admin.56754.log: --verbose -- /var/log/ceph/ceph-client.admin.56533.log 2024-09-22T04:06:27.033 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.56754.log.gz 2024-09-22T04:06:27.033 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.44776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64661.log 2024-09-22T04:06:27.033 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44776.log.gz 2024-09-22T04:06:27.033 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.56533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55902.log 2024-09-22T04:06:27.033 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.56533.log.gz 2024-09-22T04:06:27.033 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.64661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61492.log 2024-09-22T04:06:27.033 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.64661.log.gz 2024-09-22T04:06:27.034 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.55902.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33239.log 2024-09-22T04:06:27.034 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.55902.log.gz 2024-09-22T04:06:27.034 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.61492.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59242.log 2024-09-22T04:06:27.034 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.61492.log.gz 2024-09-22T04:06:27.034 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.33239.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42995.log 2024-09-22T04:06:27.034 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.33239.log.gz 2024-09-22T04:06:27.034 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.59242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56391.log 2024-09-22T04:06:27.034 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.59242.log.gz 2024-09-22T04:06:27.034 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.42995.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39240.log 2024-09-22T04:06:27.034 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42995.log.gz 2024-09-22T04:06:27.034 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.56391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45686.log 2024-09-22T04:06:27.034 INFO:teuthology.orchestra.run.smithi037.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.56391.log.gz 2024-09-22T04:06:27.034 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55454.log 2024-09-22T04:06:27.034 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.39240.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39240.log.gz 2024-09-22T04:06:27.034 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.45686.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33538.log 2024-09-22T04:06:27.035 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45686.log.gz 2024-09-22T04:06:27.035 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.55454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61541.log 2024-09-22T04:06:27.035 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.55454.log.gz 2024-09-22T04:06:27.035 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.33538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34979.log 2024-09-22T04:06:27.035 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.33538.log.gz 2024-09-22T04:06:27.035 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.61541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31206.log 2024-09-22T04:06:27.035 INFO:teuthology.orchestra.run.smithi037.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.61541.log.gz 2024-09-22T04:06:27.035 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.34979.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50590.log 2024-09-22T04:06:27.035 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.34979.log.gz 2024-09-22T04:06:27.035 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.31206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57712.log 2024-09-22T04:06:27.035 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.31206.log.gz 2024-09-22T04:06:27.035 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.50590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70881.log 2024-09-22T04:06:27.035 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.50590.log.gz 2024-09-22T04:06:27.035 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.57712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34813.log 2024-09-22T04:06:27.035 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.57712.log.gz 2024-09-22T04:06:27.036 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.70881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63258.log 2024-09-22T04:06:27.036 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.70881.log.gz 2024-09-22T04:06:27.036 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.34813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56889.log 2024-09-22T04:06:27.036 INFO:teuthology.orchestra.run.smithi037.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.34813.log.gz 2024-09-22T04:06:27.036 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.63258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70561.log 2024-09-22T04:06:27.036 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.63258.log.gz 2024-09-22T04:06:27.036 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.56889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70395.log 2024-09-22T04:06:27.036 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.56889.log.gz 2024-09-22T04:06:27.036 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.70561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31915.log 2024-09-22T04:06:27.036 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.70561.log.gz 2024-09-22T04:06:27.036 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.70395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65324.log 2024-09-22T04:06:27.036 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.70395.log.gz 2024-09-22T04:06:27.036 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55503.log 2024-09-22T04:06:27.036 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.31915.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.31915.log.gz 2024-09-22T04:06:27.036 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.65324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70562.log 2024-09-22T04:06:27.037 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.65324.log.gz 2024-09-22T04:06:27.037 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.55503.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37095.log 2024-09-22T04:06:27.037 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.55503.log.gz 2024-09-22T04:06:27.037 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.70562.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31016.log 2024-09-22T04:06:27.037 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.70562.log.gz 2024-09-22T04:06:27.037 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.37095.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67615.log 2024-09-22T04:06:27.037 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.37095.log.gz 2024-09-22T04:06:27.037 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.31016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33924.log 2024-09-22T04:06:27.037 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.31016.log.gz 2024-09-22T04:06:27.037 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.67615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51856.log 2024-09-22T04:06:27.037 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.67615.log.gz 2024-09-22T04:06:27.038 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.33924.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69640.log 2024-09-22T04:06:27.038 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.33924.log.gz 2024-09-22T04:06:27.038 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.51856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68765.log 2024-09-22T04:06:27.038 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.51856.log.gz 2024-09-22T04:06:27.038 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.69640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68805.log 2024-09-22T04:06:27.038 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.69640.log.gz 2024-09-22T04:06:27.038 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.68765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42597.log 2024-09-22T04:06:27.038 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.68765.log.gz 2024-09-22T04:06:27.038 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.68805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45855.log 2024-09-22T04:06:27.038 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.68805.log.gz 2024-09-22T04:06:27.038 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.42597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51328.log 2024-09-22T04:06:27.038 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42597.log.gz 2024-09-22T04:06:27.038 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.45855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40066.log 2024-09-22T04:06:27.039 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45855.log.gz 2024-09-22T04:06:27.039 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.51328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67977.log 2024-09-22T04:06:27.039 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.51328.log.gz 2024-09-22T04:06:27.039 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.40066.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41981.log 2024-09-22T04:06:27.039 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40066.log.gz 2024-09-22T04:06:27.039 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.67977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48233.log 2024-09-22T04:06:27.039 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.67977.log.gz 2024-09-22T04:06:27.039 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.41981.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54094.log 2024-09-22T04:06:27.039 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41981.log.gz 2024-09-22T04:06:27.039 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.48233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38218.log 2024-09-22T04:06:27.039 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.48233.log.gz 2024-09-22T04:06:27.039 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.54094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65275.log 2024-09-22T04:06:27.039 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.54094.log.gz 2024-09-22T04:06:27.039 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.38218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50677.log 2024-09-22T04:06:27.040 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.38218.log.gz 2024-09-22T04:06:27.040 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.65275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53756.log 2024-09-22T04:06:27.040 INFO:teuthology.orchestra.run.smithi037.stderr: 48.0% -- replaced with /var/log/ceph/ceph-client.admin.65275.log.gz 2024-09-22T04:06:27.040 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.50677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65980.log 2024-09-22T04:06:27.040 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.50677.log.gz 2024-09-22T04:06:27.040 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.53756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70563.log 2024-09-22T04:06:27.040 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.53756.log.gz 2024-09-22T04:06:27.040 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.65980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69382.log 2024-09-22T04:06:27.040 INFO:teuthology.orchestra.run.smithi037.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.65980.log.gz 2024-09-22T04:06:27.040 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.70563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58460.log 2024-09-22T04:06:27.040 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.70563.log.gz 2024-09-22T04:06:27.040 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.69382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66825.log 2024-09-22T04:06:27.040 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.69382.log.gz 2024-09-22T04:06:27.040 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.58460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35119.log 2024-09-22T04:06:27.041 INFO:teuthology.orchestra.run.smithi037.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.58460.log.gz 2024-09-22T04:06:27.041 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.66825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41673.log 2024-09-22T04:06:27.041 INFO:teuthology.orchestra.run.smithi037.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.66825.log.gz 2024-09-22T04:06:27.041 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.35119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60735.log 2024-09-22T04:06:27.041 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.35119.log.gz 2024-09-22T04:06:27.041 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.41673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59540.log 2024-09-22T04:06:27.041 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41673.log.gz 2024-09-22T04:06:27.041 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.60735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63836.log 2024-09-22T04:06:27.041 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.60735.log.gz 2024-09-22T04:06:27.041 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.59540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50460.log 2024-09-22T04:06:27.041 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.59540.log.gz 2024-09-22T04:06:27.041 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.63836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44160.log 2024-09-22T04:06:27.041 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.63836.log.gz 2024-09-22T04:06:27.041 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53312.log 2024-09-22T04:06:27.042 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.50460.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.50460.log.gz 2024-09-22T04:06:27.042 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.44160.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33115.log 2024-09-22T04:06:27.042 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44160.log.gz 2024-09-22T04:06:27.042 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.53312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28535.log 2024-09-22T04:06:27.042 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.53312.log.gz 2024-09-22T04:06:27.042 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52655.log 2024-09-22T04:06:27.042 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.33115.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.33115.log.gz 2024-09-22T04:06:27.042 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.28535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70560.log 2024-09-22T04:06:27.042 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.28535.log.gz 2024-09-22T04:06:27.042 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.52655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68550.log 2024-09-22T04:06:27.043 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.52655.log.gz 2024-09-22T04:06:27.043 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.70560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33764.log 2024-09-22T04:06:27.043 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.70560.log.gz 2024-09-22T04:06:27.043 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.68550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39811.log 2024-09-22T04:06:27.043 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.68550.log.gz 2024-09-22T04:06:27.043 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.33764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60646.log 2024-09-22T04:06:27.043 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.33764.log.gz 2024-09-22T04:06:27.043 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.39811.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62335.log 2024-09-22T04:06:27.043 INFO:teuthology.orchestra.run.smithi037.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.39811.log.gz 2024-09-22T04:06:27.043 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.60646.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30253.log 2024-09-22T04:06:27.043 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.60646.log.gz 2024-09-22T04:06:27.043 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.62335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55262.log 2024-09-22T04:06:27.043 INFO:teuthology.orchestra.run.smithi037.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.62335.log.gz 2024-09-22T04:06:27.044 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.30253.log: /var/log/ceph/ceph-client.admin.62891.log 2024-09-22T04:06:27.044 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.30253.log.gz 2024-09-22T04:06:27.044 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.55262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62713.log 2024-09-22T04:06:27.044 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.55262.log.gz 2024-09-22T04:06:27.044 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.62891.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67341.log 2024-09-22T04:06:27.044 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.62891.log.gz 2024-09-22T04:06:27.044 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.62713.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34022.log 2024-09-22T04:06:27.044 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.62713.log.gz 2024-09-22T04:06:27.044 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.67341.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34371.log 2024-09-22T04:06:27.044 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.67341.log.gz 2024-09-22T04:06:27.044 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.34022.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52753.log 2024-09-22T04:06:27.044 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.34022.log.gz 2024-09-22T04:06:27.044 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.34371.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42239.log 2024-09-22T04:06:27.044 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.34371.log.gz 2024-09-22T04:06:27.045 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.52753.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62851.log 2024-09-22T04:06:27.045 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.52753.log.gz 2024-09-22T04:06:27.045 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.42239.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48790.log 2024-09-22T04:06:27.045 INFO:teuthology.orchestra.run.smithi037.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.42239.log.gz 2024-09-22T04:06:27.045 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.62851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29504.log 2024-09-22T04:06:27.045 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.62851.log.gz 2024-09-22T04:06:27.045 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.48790.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54706.log 2024-09-22T04:06:27.045 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.48790.log.gz 2024-09-22T04:06:27.045 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.29504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54664.log 2024-09-22T04:06:27.045 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29504.log.gz 2024-09-22T04:06:27.045 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41157.log 2024-09-22T04:06:27.045 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.54706.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.54706.log.gz 2024-09-22T04:06:27.045 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.54664.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41760.log 2024-09-22T04:06:27.046 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.54664.log.gz 2024-09-22T04:06:27.046 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.41157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69044.log 2024-09-22T04:06:27.046 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41157.log.gz 2024-09-22T04:06:27.046 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.41760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69511.log 2024-09-22T04:06:27.046 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41760.log.gz 2024-09-22T04:06:27.046 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.69044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52522.log 2024-09-22T04:06:27.046 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.69044.log.gz 2024-09-22T04:06:27.046 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.69511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33626.log 2024-09-22T04:06:27.046 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.69511.log.gz 2024-09-22T04:06:27.046 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.52522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32534.log 2024-09-22T04:06:27.046 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.52522.log.gz 2024-09-22T04:06:27.046 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.33626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52873.log 2024-09-22T04:06:27.046 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.33626.log.gz 2024-09-22T04:06:27.047 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.32534.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-22T04:06:27.047 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.32534.log.gz 2024-09-22T04:06:27.047 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.52873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62504.log 2024-09-22T04:06:27.047 INFO:teuthology.orchestra.run.smithi037.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.52873.log.gz 2024-09-22T04:06:27.047 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47706.log 2024-09-22T04:06:27.047 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.62504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52037.log 2024-09-22T04:06:27.047 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.62504.log.gz 2024-09-22T04:06:27.047 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.47706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38449.log 2024-09-22T04:06:27.047 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47706.log.gz 2024-09-22T04:06:27.047 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.52037.log: /var/log/ceph/ceph-client.admin.64843.log 2024-09-22T04:06:27.047 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.52037.log.gz 2024-09-22T04:06:27.047 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.38449.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.38449.log.gz 2024-09-22T04:06:27.047 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41068.log 2024-09-22T04:06:27.048 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.64843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63607.log 2024-09-22T04:06:27.048 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.64843.log.gz 2024-09-22T04:06:27.048 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.41068.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41068.log.gz 2024-09-22T04:06:27.048 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61750.log 2024-09-22T04:06:27.048 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32221.log 2024-09-22T04:06:27.048 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.63607.log: 50.4%/var/log/ceph/ceph-client.admin.61750.log: -- replaced with /var/log/ceph/ceph-client.admin.63607.log.gz 2024-09-22T04:06:27.048 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29168.log 2024-09-22T04:06:27.048 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.61750.log.gz 2024-09-22T04:06:27.048 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.32221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54134.log 2024-09-22T04:06:27.048 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.32221.log.gz 2024-09-22T04:06:27.048 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.29168.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.29168.log.gz 2024-09-22T04:06:27.048 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33408.log 2024-09-22T04:06:27.048 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.54134.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31654.log 2024-09-22T04:06:27.048 INFO:teuthology.orchestra.run.smithi037.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.54134.log.gz 2024-09-22T04:06:27.049 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.33408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61981.log 2024-09-22T04:06:27.049 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.33408.log.gz 2024-09-22T04:06:27.049 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50543.log 2024-09-22T04:06:27.049 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.31654.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.31654.log.gz 2024-09-22T04:06:27.049 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.61981.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.61981.log.gz 2024-09-22T04:06:27.049 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63516.log 2024-09-22T04:06:27.049 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35168.log 2024-09-22T04:06:27.049 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.50543.log: /var/log/ceph/ceph-client.admin.63516.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.50543.log.gz 2024-09-22T04:06:27.049 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47875.log 2024-09-22T04:06:27.049 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.63516.log.gz 2024-09-22T04:06:27.049 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.35168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50082.log 2024-09-22T04:06:27.049 INFO:teuthology.orchestra.run.smithi037.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.35168.log.gz 2024-09-22T04:06:27.049 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.47875.log: gzip -5 50.0% --verbose -- replaced with /var/log/ceph/ceph-client.admin.47875.log.gz 2024-09-22T04:06:27.049 INFO:teuthology.orchestra.run.smithi037.stderr: -- /var/log/ceph/ceph-client.admin.41415.log 2024-09-22T04:06:27.050 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.50082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30252.log 2024-09-22T04:06:27.050 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.50082.log.gz 2024-09-22T04:06:27.050 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.41415.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49375.log 2024-09-22T04:06:27.050 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41415.log.gz 2024-09-22T04:06:27.050 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.30252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47265.log 2024-09-22T04:06:27.050 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.30252.log.gz 2024-09-22T04:06:27.050 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.49375.log: gzip 50.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.49375.log.gz --verbose 2024-09-22T04:06:27.050 INFO:teuthology.orchestra.run.smithi037.stderr: -- /var/log/ceph/ceph-client.admin.29210.log 2024-09-22T04:06:27.050 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35525.log 2024-09-22T04:06:27.050 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.47265.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47265.log.gz 2024-09-22T04:06:27.050 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.29210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62079.log 2024-09-22T04:06:27.050 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29210.log.gz 2024-09-22T04:06:27.050 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62762.log 2024-09-22T04:06:27.051 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.35525.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.35525.log.gz 2024-09-22T04:06:27.051 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.62079.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56440.log 2024-09-22T04:06:27.051 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.62079.log.gz 2024-09-22T04:06:27.051 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.62762.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.62762.log.gz 2024-09-22T04:06:27.051 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45084.log 2024-09-22T04:06:27.051 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59623.log 2024-09-22T04:06:27.051 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.56440.log: /var/log/ceph/ceph-client.admin.45084.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.56440.log.gz 2024-09-22T04:06:27.051 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69780.log 2024-09-22T04:06:27.051 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45084.log.gz 2024-09-22T04:06:27.051 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.59623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69591.log 2024-09-22T04:06:27.051 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.59623.log.gz 2024-09-22T04:06:27.051 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.69780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30349.log 2024-09-22T04:06:27.051 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.69780.log.gz 2024-09-22T04:06:27.051 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.69591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60905.log 2024-09-22T04:06:27.052 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.69591.log.gz 2024-09-22T04:06:27.052 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.30349.log: gzip -5 49.6% --verbose -- replaced with /var/log/ceph/ceph-client.admin.30349.log.gz -- 2024-09-22T04:06:27.052 INFO:teuthology.orchestra.run.smithi037.stderr: /var/log/ceph/ceph-client.admin.40711.log 2024-09-22T04:06:27.052 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.60905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54532.log 2024-09-22T04:06:27.052 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.60905.log.gz 2024-09-22T04:06:27.052 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.40711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42150.log 2024-09-22T04:06:27.052 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40711.log.gz 2024-09-22T04:06:27.052 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.54532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69149.log 2024-09-22T04:06:27.052 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.54532.log.gz 2024-09-22T04:06:27.052 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.42150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28799.log 2024-09-22T04:06:27.053 INFO:teuthology.orchestra.run.smithi037.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.42150.log.gz 2024-09-22T04:06:27.053 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.69149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33586.log 2024-09-22T04:06:27.053 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.69149.log.gz 2024-09-22T04:06:27.053 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.28799.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47127.log 2024-09-22T04:06:27.053 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.28799.log.gz 2024-09-22T04:06:27.053 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61039.log 2024-09-22T04:06:27.053 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.33586.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.33586.log.gz 2024-09-22T04:06:27.053 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.47127.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47127.log.gz 2024-09-22T04:06:27.053 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59362.log 2024-09-22T04:06:27.053 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61661.log 2024-09-22T04:06:27.053 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.61039.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.61039.log.gz 2024-09-22T04:06:27.053 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.59362.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53429.log 2024-09-22T04:06:27.053 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.59362.log.gz 2024-09-22T04:06:27.053 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.61661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32751.log 2024-09-22T04:06:27.053 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.61661.log.gz 2024-09-22T04:06:27.054 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.53429.log: gzip 47.6% -5 -- replaced with /var/log/ceph/ceph-client.admin.53429.log.gz 2024-09-22T04:06:27.054 INFO:teuthology.orchestra.run.smithi037.stderr: --verbose -- /var/log/ceph/ceph-client.admin.70393.log 2024-09-22T04:06:27.054 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.32751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33844.log 2024-09-22T04:06:27.054 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.32751.log.gz 2024-09-22T04:06:27.054 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.70393.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66954.log 2024-09-22T04:06:27.054 INFO:teuthology.orchestra.run.smithi037.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.70393.log.gz 2024-09-22T04:06:27.054 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.33844.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54619.log 2024-09-22T04:06:27.054 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.33844.log.gz 2024-09-22T04:06:27.054 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.66954.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58013.log 50.0% 2024-09-22T04:06:27.054 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.66954.log.gz 2024-09-22T04:06:27.054 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.54619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57924.log 2024-09-22T04:06:27.054 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.54619.log.gz 2024-09-22T04:06:27.054 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.58013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65663.log 2024-09-22T04:06:27.054 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.58013.log.gz 2024-09-22T04:06:27.055 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.57924.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53716.log 2024-09-22T04:06:27.055 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.57924.log.gz 2024-09-22T04:06:27.055 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.65663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43404.log 2024-09-22T04:06:27.055 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.65663.log.gz 2024-09-22T04:06:27.055 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.53716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34280.log 2024-09-22T04:06:27.055 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.53716.log.gz 2024-09-22T04:06:27.055 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66378.log 2024-09-22T04:06:27.055 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43404.log.gz 2024-09-22T04:06:27.055 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57196.log 2024-09-22T04:06:27.055 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.34280.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.34280.log.gz 2024-09-22T04:06:27.055 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.66378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44423.log 2024-09-22T04:06:27.056 INFO:teuthology.orchestra.run.smithi037.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.66378.log.gz 2024-09-22T04:06:27.056 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.57196.log: gzip -5 50.0% --verbose -- replaced with /var/log/ceph/ceph-client.admin.57196.log.gz -- 2024-09-22T04:06:27.056 INFO:teuthology.orchestra.run.smithi037.stderr: /var/log/ceph/ceph-client.admin.30527.log 2024-09-22T04:06:27.056 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.44423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29294.log 2024-09-22T04:06:27.056 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44423.log.gz 2024-09-22T04:06:27.056 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.30527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59988.log 2024-09-22T04:06:27.056 INFO:teuthology.orchestra.run.smithi037.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.30527.log.gz 2024-09-22T04:06:27.056 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39769.log 2024-09-22T04:06:27.056 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.29294.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29294.log.gz 2024-09-22T04:06:27.056 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.59988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47305.log 2024-09-22T04:06:27.056 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.59988.log.gz 2024-09-22T04:06:27.056 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.39769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53578.log 2024-09-22T04:06:27.056 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.39769.log.gz 2024-09-22T04:06:27.056 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.47305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70965.log 2024-09-22T04:06:27.056 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.47305.log.gz 2024-09-22T04:06:27.057 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.53578.log: gzip 49.6% -5 -- replaced with /var/log/ceph/ceph-client.admin.53578.log.gz --verbose 2024-09-22T04:06:27.057 INFO:teuthology.orchestra.run.smithi037.stderr: -- /var/log/ceph/ceph-client.admin.36695.log 2024-09-22T04:06:27.057 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.70965.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65186.log 2024-09-22T04:06:27.057 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.70965.log.gz 2024-09-22T04:06:27.057 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.36695.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54575.log 2024-09-22T04:06:27.057 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.36695.log.gz 2024-09-22T04:06:27.057 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.65186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47565.log 2024-09-22T04:06:27.057 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.65186.log.gz 2024-09-22T04:06:27.057 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.54575.log: gzip -5 --verbose -- 50.0% /var/log/ceph/ceph-client.admin.54786.log -- replaced with /var/log/ceph/ceph-client.admin.54575.log.gz 2024-09-22T04:06:27.057 INFO:teuthology.orchestra.run.smithi037.stderr: 2024-09-22T04:06:27.057 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.47565.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61352.log 2024-09-22T04:06:27.057 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.47565.log.gz 2024-09-22T04:06:27.057 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.54786.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58767.log 2024-09-22T04:06:27.057 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.54786.log.gz 2024-09-22T04:06:27.057 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.61352.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53102.log 2024-09-22T04:06:27.057 INFO:teuthology.orchestra.run.smithi037.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.61352.log.gz 2024-09-22T04:06:27.058 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.58767.log: gzip -5 50.0% --verbose -- replaced with /var/log/ceph/ceph-client.admin.58767.log.gz -- 2024-09-22T04:06:27.058 INFO:teuthology.orchestra.run.smithi037.stderr: /var/log/ceph/ceph-client.admin.34859.log 2024-09-22T04:06:27.058 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.53102.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31957.log 2024-09-22T04:06:27.058 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.53102.log.gz 2024-09-22T04:06:27.058 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.34859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57454.log 2024-09-22T04:06:27.058 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.34859.log.gz 2024-09-22T04:06:27.058 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.31957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55672.log 2024-09-22T04:06:27.058 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.31957.log.gz 2024-09-22T04:06:27.058 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.57454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64541.log 2024-09-22T04:06:27.058 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.57454.log.gz 2024-09-22T04:06:27.058 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.55672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67481.log 2024-09-22T04:06:27.058 INFO:teuthology.orchestra.run.smithi037.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.55672.log.gz 2024-09-22T04:06:27.058 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.64541.log: 50.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.64541.log.gz 2024-09-22T04:06:27.059 INFO:teuthology.orchestra.run.smithi037.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.52704.log 2024-09-22T04:06:27.059 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.67481.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49192.log 2024-09-22T04:06:27.059 INFO:teuthology.orchestra.run.smithi037.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.67481.log.gz 2024-09-22T04:06:27.059 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.52704.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.52704.log.gz 2024-09-22T04:06:27.059 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52793.log 2024-09-22T04:06:27.059 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.49192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29924.log 2024-09-22T04:06:27.059 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.49192.log.gz 2024-09-22T04:06:27.059 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.52793.log: gzip -5 --verbose 49.6% -- -- replaced with /var/log/ceph/ceph-client.admin.52793.log.gz 2024-09-22T04:06:27.059 INFO:teuthology.orchestra.run.smithi037.stderr: /var/log/ceph/ceph-client.admin.63747.log 2024-09-22T04:06:27.059 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.29924.log: /var/log/ceph/ceph-client.admin.38672.log 2024-09-22T04:06:27.059 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29924.log.gz 2024-09-22T04:06:27.059 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.63747.log: gzip -5 --verbose -- 50.0% /var/log/ceph/ceph-client.admin.42946.log 2024-09-22T04:06:27.059 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.63747.log.gz 2024-09-22T04:06:27.059 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.38672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42101.log 2024-09-22T04:06:27.059 INFO:teuthology.orchestra.run.smithi037.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.38672.log.gz 2024-09-22T04:06:27.060 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.42946.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42946.log.gz 2024-09-22T04:06:27.060 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66994.log 2024-09-22T04:06:27.060 INFO:teuthology.orchestra.run.smithi037.stderr:gzip/var/log/ceph/ceph-client.admin.42101.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.70730.log 2024-09-22T04:06:27.060 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42101.log.gz 2024-09-22T04:06:27.060 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.66994.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.66994.log.gz 2024-09-22T04:06:27.060 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45104.log 2024-09-22T04:06:27.060 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.70730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34686.log 2024-09-22T04:06:27.060 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.70730.log.gz 2024-09-22T04:06:27.060 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.45104.log: gzip -5 --verbose -- 50.0% /var/log/ceph/ceph-client.admin.37473.log -- replaced with /var/log/ceph/ceph-client.admin.45104.log.gz 2024-09-22T04:06:27.060 INFO:teuthology.orchestra.run.smithi037.stderr: 2024-09-22T04:06:27.060 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.34686.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35647.log 2024-09-22T04:06:27.060 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.34686.log.gz 2024-09-22T04:06:27.060 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.37473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31834.log 50.0% 2024-09-22T04:06:27.060 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.37473.log.gz 2024-09-22T04:06:27.060 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.35647.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43802.log 2024-09-22T04:06:27.060 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.35647.log.gz 2024-09-22T04:06:27.061 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.31834.log: gzip -5 --verbose -- 50.0% /var/log/ceph/ceph-client.admin.48411.log 2024-09-22T04:06:27.061 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.31834.log.gz 2024-09-22T04:06:27.061 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48371.log 2024-09-22T04:06:27.061 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43802.log.gz 2024-09-22T04:06:27.061 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.48411.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47615.log 2024-09-22T04:06:27.061 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.48411.log.gz 2024-09-22T04:06:27.061 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.48371.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46430.log 2024-09-22T04:06:27.061 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.48371.log.gz 2024-09-22T04:06:27.061 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.47615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62294.log 2024-09-22T04:06:27.061 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.47615.log.gz 2024-09-22T04:06:27.061 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42617.log 2024-09-22T04:06:27.061 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.46430.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.46430.log.gz 2024-09-22T04:06:27.061 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.62294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46732.log 2024-09-22T04:06:27.061 INFO:teuthology.orchestra.run.smithi037.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.62294.log.gz 2024-09-22T04:06:27.061 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.42617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59104.log 2024-09-22T04:06:27.062 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42617.log.gz 2024-09-22T04:06:27.062 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33804.log 2024-09-22T04:06:27.062 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.46732.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46732.log.gz 2024-09-22T04:06:27.062 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.59104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30747.log 2024-09-22T04:06:27.062 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.59104.log.gz 2024-09-22T04:06:27.062 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.33804.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61621.log 2024-09-22T04:06:27.062 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.33804.log.gz 2024-09-22T04:06:27.062 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.30747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64005.log 2024-09-22T04:06:27.062 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.30747.log.gz 2024-09-22T04:06:27.062 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.61621.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.61621.log.gz 2024-09-22T04:06:27.062 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44469.log 2024-09-22T04:06:27.062 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.64005.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31696.log 2024-09-22T04:06:27.062 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.64005.log.gz 2024-09-22T04:06:27.063 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.44469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54332.log 2024-09-22T04:06:27.063 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44469.log.gz 2024-09-22T04:06:27.063 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.31696.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49684.log 2024-09-22T04:06:27.063 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.31696.log.gz 2024-09-22T04:06:27.063 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.54332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53538.log 2024-09-22T04:06:27.063 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.54332.log.gz 2024-09-22T04:06:27.063 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.49684.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29395.log 2024-09-22T04:06:27.063 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.49684.log.gz 2024-09-22T04:06:27.063 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.53538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44378.log 2024-09-22T04:06:27.063 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.53538.log.gz 2024-09-22T04:06:27.063 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.29395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45406.log 2024-09-22T04:06:27.063 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29395.log.gz 2024-09-22T04:06:27.063 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.44378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56978.log 2024-09-22T04:06:27.064 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44378.log.gz 2024-09-22T04:06:27.064 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.45406.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57495.log 2024-09-22T04:06:27.064 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45406.log.gz 2024-09-22T04:06:27.064 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.56978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71007.log 2024-09-22T04:06:27.064 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.56978.log.gz 2024-09-22T04:06:27.064 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.57495.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68984.log 2024-09-22T04:06:27.064 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.57495.log.gz 2024-09-22T04:06:27.064 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.71007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52346.log 2024-09-22T04:06:27.064 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.71007.log.gz 2024-09-22T04:06:27.064 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.68984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33973.log 2024-09-22T04:06:27.064 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.68984.log.gz 2024-09-22T04:06:27.064 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.52346.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66874.log 2024-09-22T04:06:27.064 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.52346.log.gz 2024-09-22T04:06:27.064 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.33973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69551.log 2024-09-22T04:06:27.064 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.33973.log.gz 2024-09-22T04:06:27.064 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.66874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60157.log 2024-09-22T04:06:27.065 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.66874.log.gz 2024-09-22T04:06:27.065 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.69551.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36390.log 2024-09-22T04:06:27.065 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.69551.log.gz 2024-09-22T04:06:27.065 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.60157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66736.log 2024-09-22T04:06:27.065 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.60157.log.gz 2024-09-22T04:06:27.065 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.36390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67034.log 2024-09-22T04:06:27.065 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.36390.log.gz 2024-09-22T04:06:27.065 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.66736.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63467.log 2024-09-22T04:06:27.065 INFO:teuthology.orchestra.run.smithi037.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.66736.log.gz 2024-09-22T04:06:27.065 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.67034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58809.log 2024-09-22T04:06:27.065 INFO:teuthology.orchestra.run.smithi037.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.67034.log.gz 2024-09-22T04:06:27.065 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.63467.log: gzip 50.0% -- replaced with /var/log/ceph/ceph-client.admin.63467.log.gz -5 2024-09-22T04:06:27.065 INFO:teuthology.orchestra.run.smithi037.stderr: --verbose -- /var/log/ceph/ceph-client.admin.44022.log 2024-09-22T04:06:27.065 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.58809.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31464.log 2024-09-22T04:06:27.065 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.58809.log.gz 2024-09-22T04:06:27.065 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.44022.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34142.log 2024-09-22T04:06:27.066 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44022.log.gz 2024-09-22T04:06:27.066 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.31464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68683.log 2024-09-22T04:06:27.066 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.31464.log.gz 2024-09-22T04:06:27.066 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.34142.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44120.log 2024-09-22T04:06:27.066 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.34142.log.gz 2024-09-22T04:06:27.066 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.68683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39944.log 2024-09-22T04:06:27.066 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.68683.log.gz 2024-09-22T04:06:27.066 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.44120.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45546.log 2024-09-22T04:06:27.066 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44120.log.gz 2024-09-22T04:06:27.066 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.39944.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38623.log 2024-09-22T04:06:27.066 INFO:teuthology.orchestra.run.smithi037.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.39944.log.gz 2024-09-22T04:06:27.066 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.45546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41237.log 2024-09-22T04:06:27.066 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45546.log.gz 2024-09-22T04:06:27.066 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.38623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39677.log 2024-09-22T04:06:27.066 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.38623.log.gz 2024-09-22T04:06:27.067 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.41237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30787.log 2024-09-22T04:06:27.067 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41237.log.gz 2024-09-22T04:06:27.067 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.39677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45895.log 2024-09-22T04:06:27.067 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.39677.log.gz 2024-09-22T04:06:27.067 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.30787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68508.log 2024-09-22T04:06:27.067 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.30787.log.gz 2024-09-22T04:06:27.067 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.45895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40331.log 2024-09-22T04:06:27.067 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45895.log.gz 2024-09-22T04:06:27.067 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.68508.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41495.log 2024-09-22T04:06:27.067 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.68508.log.gz 2024-09-22T04:06:27.067 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.40331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32709.log 2024-09-22T04:06:27.067 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40331.log.gz 2024-09-22T04:06:27.067 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.41495.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48928.log 2024-09-22T04:06:27.067 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41495.log.gz 2024-09-22T04:06:27.067 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.32709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58589.log 2024-09-22T04:06:27.068 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.32709.log.gz 2024-09-22T04:06:27.068 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.48928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42548.log 2024-09-22T04:06:27.068 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.48928.log.gz 2024-09-22T04:06:27.068 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.58589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42061.log 2024-09-22T04:06:27.068 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.58589.log.gz 2024-09-22T04:06:27.068 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.42548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70125.log 2024-09-22T04:06:27.068 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42548.log.gz 2024-09-22T04:06:27.068 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.42061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57276.log 2024-09-22T04:06:27.068 INFO:teuthology.orchestra.run.smithi037.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.42061.log.gz 2024-09-22T04:06:27.068 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.70125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67739.log 2024-09-22T04:06:27.068 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.70125.log.gz 2024-09-22T04:06:27.068 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.57276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65602.log 2024-09-22T04:06:27.068 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.57276.log.gz 2024-09-22T04:06:27.068 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.67739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33339.log 2024-09-22T04:06:27.068 INFO:teuthology.orchestra.run.smithi037.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.67739.log.gz 2024-09-22T04:06:27.069 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.65602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59322.log 2024-09-22T04:06:27.069 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.65602.log.gz 2024-09-22T04:06:27.069 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.33339.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51956.log 2024-09-22T04:06:27.069 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.33339.log.gz 2024-09-22T04:06:27.069 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.59322.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59802.log 2024-09-22T04:06:27.069 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.59322.log.gz 2024-09-22T04:06:27.069 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.51956.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48187.log 2024-09-22T04:06:27.069 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.51956.log.gz 2024-09-22T04:06:27.069 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.59802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51732.log 2024-09-22T04:06:27.069 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.59802.log.gz 2024-09-22T04:06:27.069 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.48187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60974.log 2024-09-22T04:06:27.069 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.48187.log.gz 2024-09-22T04:06:27.069 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.51732.log: /var/log/ceph/ceph-client.admin.35028.log 2024-09-22T04:06:27.069 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.51732.log.gz 2024-09-22T04:06:27.069 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.60974.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48273.log 2024-09-22T04:06:27.069 INFO:teuthology.orchestra.run.smithi037.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.60974.log.gz 2024-09-22T04:06:27.070 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.35028.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63796.log 2024-09-22T04:06:27.070 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.35028.log.gz 2024-09-22T04:06:27.070 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.48273.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63558.log 2024-09-22T04:06:27.070 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.48273.log.gz 2024-09-22T04:06:27.070 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.63796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29562.log 2024-09-22T04:06:27.070 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.63796.log.gz 2024-09-22T04:06:27.070 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.63558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35994.log 2024-09-22T04:06:27.070 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.63558.log.gz 2024-09-22T04:06:27.070 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5/var/log/ceph/ceph-client.admin.29562.log: --verbose -- /var/log/ceph/ceph-client.admin.47385.log 2024-09-22T04:06:27.070 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29562.log.gz 2024-09-22T04:06:27.070 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.35994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49146.log 2024-09-22T04:06:27.070 INFO:teuthology.orchestra.run.smithi037.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.35994.log.gz 2024-09-22T04:06:27.070 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.47385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30707.log 2024-09-22T04:06:27.071 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47385.log.gz 2024-09-22T04:06:27.071 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.49146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39378.log 2024-09-22T04:06:27.071 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.49146.log.gz 2024-09-22T04:06:27.071 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.30707.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33319.log 2024-09-22T04:06:27.071 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.30707.log.gz 2024-09-22T04:06:27.071 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.39378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55184.log 2024-09-22T04:06:27.071 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.39378.log.gz 2024-09-22T04:06:27.071 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.33319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37215.log 2024-09-22T04:06:27.071 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.33319.log.gz 2024-09-22T04:06:27.071 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.55184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50990.log 2024-09-22T04:06:27.071 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.55184.log.gz 2024-09-22T04:06:27.071 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.37215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46542.log 2024-09-22T04:06:27.071 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.37215.log.gz 2024-09-22T04:06:27.071 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.50990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53493.log 2024-09-22T04:06:27.071 INFO:teuthology.orchestra.run.smithi037.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.50990.log.gz 2024-09-22T04:06:27.072 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.0.46542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29730.log 2024-09-22T04:06:27.072 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.53493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59895.log 2024-09-22T04:06:27.072 INFO:teuthology.orchestra.run.smithi037.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.53493.log.gz 2024-09-22T04:06:27.072 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69242.log 2024-09-22T04:06:27.072 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.29730.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29730.log.gz 2024-09-22T04:06:27.072 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.59895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38812.log 2024-09-22T04:06:27.072 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.59895.log.gz 2024-09-22T04:06:27.072 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.69242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34062.log 2024-09-22T04:06:27.072 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.69242.log.gz 2024-09-22T04:06:27.072 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55584.log 2024-09-22T04:06:27.072 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.38812.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.38812.log.gz 2024-09-22T04:06:27.072 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.34062.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52214.log 2024-09-22T04:06:27.072 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.34062.log.gz 2024-09-22T04:06:27.072 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45944.log 2024-09-22T04:06:27.073 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.55584.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.55584.log.gz 2024-09-22T04:06:27.073 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.52214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71259.log 2024-09-22T04:06:27.073 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.52214.log.gz 2024-09-22T04:06:27.073 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.45944.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32003.log 2024-09-22T04:06:27.073 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45944.log.gz 2024-09-22T04:06:27.073 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.71259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.30421.log 2024-09-22T04:06:27.073 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.71259.log.gz 2024-09-22T04:06:27.073 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5/var/log/ceph/ceph-client.admin.32003.log: --verbose -- /var/log/ceph/ceph-client.admin.35258.log 2024-09-22T04:06:27.073 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.32003.log.gz 2024-09-22T04:06:27.073 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.0.30421.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45735.log 2024-09-22T04:06:27.073 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.35258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31794.log 2024-09-22T04:06:27.073 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.35258.log.gz 2024-09-22T04:06:27.074 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.45735.log: /var/log/ceph/ceph-client.admin.41693.log 2024-09-22T04:06:27.074 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45735.log.gz 2024-09-22T04:06:27.074 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.31794.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31375.log 2024-09-22T04:06:27.074 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.31794.log.gz 2024-09-22T04:06:27.074 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.41693.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53667.log 2024-09-22T04:06:27.074 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41693.log.gz 2024-09-22T04:06:27.074 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.31375.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66567.log 2024-09-22T04:06:27.074 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.31375.log.gz 2024-09-22T04:06:27.074 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.53667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37255.log 2024-09-22T04:06:27.074 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.53667.log.gz 2024-09-22T04:06:27.074 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.66567.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70392.log 2024-09-22T04:06:27.074 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.66567.log.gz 2024-09-22T04:06:27.075 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.37255.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49933.log 2024-09-22T04:06:27.075 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.37255.log.gz 2024-09-22T04:06:27.075 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.70392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60417.log 2024-09-22T04:06:27.075 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.70392.log.gz 2024-09-22T04:06:27.075 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.49933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63418.log 2024-09-22T04:06:27.075 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.49933.log.gz 2024-09-22T04:06:27.075 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.60417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49593.log 2024-09-22T04:06:27.075 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.60417.log.gz 2024-09-22T04:06:27.075 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.63418.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30667.log 2024-09-22T04:06:27.075 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.63418.log.gz 2024-09-22T04:06:27.075 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.49593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43044.log 2024-09-22T04:06:27.075 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.49593.log.gz 2024-09-22T04:06:27.075 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.30667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68935.log 2024-09-22T04:06:27.075 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.30667.log.gz 2024-09-22T04:06:27.075 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37304.log 2024-09-22T04:06:27.076 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43044.log.gz 2024-09-22T04:06:27.076 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.68935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42679.log 2024-09-22T04:06:27.076 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.68935.log.gz 2024-09-22T04:06:27.076 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.37304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38316.log 2024-09-22T04:06:27.076 INFO:teuthology.orchestra.run.smithi037.stderr: 47.6% -- replaced with /var/log/ceph/ceph-client.admin.37304.log.gz 2024-09-22T04:06:27.076 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.42679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32849.log 2024-09-22T04:06:27.076 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42679.log.gz 2024-09-22T04:06:27.076 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.38316.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58320.log 2024-09-22T04:06:27.076 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.38316.log.gz 2024-09-22T04:06:27.076 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.32849.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62184.log 2024-09-22T04:06:27.076 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.32849.log.gz 2024-09-22T04:06:27.076 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.58320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57587.log 2024-09-22T04:06:27.076 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.58320.log.gz 2024-09-22T04:06:27.076 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.62184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37695.log 2024-09-22T04:06:27.076 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.62184.log.gz 2024-09-22T04:06:27.077 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.57587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60037.log 2024-09-22T04:06:27.077 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.57587.log.gz 2024-09-22T04:06:27.077 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.37695.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68463.log 2024-09-22T04:06:27.077 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.37695.log.gz 2024-09-22T04:06:27.077 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.60037.log: gzip -5 --verbose -- 50.0% -- replaced with /var/log/ceph/ceph-client.admin.60037.log.gz 2024-09-22T04:06:27.077 INFO:teuthology.orchestra.run.smithi037.stderr: /var/log/ceph/ceph-client.admin.67390.log 2024-09-22T04:06:27.077 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.68463.log: 50.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.68463.log.gz -5 2024-09-22T04:06:27.077 INFO:teuthology.orchestra.run.smithi037.stderr: --verbose -- /var/log/ceph/ceph-client.admin.39723.log 2024-09-22T04:06:27.077 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.67390.log: gzip -5 --verbose -- 50.0% -- replaced with /var/log/ceph/ceph-client.admin.67390.log.gz 2024-09-22T04:06:27.077 INFO:teuthology.orchestra.run.smithi037.stderr: /var/log/ceph/ceph-client.admin.51159.log 2024-09-22T04:06:27.077 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.39723.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39723.log.gz 2024-09-22T04:06:27.077 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39538.log 2024-09-22T04:06:27.077 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.51159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35567.log 2024-09-22T04:06:27.077 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.51159.log.gz 2024-09-22T04:06:27.077 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.39538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71427.log 2024-09-22T04:06:27.078 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.39538.log.gz 2024-09-22T04:06:27.078 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.35567.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68068.log 2024-09-22T04:06:27.078 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.35567.log.gz 2024-09-22T04:06:27.078 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.71427.log: gzip -5 --verbose -- 50.0% -- replaced with /var/log/ceph/ceph-client.admin.71427.log.gz 2024-09-22T04:06:27.078 INFO:teuthology.orchestra.run.smithi037.stderr: /var/log/ceph/ceph-client.admin.47216.log 2024-09-22T04:06:27.078 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.68068.log: 47.6% -- replaced with /var/log/ceph/ceph-client.admin.68068.log.gz 2024-09-22T04:06:27.078 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-22T04:06:27.078 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.47216.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.47216.log.gz 2024-09-22T04:06:27.078 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37046.log 2024-09-22T04:06:27.078 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60954.log 2024-09-22T04:06:27.078 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.37046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70394.log 2024-09-22T04:06:27.078 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.37046.log.gz 2024-09-22T04:06:27.078 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.60954.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34323.log 2024-09-22T04:06:27.078 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.60954.log.gz 2024-09-22T04:06:27.079 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32359.log 2024-09-22T04:06:27.079 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.70394.log: gzip 49.6% -5 --verbose -- /var/log/ceph/ceph-client.admin.70209.log 2024-09-22T04:06:27.079 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.70394.log.gz 2024-09-22T04:06:27.079 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.34323.log: /var/log/ceph/ceph-client.admin.32359.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.34323.log.gz 2024-09-22T04:06:27.079 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.32359.log.gz 2024-09-22T04:06:27.079 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30478.log 2024-09-22T04:06:27.079 INFO:teuthology.orchestra.run.smithi037.stderr: 88.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-22T04:06:27.079 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.70209.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42855.log 2024-09-22T04:06:27.079 INFO:teuthology.orchestra.run.smithi037.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.70209.log.gz 2024-09-22T04:06:27.079 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.30478.log: /var/log/ceph/ceph-client.admin.71133.log 2024-09-22T04:06:27.079 INFO:teuthology.orchestra.run.smithi037.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.30478.log.gz 2024-09-22T04:06:27.079 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.42855.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.42855.log.gz 2024-09-22T04:06:27.079 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50271.log 2024-09-22T04:06:27.079 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.71133.log: gzip -5 --verbose 49.6% -- /var/log/ceph/ceph-client.admin.65146.log 2024-09-22T04:06:27.080 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.71133.log.gz 2024-09-22T04:06:27.080 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.50271.log: gzip 49.6% -- replaced with /var/log/ceph/ceph-client.admin.50271.log.gz -5 2024-09-22T04:06:27.080 INFO:teuthology.orchestra.run.smithi037.stderr: --verbose -- /var/log/ceph/ceph-client.admin.66427.log 2024-09-22T04:06:27.080 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.65146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50852.log 2024-09-22T04:06:27.080 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.65146.log.gz 2024-09-22T04:06:27.080 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.66427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47167.log 2024-09-22T04:06:27.080 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.66427.log.gz 2024-09-22T04:06:27.080 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.50852.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42408.log 2024-09-22T04:06:27.080 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.50852.log.gz 2024-09-22T04:06:27.080 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.47167.log: gzip -5 --verbose 50.4% -- replaced with /var/log/ceph/ceph-client.admin.47167.log.gz 2024-09-22T04:06:27.080 INFO:teuthology.orchestra.run.smithi037.stderr: -- /var/log/ceph/ceph-client.admin.71049.log 2024-09-22T04:06:27.080 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.42408.log: 49.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35607.log 2024-09-22T04:06:27.080 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42408.log.gz 2024-09-22T04:06:27.080 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.71049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51599.log 2024-09-22T04:06:27.080 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.71049.log.gz 2024-09-22T04:06:27.081 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39071.log 2024-09-22T04:06:27.081 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.35607.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.35607.log.gz 2024-09-22T04:06:27.081 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.51599.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38566.log 2024-09-22T04:06:27.081 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.51599.log.gz 2024-09-22T04:06:27.081 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.39071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48888.log 2024-09-22T04:06:27.081 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39071.log.gz 2024-09-22T04:06:27.081 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.0.38566.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69689.log 2024-09-22T04:06:27.081 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.48888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70671.log 2024-09-22T04:06:27.081 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.48888.log.gz 2024-09-22T04:06:27.081 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.69689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41117.log 2024-09-22T04:06:27.081 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.69689.log.gz 2024-09-22T04:06:27.081 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37611.log 2024-09-22T04:06:27.081 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.70671.log: /var/log/ceph/ceph-client.admin.41117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46916.log 2024-09-22T04:06:27.081 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41117.log.gz 2024-09-22T04:06:27.081 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.70671.log.gz 2024-09-22T04:06:27.082 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.37611.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.37611.log.gz 2024-09-22T04:06:27.082 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64710.log 2024-09-22T04:06:27.082 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.46916.log: gzip -5 --verbose 49.6% -- replaced with /var/log/ceph/ceph-client.admin.46916.log.gz 2024-09-22T04:06:27.082 INFO:teuthology.orchestra.run.smithi037.stderr: -- /var/log/ceph/ceph-client.admin.50760.log 2024-09-22T04:06:27.082 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.64710.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.64710.log.gz 2024-09-22T04:06:27.082 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35413.log 2024-09-22T04:06:27.082 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.50760.log: gzip -5 --verbose -- 49.6% -- replaced with /var/log/ceph/ceph-client.admin.50760.log.gz 2024-09-22T04:06:27.082 INFO:teuthology.orchestra.run.smithi037.stderr: /var/log/ceph/ceph-client.admin.44603.log 2024-09-22T04:06:27.082 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.35413.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.35413.log.gz 2024-09-22T04:06:27.082 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61581.log 2024-09-22T04:06:27.082 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45042.log 2024-09-22T04:06:27.082 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.44603.log: /var/log/ceph/ceph-client.admin.61581.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49415.log 2024-09-22T04:06:27.082 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% 50.4% -- replaced with /var/log/ceph/ceph-client.admin.61581.log.gz 2024-09-22T04:06:27.082 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44603.log.gz 2024-09-22T04:06:27.082 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.45042.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45042.log.gz 2024-09-22T04:06:27.083 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49873.log 2024-09-22T04:06:27.083 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.49415.log: gzip -5 --verbose -- 49.6% -- replaced with /var/log/ceph/ceph-client.admin.49415.log.gz 2024-09-22T04:06:27.083 INFO:teuthology.orchestra.run.smithi037.stderr: /var/log/ceph/ceph-client.admin.50635.log 2024-09-22T04:06:27.083 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.49873.log: 49.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44329.log 2024-09-22T04:06:27.083 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.49873.log.gz 2024-09-22T04:06:27.083 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.50635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54828.log 2024-09-22T04:06:27.083 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.50635.log.gz 2024-09-22T04:06:27.083 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.44329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33024.log 2024-09-22T04:06:27.083 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44329.log.gz 2024-09-22T04:06:27.083 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32401.log 2024-09-22T04:06:27.083 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.54828.log: /var/log/ceph/ceph-client.admin.33024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52480.log 2024-09-22T04:06:27.083 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% 50.0% -- replaced with /var/log/ceph/ceph-client.admin.54828.log.gz 2024-09-22T04:06:27.084 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.33024.log.gz 2024-09-22T04:06:27.084 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.32401.log: gzip 49.6% -- replaced with /var/log/ceph/ceph-client.admin.32401.log.gz 2024-09-22T04:06:27.084 INFO:teuthology.orchestra.run.smithi037.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.48084.log 2024-09-22T04:06:27.084 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.52480.log: gzip 49.6% -- replaced with /var/log/ceph/ceph-client.admin.52480.log.gz 2024-09-22T04:06:27.084 INFO:teuthology.orchestra.run.smithi037.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.39851.log 2024-09-22T04:06:27.084 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.48084.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.48084.log.gz 2024-09-22T04:06:27.084 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49635.log 2024-09-22T04:06:27.084 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.39851.log: gzip -5 --verbose -- 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39851.log.gz 2024-09-22T04:06:27.084 INFO:teuthology.orchestra.run.smithi037.stderr: /var/log/ceph/ceph-client.admin.51976.log 2024-09-22T04:06:27.084 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.49635.log: 49.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67274.log 2024-09-22T04:06:27.084 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.49635.log.gz 2024-09-22T04:06:27.084 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.51976.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61303.log 2024-09-22T04:06:27.084 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.51976.log.gz 2024-09-22T04:06:27.084 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.67274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44867.log 2024-09-22T04:06:27.085 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.67274.log.gz 2024-09-22T04:06:27.085 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31065.log 2024-09-22T04:06:27.085 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.61303.log: /var/log/ceph/ceph-client.admin.44867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39986.log 2024-09-22T04:06:27.085 INFO:teuthology.orchestra.run.smithi037.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.61303.log.gz 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44867.log.gz 2024-09-22T04:06:27.085 INFO:teuthology.orchestra.run.smithi037.stderr: 2024-09-22T04:06:27.085 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.31065.log: 49.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29563.log 2024-09-22T04:06:27.085 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.31065.log.gz 2024-09-22T04:06:27.085 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.39986.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54183.log 2024-09-22T04:06:27.085 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39986.log.gz 2024-09-22T04:06:27.085 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61083.log 2024-09-22T04:06:27.085 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.29563.log: /var/log/ceph/ceph-client.admin.54183.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54915.log 2024-09-22T04:06:27.085 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% 49.6% -- replaced with /var/log/ceph/ceph-client.admin.54183.log.gz 2024-09-22T04:06:27.085 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.29563.log.gz 2024-09-22T04:06:27.085 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.61083.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.61083.log.gz 2024-09-22T04:06:27.085 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70041.log 2024-09-22T04:06:27.086 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34231.log 2024-09-22T04:06:27.086 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.54915.log: /var/log/ceph/ceph-client.admin.70041.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61939.log 2024-09-22T04:06:27.086 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.54915.log.gz 2024-09-22T04:06:27.086 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.70041.log.gz 2024-09-22T04:06:27.086 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.34231.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43980.log 2024-09-22T04:06:27.086 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.34231.log.gz 2024-09-22T04:06:27.086 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.61939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70729.log 2024-09-22T04:06:27.086 INFO:teuthology.orchestra.run.smithi037.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.61939.log.gz 2024-09-22T04:06:27.086 INFO:teuthology.orchestra.run.smithi037.stderr:gzip/var/log/ceph/ceph-client.admin.43980.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.46958.log 2024-09-22T04:06:27.086 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43980.log.gz 2024-09-22T04:06:27.086 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.70729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56671.log 2024-09-22T04:06:27.086 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.70729.log.gz 2024-09-22T04:06:27.086 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65791.log 2024-09-22T04:06:27.086 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.46958.log: /var/log/ceph/ceph-client.admin.56671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40975.log 2024-09-22T04:06:27.087 INFO:teuthology.orchestra.run.smithi037.stderr: 49.2% 50.0% -- replaced with /var/log/ceph/ceph-client.admin.56671.log.gz 2024-09-22T04:06:27.087 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46958.log.gz 2024-09-22T04:06:27.087 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.65791.log: 50.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58669.log 2024-09-22T04:06:27.087 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.65791.log.gz 2024-09-22T04:06:27.087 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.40975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43184.log 2024-09-22T04:06:27.087 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40975.log.gz 2024-09-22T04:06:27.087 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56631.log 2024-09-22T04:06:27.087 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.58669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57058.log 2024-09-22T04:06:27.087 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43184.log: 50.0% 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43184.log.gz 2024-09-22T04:06:27.087 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.58669.log.gz 2024-09-22T04:06:27.087 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.56631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45217.log 2024-09-22T04:06:27.087 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6%/var/log/ceph/ceph-client.admin.57058.log: -- replaced with /var/log/ceph/ceph-client.admin.56631.log.gz 2024-09-22T04:06:27.087 INFO:teuthology.orchestra.run.smithi037.stderr: 49.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.57058.log.gz -5 2024-09-22T04:06:27.087 INFO:teuthology.orchestra.run.smithi037.stderr: --verbose -- /var/log/ceph/ceph-client.admin.37740.log 2024-09-22T04:06:27.087 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53796.log 2024-09-22T04:06:27.088 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.45217.log: /var/log/ceph/ceph-client.admin.37740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67410.log 2024-09-22T04:06:27.088 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% 50.0% -- replaced with /var/log/ceph/ceph-client.admin.37740.log.gz 2024-09-22T04:06:27.088 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45217.log.gz 2024-09-22T04:06:27.088 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.53796.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.53796.log.gz 2024-09-22T04:06:27.088 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34939.log 2024-09-22T04:06:27.088 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71343.log 2024-09-22T04:06:27.088 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.67410.log: /var/log/ceph/ceph-client.admin.34939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65751.log 2024-09-22T04:06:27.088 INFO:teuthology.orchestra.run.smithi037.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.67410.log.gz 2024-09-22T04:06:27.088 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.34939.log.gz 2024-09-22T04:06:27.088 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.71343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33497.log 2024-09-22T04:06:27.088 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.71343.log.gz 2024-09-22T04:06:27.088 INFO:teuthology.orchestra.run.smithi037.stderr:gzip/var/log/ceph/ceph-client.admin.65751.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.36652.log 2024-09-22T04:06:27.088 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.65751.log.gz 2024-09-22T04:06:27.088 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.33497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65226.log 2024-09-22T04:06:27.088 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.33497.log.gz 2024-09-22T04:06:27.088 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43722.log 2024-09-22T04:06:27.089 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.36652.log: gzip/var/log/ceph/ceph-client.admin.65226.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.54726.log 2024-09-22T04:06:27.089 INFO:teuthology.orchestra.run.smithi037.stderr: 48.4% -- replaced with /var/log/ceph/ceph-client.admin.65226.log.gz 2024-09-22T04:06:27.089 INFO:teuthology.orchestra.run.smithi037.stderr: 49.2%/var/log/ceph/ceph-client.admin.43722.log: -- replaced with /var/log/ceph/ceph-client.admin.36652.log.gz 2024-09-22T04:06:27.089 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.43722.log.gz 2024-09-22T04:06:27.089 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36341.log 2024-09-22T04:06:27.089 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36831.log 2024-09-22T04:06:27.089 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.54726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62633.log 2024-09-22T04:06:27.089 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.36341.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.54726.log.gz 49.6% 2024-09-22T04:06:27.089 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.36341.log.gz 2024-09-22T04:06:27.089 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.36831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71091.log 2024-09-22T04:06:27.089 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.36831.log.gz 2024-09-22T04:06:27.089 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.62633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38535.log 2024-09-22T04:06:27.089 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.62633.log.gz 2024-09-22T04:06:27.089 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.71091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40453.log 2024-09-22T04:06:27.089 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.71091.log.gz 2024-09-22T04:06:27.089 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65889.log 2024-09-22T04:06:27.090 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.38535.log: /var/log/ceph/ceph-client.admin.40453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49733.log 2024-09-22T04:06:27.090 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.38535.log.gz 2024-09-22T04:06:27.090 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40453.log.gz 2024-09-22T04:06:27.090 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.65889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32666.log 2024-09-22T04:06:27.090 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.65889.log.gz 2024-09-22T04:06:27.090 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64781.log 2024-09-22T04:06:27.090 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.49733.log: /var/log/ceph/ceph-client.admin.32666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60695.log 2024-09-22T04:06:27.090 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% 49.6% -- replaced with /var/log/ceph/ceph-client.admin.49733.log.gz 2024-09-22T04:06:27.090 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.32666.log.gz 2024-09-22T04:06:27.090 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.64781.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.64781.log.gz 2024-09-22T04:06:27.090 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69731.log 2024-09-22T04:06:27.090 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.60695.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.60695.log.gz 2024-09-22T04:06:27.090 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46978.log 2024-09-22T04:06:27.090 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.69731.log: /var/log/ceph/ceph-client.admin.61443.log 2024-09-22T04:06:27.091 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.69731.log.gz 2024-09-22T04:06:27.091 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.46978.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46978.log.gz 2024-09-22T04:06:27.091 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58907.log 2024-09-22T04:06:27.091 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32141.log 2024-09-22T04:06:27.091 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.61443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59738.log 2024-09-22T04:06:27.091 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.58907.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.61443.log.gz 2024-09-22T04:06:27.091 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.58907.log.gz 2024-09-22T04:06:27.091 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.32141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48839.log 2024-09-22T04:06:27.091 INFO:teuthology.orchestra.run.smithi037.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.32141.log.gz 2024-09-22T04:06:27.091 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68237.log 2024-09-22T04:06:27.091 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.59738.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.59738.log.gz 2024-09-22T04:06:27.091 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69821.log 2024-09-22T04:06:27.091 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.48839.log: /var/log/ceph/ceph-client.admin.68237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67699.log 2024-09-22T04:06:27.091 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.48839.log.gz 2024-09-22T04:06:27.091 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.68237.log.gz 2024-09-22T04:06:27.091 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.69821.log: gzip 49.6% -- replaced with /var/log/ceph/ceph-client.admin.69821.log.gz 2024-09-22T04:06:27.092 INFO:teuthology.orchestra.run.smithi037.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.69957.log 2024-09-22T04:06:27.092 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.67699.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.67699.log.gz 2024-09-22T04:06:27.092 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40591.log 2024-09-22T04:06:27.092 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.69957.log: /var/log/ceph/ceph-client.admin.66069.log 2024-09-22T04:06:27.092 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.69957.log.gz/var/log/ceph/ceph-client.admin.40591.log: 2024-09-22T04:06:27.092 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40591.log.gz 2024-09-22T04:06:27.092 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47474.log 2024-09-22T04:06:27.092 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.66069.log: /var/log/ceph/ceph-client.admin.63209.log 2024-09-22T04:06:27.092 INFO:teuthology.orchestra.run.smithi037.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.66069.log.gz 2024-09-22T04:06:27.092 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.47474.log: /var/log/ceph/ceph-client.admin.30925.log 2024-09-22T04:06:27.092 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.47474.log.gz 2024-09-22T04:06:27.092 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.63209.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.63209.log.gz 2024-09-22T04:06:27.092 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67928.log 2024-09-22T04:06:27.093 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33157.log 2024-09-22T04:06:27.093 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.30925.log: gzip -5 --verbose --/var/log/ceph/ceph-client.admin.67928.log: /var/log/ceph/ceph-client.admin.33884.log 2024-09-22T04:06:27.093 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.30925.log.gz 50.8% -- replaced with /var/log/ceph/ceph-client.admin.67928.log.gz 2024-09-22T04:06:27.093 INFO:teuthology.orchestra.run.smithi037.stderr: 2024-09-22T04:06:27.093 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.33157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47086.log 2024-09-22T04:06:27.093 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.33157.log.gz/var/log/ceph/ceph-client.admin.33884.log: 2024-09-22T04:06:27.093 INFO:teuthology.orchestra.run.smithi037.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.33884.log.gz 2024-09-22T04:06:27.093 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66776.log 2024-09-22T04:06:27.093 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.47086.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47086.log.gz 2024-09-22T04:06:27.093 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36034.log 2024-09-22T04:06:27.093 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.66776.log: 50.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36132.log 2024-09-22T04:06:27.093 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.66776.log.gz 2024-09-22T04:06:27.093 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.36034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34728.log 2024-09-22T04:06:27.093 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.36034.log.gz 2024-09-22T04:06:27.094 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66327.log 2024-09-22T04:06:27.094 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.36132.log: /var/log/ceph/ceph-client.admin.34728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37780.log 2024-09-22T04:06:27.094 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% 50.0% -- replaced with /var/log/ceph/ceph-client.admin.36132.log.gz 2024-09-22T04:06:27.094 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.34728.log.gz 2024-09-22T04:06:27.094 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.66327.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.66327.log.gz 2024-09-22T04:06:27.094 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48710.log 2024-09-22T04:06:27.094 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31513.log 2024-09-22T04:06:27.094 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.37780.log: /var/log/ceph/ceph-client.admin.48710.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46324.log 2024-09-22T04:06:27.094 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.37780.log.gz 2024-09-22T04:06:27.094 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.48710.log.gz 2024-09-22T04:06:27.095 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.31513.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32310.log 2024-09-22T04:06:27.095 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.31513.log.gz 2024-09-22T04:06:27.095 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.46324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35483.log 2024-09-22T04:06:27.095 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46324.log.gz 2024-09-22T04:06:27.095 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41941.log 2024-09-22T04:06:27.095 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.32310.log: /var/log/ceph/ceph-client.admin.35483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47040.log 2024-09-22T04:06:27.095 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% 49.6% -- replaced with /var/log/ceph/ceph-client.admin.35483.log.gz 2024-09-22T04:06:27.095 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.32310.log.gz 2024-09-22T04:06:27.095 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.41941.log: gzip 50.4% -- replaced with /var/log/ceph/ceph-client.admin.41941.log.gz 2024-09-22T04:06:27.095 INFO:teuthology.orchestra.run.smithi037.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.58271.log 2024-09-22T04:06:27.095 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.47040.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47040.log.gz 2024-09-22T04:06:27.096 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68416.log 2024-09-22T04:06:27.096 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.58271.log: 49.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35912.log 2024-09-22T04:06:27.096 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.58271.log.gz 2024-09-22T04:06:27.096 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.68416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70083.log 2024-09-22T04:06:27.096 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.68416.log.gz 2024-09-22T04:06:27.096 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36252.log 2024-09-22T04:06:27.096 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.35912.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.35912.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66652.log 2024-09-22T04:06:27.096 INFO:teuthology.orchestra.run.smithi037.stderr: 2024-09-22T04:06:27.096 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.70083.log: /var/log/ceph/ceph-client.admin.36252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35350.log 2024-09-22T04:06:27.096 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% 50.0% -- replaced with /var/log/ceph/ceph-client.admin.36252.log.gz 2024-09-22T04:06:27.096 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.70083.log.gz 2024-09-22T04:06:27.096 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.66652.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.66652.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53925.log 2024-09-22T04:06:27.096 INFO:teuthology.orchestra.run.smithi037.stderr: 2024-09-22T04:06:27.096 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56490.log 2024-09-22T04:06:27.097 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.35350.log: /var/log/ceph/ceph-client.admin.53925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64101.log 2024-09-22T04:06:27.097 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.35350.log.gz 2024-09-22T04:06:27.097 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.53925.log.gz 2024-09-22T04:06:27.097 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.56490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47425.log 2024-09-22T04:06:27.097 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.56490.log.gz 2024-09-22T04:06:27.097 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40244.log 2024-09-22T04:06:27.097 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.64101.log: /var/log/ceph/ceph-client.admin.47425.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68326.log 2024-09-22T04:06:27.097 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% 49.6% -- replaced with /var/log/ceph/ceph-client.admin.47425.log.gz 2024-09-22T04:06:27.097 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.64101.log.gz 2024-09-22T04:06:27.097 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.40244.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40244.log.gz 2024-09-22T04:06:27.097 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70167.log 2024-09-22T04:06:27.097 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52833.log 2024-09-22T04:06:27.097 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.68326.log: /var/log/ceph/ceph-client.admin.70167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48580.log 2024-09-22T04:06:27.097 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.68326.log.gz 2024-09-22T04:06:27.097 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.70167.log.gz 2024-09-22T04:06:27.098 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.52833.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.52833.log.gz 2024-09-22T04:06:27.098 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45000.log 2024-09-22T04:06:27.098 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56797.log 2024-09-22T04:06:27.098 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.48580.log: 49.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38892.log 2024-09-22T04:06:27.098 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.45000.log: -- replaced with /var/log/ceph/ceph-client.admin.48580.log.gz 2024-09-22T04:06:27.098 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45000.log.gz 2024-09-22T04:06:27.098 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44286.log 2024-09-22T04:06:27.098 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.56797.log: 49.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50178.log 2024-09-22T04:06:27.098 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.38892.log: -- replaced with /var/log/ceph/ceph-client.admin.56797.log.gz 2024-09-22T04:06:27.098 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.38892.log.gz 2024-09-22T04:06:27.098 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.44286.log: gzip 47.6% -- replaced with /var/log/ceph/ceph-client.admin.44286.log.gz 2024-09-22T04:06:27.098 INFO:teuthology.orchestra.run.smithi037.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.41633.log 2024-09-22T04:06:27.098 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.50178.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.50178.log.gz 2024-09-22T04:06:27.098 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57316.log 2024-09-22T04:06:27.099 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47924.log 2024-09-22T04:06:27.099 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.41633.log: /var/log/ceph/ceph-client.admin.57316.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53836.log 2024-09-22T04:06:27.099 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% 49.6% -- replaced with /var/log/ceph/ceph-client.admin.57316.log.gz 2024-09-22T04:06:27.099 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.41633.log.gz 2024-09-22T04:06:27.099 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.47924.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.47924.log.gz 2024-09-22T04:06:27.099 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54312.log 2024-09-22T04:06:27.099 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65066.log 2024-09-22T04:06:27.099 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.53836.log: /var/log/ceph/ceph-client.admin.54312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68590.log 2024-09-22T04:06:27.099 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.53836.log.gz 2024-09-22T04:06:27.099 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.54312.log.gz 2024-09-22T04:06:27.099 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.65066.log: gzip 49.6% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.65066.log.gz -- 2024-09-22T04:06:27.099 INFO:teuthology.orchestra.run.smithi037.stderr: /var/log/ceph/ceph-client.admin.55523.log 2024-09-22T04:06:27.099 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33064.log 2024-09-22T04:06:27.099 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.68590.log: /var/log/ceph/ceph-client.admin.55523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48064.log 2024-09-22T04:06:27.100 INFO:teuthology.orchestra.run.smithi037.stderr: 48.0% 49.6% -- replaced with /var/log/ceph/ceph-client.admin.55523.log.gz 2024-09-22T04:06:27.100 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.68590.log.gz 2024-09-22T04:06:27.100 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.33064.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.33064.log.gz 2024-09-22T04:06:27.100 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56111.log 2024-09-22T04:06:27.100 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60795.log 2024-09-22T04:06:27.100 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.48064.log: 48.0% -- replaced with /var/log/ceph/ceph-client.admin.48064.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37869.log 2024-09-22T04:06:27.100 INFO:teuthology.orchestra.run.smithi037.stderr: 2024-09-22T04:06:27.100 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.56111.log: /var/log/ceph/ceph-client.admin.60795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71551.log 2024-09-22T04:06:27.100 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% 50.0% -- replaced with /var/log/ceph/ceph-client.admin.60795.log.gz 2024-09-22T04:06:27.100 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.56111.log.gz 2024-09-22T04:06:27.100 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.37869.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.37869.log.gz 2024-09-22T04:06:27.100 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69285.log 2024-09-22T04:06:27.100 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.71551.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.71551.log.gz 2024-09-22T04:06:27.100 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62121.log 2024-09-22T04:06:27.100 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64501.log 2024-09-22T04:06:27.100 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.69285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49051.log 2024-09-22T04:06:27.101 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.62121.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.69285.log.gz 50.4% -- replaced with /var/log/ceph/ceph-client.admin.62121.log.gz 2024-09-22T04:06:27.101 INFO:teuthology.orchestra.run.smithi037.stderr: 2024-09-22T04:06:27.101 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.64501.log: gzip -5 --verbose 50.4% -- replaced with /var/log/ceph/ceph-client.admin.64501.log.gz 2024-09-22T04:06:27.101 INFO:teuthology.orchestra.run.smithi037.stderr: -- /var/log/ceph/ceph-client.admin.49009.log 2024-09-22T04:06:27.101 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.49051.log: 49.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40909.log 2024-09-22T04:06:27.101 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.49051.log.gz 2024-09-22T04:06:27.101 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.49009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53974.log 2024-09-22T04:06:27.101 INFO:teuthology.orchestra.run.smithi037.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.49009.log.gz 2024-09-22T04:06:27.101 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57537.log 2024-09-22T04:06:27.101 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.40909.log: /var/log/ceph/ceph-client.admin.53974.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60296.log 2024-09-22T04:06:27.101 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40909.log.gz 2024-09-22T04:06:27.101 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.53974.log.gz 2024-09-22T04:06:27.101 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.57537.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.57537.log.gz 2024-09-22T04:06:27.101 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29672.log 2024-09-22T04:06:27.102 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.60296.log: gzip -5 --verbose -- 49.6% -- replaced with /var/log/ceph/ceph-client.admin.60296.log.gz 2024-09-22T04:06:27.102 INFO:teuthology.orchestra.run.smithi037.stderr: /var/log/ceph/ceph-client.admin.29840.log 2024-09-22T04:06:27.102 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.29672.log: 50.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57762.log 2024-09-22T04:06:27.102 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.29672.log.gz 2024-09-22T04:06:27.102 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.29840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52962.log 2024-09-22T04:06:27.102 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29840.log.gz 2024-09-22T04:06:27.102 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60555.log 2024-09-22T04:06:27.102 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.57762.log: /var/log/ceph/ceph-client.admin.52962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31415.log 2024-09-22T04:06:27.102 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% 50.0% -- replaced with /var/log/ceph/ceph-client.admin.57762.log.gz 2024-09-22T04:06:27.102 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.52962.log.gz 2024-09-22T04:06:27.102 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.60555.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.60555.log.gz 2024-09-22T04:06:27.102 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33457.log 2024-09-22T04:06:27.102 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.31415.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57844.log 2024-09-22T04:06:27.102 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.31415.log.gz 2024-09-22T04:06:27.103 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.33457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55631.log 2024-09-22T04:06:27.103 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.33457.log.gz 2024-09-22T04:06:27.103 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71469.log 2024-09-22T04:06:27.103 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.57844.log: /var/log/ceph/ceph-client.admin.55631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52607.log 2024-09-22T04:06:27.103 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% 50.0% -- replaced with /var/log/ceph/ceph-client.admin.57844.log.gz 2024-09-22T04:06:27.103 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.55631.log.gz 2024-09-22T04:06:27.103 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.71469.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.71469.log.gz 2024-09-22T04:06:27.103 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41018.log 2024-09-22T04:06:27.103 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.52607.log: gzip -5 --verbose -- 49.6% -- replaced with /var/log/ceph/ceph-client.admin.52607.log.gz 2024-09-22T04:06:27.103 INFO:teuthology.orchestra.run.smithi037.stderr: /var/log/ceph/ceph-client.admin.43882.log 2024-09-22T04:06:27.103 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.41018.log: 50.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34162.log 2024-09-22T04:06:27.103 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.41018.log.gz 2024-09-22T04:06:27.103 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43882.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71511.log 2024-09-22T04:06:27.104 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43882.log.gz 2024-09-22T04:06:27.104 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45595.log 2024-09-22T04:06:27.104 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.34162.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.34162.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61841.log 2024-09-22T04:06:27.104 INFO:teuthology.orchestra.run.smithi037.stderr: 2024-09-22T04:06:27.104 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.71511.log: /var/log/ceph/ceph-client.admin.45595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59500.log 2024-09-22T04:06:27.104 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45595.log.gz 2024-09-22T04:06:27.104 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.71511.log.gz 2024-09-22T04:06:27.104 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.61841.log: 49.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51466.log 2024-09-22T04:06:27.104 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.61841.log.gz 2024-09-22T04:06:27.104 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.59500.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38138.log 2024-09-22T04:06:27.104 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.59500.log.gz 2024-09-22T04:06:27.104 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60856.log 2024-09-22T04:06:27.105 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.51466.log: /var/log/ceph/ceph-client.admin.38138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46388.log 2024-09-22T04:06:27.105 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.51466.log.gz 2024-09-22T04:06:27.105 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.38138.log.gz 2024-09-22T04:06:27.105 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.60856.log: 50.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59560.log 2024-09-22T04:06:27.105 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.60856.log.gz 2024-09-22T04:06:27.105 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.46388.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34102.log 2024-09-22T04:06:27.105 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46388.log.gz 2024-09-22T04:06:27.105 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58184.log 2024-09-22T04:06:27.105 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.59560.log: /var/log/ceph/ceph-client.admin.34102.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31106.log 2024-09-22T04:06:27.105 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% 49.6% -- replaced with /var/log/ceph/ceph-client.admin.34102.log.gz 2024-09-22T04:06:27.105 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.59560.log.gz 2024-09-22T04:06:27.105 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.58184.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.58184.log.gz 2024-09-22T04:06:27.105 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43275.log 2024-09-22T04:06:27.106 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46825.log 2024-09-22T04:06:27.106 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.31106.log: /var/log/ceph/ceph-client.admin.43275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66587.log 2024-09-22T04:06:27.106 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.31106.log.gz 2024-09-22T04:06:27.106 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.43275.log.gz 2024-09-22T04:06:27.106 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.46825.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.46825.log.gz 2024-09-22T04:06:27.106 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70923.log 2024-09-22T04:06:27.106 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47944.log 2024-09-22T04:06:27.106 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.66587.log: /var/log/ceph/ceph-client.admin.70923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67083.log 2024-09-22T04:06:27.106 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.66587.log.gz 2024-09-22T04:06:27.106 INFO:teuthology.orchestra.run.smithi037.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.70923.log.gz 2024-09-22T04:06:27.106 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.47944.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62229.log 2024-09-22T04:06:27.106 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.47944.log.gz 2024-09-22T04:06:27.106 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.67083.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56349.log 2024-09-22T04:06:27.106 INFO:teuthology.orchestra.run.smithi037.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.67083.log.gz/var/log/ceph/ceph-client.admin.62229.log: 2024-09-22T04:06:27.106 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30569.log 2024-09-22T04:06:27.107 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.62229.log.gz 2024-09-22T04:06:27.107 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58503.log 2024-09-22T04:06:27.107 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.56349.log: /var/log/ceph/ceph-client.admin.30569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43673.log 2024-09-22T04:06:27.107 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.56349.log.gz 2024-09-22T04:06:27.107 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.30569.log.gz 2024-09-22T04:06:27.107 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.58503.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60775.log 2024-09-22T04:06:27.107 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.58503.log.gz 2024-09-22T04:06:27.107 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51368.log 2024-09-22T04:06:27.107 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65444.log 2024-09-22T04:06:27.107 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43673.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43673.log.gz 2024-09-22T04:06:27.107 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.51368.log: /var/log/ceph/ceph-client.admin.60775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52388.log 2024-09-22T04:06:27.107 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.51368.log.gz 2024-09-22T04:06:27.107 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.60775.log.gz 2024-09-22T04:06:27.107 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59153.log 2024-09-22T04:06:27.107 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.65444.log: /var/log/ceph/ceph-client.admin.52388.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50222.log 2024-09-22T04:06:27.108 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% 49.2% -- replaced with /var/log/ceph/ceph-client.admin.52388.log.gz 2024-09-22T04:06:27.108 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.65444.log.gz 2024-09-22T04:06:27.108 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.59153.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.59153.log.gz 2024-09-22T04:06:27.108 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68157.log 2024-09-22T04:06:27.108 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55811.log 2024-09-22T04:06:27.108 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.50222.log: /var/log/ceph/ceph-client.admin.68157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60597.log 2024-09-22T04:06:27.108 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.50222.log.gz 2024-09-22T04:06:27.108 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.68157.log.gz 2024-09-22T04:06:27.108 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.55811.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53011.log 2024-09-22T04:06:27.108 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.55811.log.gz 2024-09-22T04:06:27.108 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48630.log 2024-09-22T04:06:27.108 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.60597.log: /var/log/ceph/ceph-client.admin.53011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70839.log 2024-09-22T04:06:27.108 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.60597.log.gz 2024-09-22T04:06:27.109 INFO:teuthology.orchestra.run.smithi037.stderr: 48.0% -- replaced with /var/log/ceph/ceph-client.admin.53011.log.gz 2024-09-22T04:06:27.109 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.48630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52125.log 2024-09-22T04:06:27.109 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.48630.log.gz 2024-09-22T04:06:27.109 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.70839.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65017.log 2024-09-22T04:06:27.109 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.70839.log.gz 2024-09-22T04:06:27.109 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.52125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50131.log 2024-09-22T04:06:27.109 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.52125.log.gz 2024-09-22T04:06:27.109 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59062.log 2024-09-22T04:06:27.109 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.65017.log: /var/log/ceph/ceph-client.admin.50131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57629.log 2024-09-22T04:06:27.109 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% 49.6% -- replaced with /var/log/ceph/ceph-client.admin.65017.log.gz 2024-09-22T04:06:27.109 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.50131.log.gz 2024-09-22T04:06:27.109 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.59062.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.59062.log.gz 2024-09-22T04:06:27.109 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66287.log 2024-09-22T04:06:27.109 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.57629.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.57629.log.gz 2024-09-22T04:06:27.110 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45775.log 2024-09-22T04:06:27.110 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.66287.log: /var/log/ceph/ceph-client.admin.51030.log 2024-09-22T04:06:27.110 INFO:teuthology.orchestra.run.smithi037.stderr: 50.4%/var/log/ceph/ceph-client.admin.45775.log: -- replaced with /var/log/ceph/ceph-client.admin.66287.log.gz 2024-09-22T04:06:27.110 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66189.log 2024-09-22T04:06:27.110 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45775.log.gz 2024-09-22T04:06:27.110 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39198.log 2024-09-22T04:06:27.110 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.66189.log: /var/log/ceph/ceph-client.admin.51030.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55402.log 2024-09-22T04:06:27.110 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.51030.log.gz 2024-09-22T04:06:27.110 INFO:teuthology.orchestra.run.smithi037.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.66189.log.gz 2024-09-22T04:06:27.110 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33666.log 2024-09-22T04:06:27.110 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.39198.log: /var/log/ceph/ceph-client.admin.55402.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67132.log 2024-09-22T04:06:27.110 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.39198.log.gz 2024-09-22T04:06:27.110 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.55402.log.gz 2024-09-22T04:06:27.110 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61799.log 2024-09-22T04:06:27.111 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.33666.log: /var/log/ceph/ceph-client.admin.67132.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45815.log 2024-09-22T04:06:27.111 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.33666.log.gz 2024-09-22T04:06:27.111 INFO:teuthology.orchestra.run.smithi037.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.67132.log.gz 2024-09-22T04:06:27.111 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71217.log 2024-09-22T04:06:27.111 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.61799.log: /var/log/ceph/ceph-client.admin.45815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49237.log 2024-09-22T04:06:27.111 INFO:teuthology.orchestra.run.smithi037.stderr: 50.4% 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45815.log.gz 2024-09-22T04:06:27.111 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.61799.log.gz 2024-09-22T04:06:27.111 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.71217.log: gzip -5 49.6% -- replaced with /var/log/ceph/ceph-client.admin.71217.log.gz 2024-09-22T04:06:27.111 INFO:teuthology.orchestra.run.smithi037.stderr: --verbose -- /var/log/ceph/ceph-client.admin.44220.log 2024-09-22T04:06:27.111 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.49237.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.49237.log.gz 2024-09-22T04:06:27.111 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64263.log 2024-09-22T04:06:27.111 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.44220.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44220.log.gz 2024-09-22T04:06:27.111 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63069.log 2024-09-22T04:06:27.111 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.64263.log: 50.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43226.log 2024-09-22T04:06:27.112 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.64263.log.gz 2024-09-22T04:06:27.112 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.63069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29034.log 2024-09-22T04:06:27.112 INFO:teuthology.orchestra.run.smithi037.stderr: 48.0% -- replaced with /var/log/ceph/ceph-client.admin.63069.log.gz 2024-09-22T04:06:27.112 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50502.log 2024-09-22T04:06:27.112 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43226.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43226.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52305.log 2024-09-22T04:06:27.112 INFO:teuthology.orchestra.run.smithi037.stderr: 2024-09-22T04:06:27.112 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.29034.log: /var/log/ceph/ceph-client.admin.50502.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55224.log 2024-09-22T04:06:27.112 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29034.log.gz 49.6% -- replaced with /var/log/ceph/ceph-client.admin.50502.log.gz 2024-09-22T04:06:27.112 INFO:teuthology.orchestra.run.smithi037.stderr: 2024-09-22T04:06:27.112 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.52305.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.52305.log.gz 2024-09-22T04:06:27.112 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48322.log 2024-09-22T04:06:27.112 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.55224.log: 50.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62673.log 2024-09-22T04:06:27.112 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.55224.log.gz 2024-09-22T04:06:27.112 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.48322.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39587.log 2024-09-22T04:06:27.113 INFO:teuthology.orchestra.run.smithi037.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.48322.log.gz 2024-09-22T04:06:27.113 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46601.log 2024-09-22T04:06:27.113 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.62673.log: /var/log/ceph/ceph-client.admin.39587.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-22T04:06:27.113 INFO:teuthology.orchestra.run.smithi037.stderr: 48.8% 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39587.log.gz 2024-09-22T04:06:27.113 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.62673.log.gz 2024-09-22T04:06:27.113 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.46601.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46601.log.gz 2024-09-22T04:06:27.113 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34511.log 2024-09-22T04:06:27.113 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38494.log 2024-09-22T04:06:27.113 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.34511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36610.log 2024-09-22T04:06:27.113 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.34511.log.gz 2024-09-22T04:06:27.113 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.38494.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.38494.log.gz 2024-09-22T04:06:27.113 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61401.log 2024-09-22T04:06:27.113 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29966.log 2024-09-22T04:06:27.114 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.36610.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.36610.log.gz 2024-09-22T04:06:27.114 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.61401.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.61401.log.gz 2024-09-22T04:06:27.114 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46867.log 2024-09-22T04:06:27.114 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49335.log 2024-09-22T04:06:27.114 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.46867.log: /var/log/ceph/ceph-client.admin.29966.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.46867.log.gz 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29966.log.gz 2024-09-22T04:06:27.114 INFO:teuthology.orchestra.run.smithi037.stderr: 2024-09-22T04:06:27.114 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49773.log 2024-09-22T04:06:27.114 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48670.log 2024-09-22T04:06:27.114 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.49335.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.49335.log.gz 2024-09-22T04:06:27.114 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.49773.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.49773.log.gz 2024-09-22T04:06:27.114 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66029.log 2024-09-22T04:06:27.114 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64887.log 2024-09-22T04:06:27.115 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.66029.log: /var/log/ceph/ceph-client.admin.48670.log: 50.8% -- replaced with /var/log/ceph/ceph-client.admin.66029.log.gz 2024-09-22T04:06:27.115 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.48670.log.gz 2024-09-22T04:06:27.115 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43484.log 2024-09-22T04:06:27.115 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.64887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64452.log 2024-09-22T04:06:27.115 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.64887.log.gz 2024-09-22T04:06:27.115 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43484.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61212.log 2024-09-22T04:06:27.115 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.64452.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.43484.log.gz 49.6% -- replaced with /var/log/ceph/ceph-client.admin.64452.log.gz 2024-09-22T04:06:27.115 INFO:teuthology.orchestra.run.smithi037.stderr: 2024-09-22T04:06:27.115 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46303.log 2024-09-22T04:06:27.115 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.61212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68197.log 2024-09-22T04:06:27.115 INFO:teuthology.orchestra.run.smithi037.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.61212.log.gz 2024-09-22T04:06:27.115 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44646.log 2024-09-22T04:06:27.115 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.46303.log: /var/log/ceph/ceph-client.admin.68197.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.46303.log.gz 50.0% 2024-09-22T04:06:27.116 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.68197.log.gz 2024-09-22T04:06:27.116 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32097.log 2024-09-22T04:06:27.116 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37960.log 2024-09-22T04:06:27.116 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.44646.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44646.log.gz 2024-09-22T04:06:27.116 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.32097.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.32097.log.gz 2024-09-22T04:06:27.116 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30251.log 2024-09-22T04:06:27.116 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41801.log 2024-09-22T04:06:27.116 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.30251.log: /var/log/ceph/ceph-client.admin.37960.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.30251.log.gz 2024-09-22T04:06:27.116 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.37960.log.gz 2024-09-22T04:06:27.116 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49544.log 2024-09-22T04:06:27.116 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64403.log 2024-09-22T04:06:27.116 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.41801.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.41801.log.gz 2024-09-22T04:06:27.116 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.49544.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.49544.log.gz 2024-09-22T04:06:27.116 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69471.log 2024-09-22T04:06:27.117 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68865.log 2024-09-22T04:06:27.117 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.69471.log: /var/log/ceph/ceph-client.admin.64403.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.69471.log.gz 2024-09-22T04:06:27.117 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.64403.log.gz 2024-09-22T04:06:27.117 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35730.log 2024-09-22T04:06:27.117 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.68865.log: gzip 49.6% -5 --verbose -- /var/log/ceph/ceph-client.admin.39021.log 2024-09-22T04:06:27.117 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.68865.log.gz 2024-09-22T04:06:27.117 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31255.log 2024-09-22T04:06:27.117 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.35730.log: /var/log/ceph/ceph-client.admin.39021.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.35730.log.gz 49.6% -- replaced with /var/log/ceph/ceph-client.admin.39021.log.gz 2024-09-22T04:06:27.117 INFO:teuthology.orchestra.run.smithi037.stderr: 2024-09-22T04:06:27.117 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30965.log 2024-09-22T04:06:27.117 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.31255.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56209.log 2024-09-22T04:06:27.117 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.31255.log.gz 2024-09-22T04:06:27.118 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.30965.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46692.log 2024-09-22T04:06:27.118 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.56209.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.30965.log.gz 2024-09-22T04:06:27.118 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.56209.log.gz 2024-09-22T04:06:27.118 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66518.log 2024-09-22T04:06:27.118 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66914.log 2024-09-22T04:06:27.118 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.46692.log: 48.4% -- replaced with /var/log/ceph/ceph-client.admin.46692.log.gz 2024-09-22T04:06:27.119 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.66518.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.66518.log.gz 2024-09-22T04:06:27.119 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49824.log 2024-09-22T04:06:27.119 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57670.log 2024-09-22T04:06:27.119 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.49824.log: /var/log/ceph/ceph-client.admin.66914.log: 47.6% -- replaced with /var/log/ceph/ceph-client.admin.49824.log.gz 2024-09-22T04:06:27.119 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.66914.log.gz 2024-09-22T04:06:27.119 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43762.log 2024-09-22T04:06:27.119 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69105.log 2024-09-22T04:06:27.120 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.57670.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.57670.log.gz 2024-09-22T04:06:27.120 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43762.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43762.log.gz 2024-09-22T04:06:27.120 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69024.log 2024-09-22T04:06:27.120 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35954.log 2024-09-22T04:06:27.120 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.69105.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.69105.log.gz 2024-09-22T04:06:27.120 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.69024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64183.log 2024-09-22T04:06:27.120 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.69024.log.gz 2024-09-22T04:06:27.120 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.35954.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39140.log 2024-09-22T04:06:27.120 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.35954.log.gz 2024-09-22T04:06:27.121 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.64183.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56930.log 2024-09-22T04:06:27.121 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6%/var/log/ceph/ceph-client.admin.39140.log: -- replaced with /var/log/ceph/ceph-client.admin.64183.log.gz 2024-09-22T04:06:27.121 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39140.log.gz 2024-09-22T04:06:27.121 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50717.log 2024-09-22T04:06:27.121 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38058.log 2024-09-22T04:06:27.121 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.56930.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.56930.log.gz 2024-09-22T04:06:27.121 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.50717.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.50717.log.gz 2024-09-22T04:06:27.121 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30092.log 2024-09-22T04:06:27.122 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32596.log 2024-09-22T04:06:27.122 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.30092.log: /var/log/ceph/ceph-client.admin.38058.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.30092.log.gz 2024-09-22T04:06:27.122 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.38058.log.gz 2024-09-22T04:06:27.122 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71385.log 2024-09-22T04:06:27.122 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.32596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61163.log 2024-09-22T04:06:27.122 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.32596.log.gz 2024-09-22T04:06:27.122 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.71385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63020.log 2024-09-22T04:06:27.122 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.61163.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.71385.log.gz 2024-09-22T04:06:27.123 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.61163.log.gz 2024-09-22T04:06:27.123 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58718.log 2024-09-22T04:06:27.123 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58949.log 2024-09-22T04:06:27.123 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.63020.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.63020.log.gz 2024-09-22T04:06:27.123 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.58718.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.58718.log.gzgzip 2024-09-22T04:06:27.123 INFO:teuthology.orchestra.run.smithi037.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.57018.log 2024-09-22T04:06:27.124 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40026.log 2024-09-22T04:06:27.124 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.57018.log: /var/log/ceph/ceph-client.admin.58949.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.57018.log.gz 2024-09-22T04:06:27.124 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.58949.log.gz 2024-09-22T04:06:27.124 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37562.log 2024-09-22T04:06:27.124 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36739.log 2024-09-22T04:06:27.124 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.40026.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.40026.log.gz 2024-09-22T04:06:27.124 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.37562.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.37562.log.gz 2024-09-22T04:06:27.125 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65106.log 2024-09-22T04:06:27.125 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68845.log 2024-09-22T04:06:27.125 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.36739.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.36739.log.gz 2024-09-22T04:06:27.125 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.65106.log: 49.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62972.log 2024-09-22T04:06:27.125 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.65106.log.gz 2024-09-22T04:06:27.125 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59669.log 2024-09-22T04:06:27.125 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.68845.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.68845.log.gz 2024-09-22T04:06:27.126 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.62972.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45497.log 2024-09-22T04:06:27.126 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.62972.log.gz 2024-09-22T04:06:27.126 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.59669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43135.log 2024-09-22T04:06:27.126 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.59669.log.gz 2024-09-22T04:06:27.126 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.45497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56071.log 2024-09-22T04:06:27.126 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43135.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45497.log.gz 2024-09-22T04:06:27.126 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43135.log.gz 2024-09-22T04:06:27.126 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65404.log 2024-09-22T04:06:27.126 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.56071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28771.log 2024-09-22T04:06:27.126 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.56071.log.gz 2024-09-22T04:06:27.126 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.65404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42806.log 2024-09-22T04:06:27.126 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.28771.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.65404.log.gz 2024-09-22T04:06:27.127 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.28771.log.gz 2024-09-22T04:06:27.127 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45455.log 2024-09-22T04:06:27.127 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53426.log 2024-09-22T04:06:27.127 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.42806.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42806.log.gz 2024-09-22T04:06:27.127 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.45455.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45455.log.gz 2024-09-22T04:06:27.127 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43324.log 2024-09-22T04:06:27.127 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48015.log 2024-09-22T04:06:27.127 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43324.log: /var/log/ceph/ceph-client.admin.53426.log: 49.6% 50.0% -- replaced with /var/log/ceph/ceph-client.admin.43324.log.gz 2024-09-22T04:06:27.127 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.53426.log.gz 2024-09-22T04:06:27.127 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30154.log 2024-09-22T04:06:27.127 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40760.log 2024-09-22T04:06:27.127 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.48015.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.48015.log.gz/var/log/ceph/ceph-client.admin.30154.log: 2024-09-22T04:06:27.127 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.30154.log.gz 2024-09-22T04:06:27.127 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34899.log 2024-09-22T04:06:27.127 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.40760.log: 49.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52263.log 2024-09-22T04:06:27.128 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.40760.log.gz 2024-09-22T04:06:27.128 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67657.log 2024-09-22T04:06:27.128 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.34899.log: /var/log/ceph/ceph-client.admin.52263.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.52263.log.gz 2024-09-22T04:06:27.128 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.34899.log.gz 2024-09-22T04:06:27.128 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34644.log 2024-09-22T04:06:27.128 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.67657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29092.log 2024-09-22T04:06:27.128 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.67657.log.gz 2024-09-22T04:06:27.128 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.34644.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36917.log 2024-09-22T04:06:27.128 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.29092.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.34644.log.gz 2024-09-22T04:06:27.128 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29092.log.gz 2024-09-22T04:06:27.128 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40809.log 2024-09-22T04:06:27.128 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47746.log 2024-09-22T04:06:27.128 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.36917.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.36917.log.gz 2024-09-22T04:06:27.128 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.40809.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40809.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51816.log 2024-09-22T04:06:27.129 INFO:teuthology.orchestra.run.smithi037.stderr: 2024-09-22T04:06:27.129 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47786.log 2024-09-22T04:06:27.129 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.47746.log: /var/log/ceph/ceph-client.admin.51816.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.51816.log.gz 2024-09-22T04:06:27.129 INFO:teuthology.orchestra.run.smithi037.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.47746.log.gz 2024-09-22T04:06:27.129 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36481.log 2024-09-22T04:06:27.129 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.47786.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31874.log 2024-09-22T04:06:27.129 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47786.log.gz 2024-09-22T04:06:27.129 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.36481.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32181.log 2024-09-22T04:06:27.129 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.31874.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.36481.log.gz 2024-09-22T04:06:27.129 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.31874.log.gz 2024-09-22T04:06:27.129 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50950.log 2024-09-22T04:06:27.129 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55313.log 2024-09-22T04:06:27.129 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.32181.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.32181.log.gz 2024-09-22T04:06:27.129 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.50950.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.50950.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31335.log 2024-09-22T04:06:27.130 INFO:teuthology.orchestra.run.smithi037.stderr: 2024-09-22T04:06:27.130 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56582.log 2024-09-22T04:06:27.130 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.55313.log: /var/log/ceph/ceph-client.admin.31335.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.31335.log.gz 2024-09-22T04:06:27.130 INFO:teuthology.orchestra.run.smithi037.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.55313.log.gz 2024-09-22T04:06:27.130 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53151.log 2024-09-22T04:06:27.130 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.56582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.54851.log 2024-09-22T04:06:27.130 INFO:teuthology.orchestra.run.smithi037.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.56582.log.gz 2024-09-22T04:06:27.130 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.53151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36957.log 2024-09-22T04:06:27.130 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.0.54851.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.53151.log.gz 2024-09-22T04:06:27.130 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53191.log 2024-09-22T04:06:27.130 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.36957.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.36957.log.gz 2024-09-22T04:06:27.130 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40288.log 2024-09-22T04:06:27.130 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.53191.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.53191.log.gz 2024-09-22T04:06:27.130 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58549.log 2024-09-22T04:06:27.131 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.40288.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.40288.log.gz 2024-09-22T04:06:27.131 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33279.log 2024-09-22T04:06:27.131 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.58549.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.58549.log.gz 2024-09-22T04:06:27.131 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64581.log 2024-09-22T04:06:27.131 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.33279.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.33279.log.gz 2024-09-22T04:06:27.131 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35217.log 2024-09-22T04:06:27.131 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.64581.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.64581.log.gz 2024-09-22T04:06:27.131 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61701.log 2024-09-22T04:06:27.131 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.35217.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.35217.log.gz 2024-09-22T04:06:27.131 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38009.log 2024-09-22T04:06:27.131 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.61701.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.61701.log.gz 2024-09-22T04:06:27.132 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.27455.log 2024-09-22T04:06:27.132 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.38009.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.38009.log.gz 2024-09-22T04:06:27.132 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52165.log 2024-09-22T04:06:27.132 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph.tmp-client.admin.27455.log: 67.7% -- replaced with /var/log/ceph/ceph.tmp-client.admin.27455.log.gz 2024-09-22T04:06:27.132 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64312.log 2024-09-22T04:06:27.132 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.52165.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.52165.log.gz 2024-09-22T04:06:27.132 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55362.log 2024-09-22T04:06:27.132 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.64312.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.64312.log.gz 2024-09-22T04:06:27.132 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38356.log 2024-09-22T04:06:27.132 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.55362.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.55362.log.gz 2024-09-22T04:06:27.132 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51774.log 2024-09-22T04:06:27.132 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.38356.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.38356.log.gz 2024-09-22T04:06:27.132 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57147.log 2024-09-22T04:06:27.132 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.51774.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.51774.log.gz 2024-09-22T04:06:27.132 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46208.log 2024-09-22T04:06:27.132 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.57147.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.57147.log.gz 2024-09-22T04:06:27.133 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60337.log 2024-09-22T04:06:27.133 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.46208.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.46208.log.gz 2024-09-22T04:06:27.133 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41326.log 2024-09-22T04:06:27.133 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.60337.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.60337.log.gz 2024-09-22T04:06:27.133 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51208.log 2024-09-22T04:06:27.133 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.41326.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41326.log.gz 2024-09-22T04:06:27.133 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61123.log 2024-09-22T04:06:27.133 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.51208.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.51208.log.gz 2024-09-22T04:06:27.133 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31295.log 2024-09-22T04:06:27.133 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.61123.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.61123.log.gz 2024-09-22T04:06:27.133 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62376.log 2024-09-22T04:06:27.133 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.31295.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.31295.log.gz 2024-09-22T04:06:27.133 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70293.log 2024-09-22T04:06:27.133 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.62376.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.62376.log.gz 2024-09-22T04:06:27.134 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35308.log 2024-09-22T04:06:27.134 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.70293.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.70293.log.gz 2024-09-22T04:06:27.134 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42339.log 2024-09-22T04:06:27.134 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.35308.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.35308.log.gz 2024-09-22T04:06:27.134 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64361.log 2024-09-22T04:06:27.134 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.42339.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42339.log.gz 2024-09-22T04:06:27.134 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58629.log 2024-09-22T04:06:27.134 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.64361.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.64361.log.gz 2024-09-22T04:06:27.134 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29396.log 2024-09-22T04:06:27.134 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.58629.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.58629.log.gz 2024-09-22T04:06:27.134 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63961.log 2024-09-22T04:06:27.134 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.29396.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29396.log.gz 2024-09-22T04:06:27.134 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54272.log 2024-09-22T04:06:27.134 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.63961.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.63961.log.gz 2024-09-22T04:06:27.135 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36083.log 2024-09-22T04:06:27.135 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.54272.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.54272.log.gz 2024-09-22T04:06:27.135 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69999.log 2024-09-22T04:06:27.135 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.36083.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.36083.log.gz 2024-09-22T04:06:27.135 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57098.log 2024-09-22T04:06:27.135 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.69999.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.69999.log.gz 2024-09-22T04:06:27.135 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68725.log 2024-09-22T04:06:27.135 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.57098.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.57098.log.gz 2024-09-22T04:06:27.135 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61261.log 2024-09-22T04:06:27.135 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.68725.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.68725.log.gz 2024-09-22T04:06:27.135 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-22T04:06:27.136 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.61261.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.61261.log.gz 2024-09-22T04:06:27.136 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41584.log 2024-09-22T04:06:27.136 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph.log: 86.8% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-22T04:06:27.136 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60506.log 2024-09-22T04:06:27.136 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.41584.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41584.log.gz 2024-09-22T04:06:27.136 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51661.log 2024-09-22T04:06:27.136 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.60506.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.60506.log.gz 2024-09-22T04:06:27.136 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41842.log 2024-09-22T04:06:27.136 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.51661.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.51661.log.gz 2024-09-22T04:06:27.136 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60246.log 2024-09-22T04:06:27.136 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.41842.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41842.log.gz 2024-09-22T04:06:27.338 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57236.log 2024-09-22T04:06:27.338 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.60246.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.60246.log.gz 2024-09-22T04:06:27.338 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45637.log 2024-09-22T04:06:27.338 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.57236.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.57236.log.gz 2024-09-22T04:06:27.338 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52562.log 2024-09-22T04:06:27.338 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.45637.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45637.log.gz 2024-09-22T04:06:27.339 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59013.log 2024-09-22T04:06:27.339 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.52562.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.52562.log.gz 2024-09-22T04:06:27.339 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39902.log 2024-09-22T04:06:27.339 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.59013.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.59013.log.gz 2024-09-22T04:06:27.339 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69333.log 2024-09-22T04:06:27.339 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.39902.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.39902.log.gz 2024-09-22T04:06:27.339 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65364.log 2024-09-22T04:06:27.339 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.69333.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.69333.log.gz 2024-09-22T04:06:27.339 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38763.log 2024-09-22T04:06:27.339 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.65364.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.65364.log.gz 2024-09-22T04:06:27.339 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62164.log 2024-09-22T04:06:27.339 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.38763.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.38763.log.gz 2024-09-22T04:06:27.340 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31745.log 2024-09-22T04:06:27.340 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.62164.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.62164.log.gz 2024-09-22T04:06:27.340 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47806.log 2024-09-22T04:06:27.340 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.31745.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.31745.log.gz 2024-09-22T04:06:27.340 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64928.log 2024-09-22T04:06:27.340 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.47806.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47806.log.gz 2024-09-22T04:06:27.340 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59282.log 2024-09-22T04:06:27.340 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.64928.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.64928.log.gz 2024-09-22T04:06:27.340 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46775.log 2024-09-22T04:06:27.340 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.59282.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.59282.log.gz 2024-09-22T04:06:27.340 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42279.log 2024-09-22T04:06:27.340 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.46775.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.46775.log.gz 2024-09-22T04:06:27.340 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63656.log 2024-09-22T04:06:27.340 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.42279.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42279.log.gz 2024-09-22T04:06:27.340 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67212.log 2024-09-22T04:06:27.340 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.63656.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.63656.log.gz 2024-09-22T04:06:27.341 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62929.log 2024-09-22T04:06:27.341 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.67212.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.67212.log.gz 2024-09-22T04:06:27.341 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40195.log 2024-09-22T04:06:27.341 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.62929.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.62929.log.gz 2024-09-22T04:06:27.341 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42904.log 2024-09-22T04:06:27.341 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.40195.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.40195.log.gz 2024-09-22T04:06:27.341 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41197.log 2024-09-22T04:06:27.341 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.42904.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42904.log.gz 2024-09-22T04:06:27.341 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68117.log 2024-09-22T04:06:27.341 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.41197.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41197.log.gz 2024-09-22T04:06:27.341 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58102.log 2024-09-22T04:06:27.341 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.68117.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.68117.log.gz 2024-09-22T04:06:27.341 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51907.log 2024-09-22T04:06:27.341 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.58102.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.58102.log.gz 2024-09-22T04:06:27.341 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43364.log 2024-09-22T04:06:27.341 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.51907.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.51907.log.gz 2024-09-22T04:06:27.342 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36530.log 2024-09-22T04:06:27.342 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43364.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43364.log.gz 2024-09-22T04:06:27.342 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37175.log 2024-09-22T04:06:27.342 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.36530.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.36530.log.gz 2024-09-22T04:06:27.342 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45266.log 2024-09-22T04:06:27.342 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.37175.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.37175.log.gz 2024-09-22T04:06:27.342 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50808.log 2024-09-22T04:06:27.342 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.45266.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45266.log.gz 2024-09-22T04:06:27.342 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70731.log 2024-09-22T04:06:27.342 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.50808.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.50808.log.gz 2024-09-22T04:06:27.342 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51417.log 2024-09-22T04:06:27.342 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.70731.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.70731.log.gz 2024-09-22T04:06:27.342 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71175.log 2024-09-22T04:06:27.342 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.51417.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.51417.log.gz 2024-09-22T04:06:27.343 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33199.log 2024-09-22T04:06:27.343 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.71175.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.71175.log.gz 2024-09-22T04:06:27.343 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63698.log 2024-09-22T04:06:27.343 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.33199.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.33199.log.gz 2024-09-22T04:06:27.343 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31605.log 2024-09-22T04:06:27.343 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.63698.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.63698.log.gz 2024-09-22T04:06:27.343 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32931.log 2024-09-22T04:06:27.343 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.31605.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.31605.log.gz 2024-09-22T04:06:27.343 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41455.log 2024-09-22T04:06:27.343 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.32931.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.32931.log.gz 2024-09-22T04:06:27.343 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37820.log 2024-09-22T04:06:27.343 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.41455.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41455.log.gz 2024-09-22T04:06:27.343 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29732.log 2024-09-22T04:06:27.343 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.37820.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.37820.log.gz 2024-09-22T04:06:27.343 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68375.log 2024-09-22T04:06:27.344 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.29732.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29732.log.gz 2024-09-22T04:06:27.344 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53360.log 2024-09-22T04:06:27.344 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.68375.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.68375.log.gz 2024-09-22T04:06:27.344 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64054.log 2024-09-22T04:06:27.344 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.53360.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.53360.log.gz 2024-09-22T04:06:27.344 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31555.log 2024-09-22T04:06:27.344 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.64054.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.64054.log.gz 2024-09-22T04:06:27.344 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66467.log 2024-09-22T04:06:27.344 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.31555.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.31555.log.gz 2024-09-22T04:06:27.344 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40671.log 2024-09-22T04:06:27.344 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.66467.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.66467.log.gz 2024-09-22T04:06:27.345 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36212.log 2024-09-22T04:06:27.345 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.40671.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40671.log.gz 2024-09-22T04:06:27.345 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48968.log 2024-09-22T04:06:27.345 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.36212.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.36212.log.gz 2024-09-22T04:06:27.345 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39093.log 2024-09-22T04:06:27.345 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.48968.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.48968.log.gz 2024-09-22T04:06:27.345 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33715.log 2024-09-22T04:06:27.345 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.39093.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.39093.log.gz 2024-09-22T04:06:27.345 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38852.log 2024-09-22T04:06:27.345 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.33715.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.33715.log.gz 2024-09-22T04:06:27.345 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56031.log 2024-09-22T04:06:27.345 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.38852.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.38852.log.gz 2024-09-22T04:06:27.345 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40106.log 2024-09-22T04:06:27.345 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.56031.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.56031.log.gz 2024-09-22T04:06:27.345 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58361.log 2024-09-22T04:06:27.346 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.40106.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40106.log.gz 2024-09-22T04:06:27.346 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40631.log 2024-09-22T04:06:27.346 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.58361.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.58361.log.gz 2024-09-22T04:06:27.346 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43931.log 2024-09-22T04:06:27.346 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.40631.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.40631.log.gz 2024-09-22T04:06:27.346 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71301.log 2024-09-22T04:06:27.346 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43931.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43931.log.gz 2024-09-22T04:06:27.346 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29393.log 2024-09-22T04:06:27.346 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.71301.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.71301.log.gz 2024-09-22T04:06:27.346 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39418.log 2024-09-22T04:06:27.346 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.29393.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29393.log.gz 2024-09-22T04:06:27.346 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44518.log 2024-09-22T04:06:27.346 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.39418.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.39418.log.gz 2024-09-22T04:06:27.346 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32261.log 2024-09-22T04:06:27.347 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.44518.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44518.log.gz 2024-09-22T04:06:27.347 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52913.log 2024-09-22T04:06:27.347 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.32261.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.32261.log.gz 2024-09-22T04:06:27.347 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48145.log 2024-09-22T04:06:27.347 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.52913.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.52913.log.gz 2024-09-22T04:06:27.347 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42766.log 2024-09-22T04:06:27.347 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.48145.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.48145.log.gz 2024-09-22T04:06:27.347 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44825.log 2024-09-22T04:06:27.347 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.42766.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42766.log.gz 2024-09-22T04:06:27.347 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67879.log 2024-09-22T04:06:27.347 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.44825.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44825.log.gz 2024-09-22T04:06:27.347 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44908.log 2024-09-22T04:06:27.347 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.67879.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.67879.log.gz 2024-09-22T04:06:27.347 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30391.log 2024-09-22T04:06:27.348 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.44908.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44908.log.gz 2024-09-22T04:06:27.348 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51110.log 2024-09-22T04:06:27.348 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.30391.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.30391.log.gz 2024-09-22T04:06:27.348 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44727.log 2024-09-22T04:06:27.348 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.51110.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.51110.log.gz 2024-09-22T04:06:27.348 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42021.log 2024-09-22T04:06:27.348 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.44727.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44727.log.gz 2024-09-22T04:06:27.348 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64223.log 2024-09-22T04:06:27.348 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.42021.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42021.log.gz 2024-09-22T04:06:27.348 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48451.log 2024-09-22T04:06:27.348 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.64223.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.64223.log.gz 2024-09-22T04:06:27.348 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38932.log 2024-09-22T04:06:27.348 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.48451.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.48451.log.gz 2024-09-22T04:06:27.348 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34420.log 2024-09-22T04:06:27.349 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.38932.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.38932.log.gz 2024-09-22T04:06:27.349 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47345.log 2024-09-22T04:06:27.349 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.34420.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.34420.log.gz 2024-09-22T04:06:27.349 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35776.log 2024-09-22T04:06:27.349 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.47345.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.47345.log.gz 2024-09-22T04:06:27.349 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56840.log 2024-09-22T04:06:27.349 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.35776.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.35776.log.gz 2024-09-22T04:06:27.349 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34469.log 2024-09-22T04:06:27.349 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.56840.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.56840.log.gz 2024-09-22T04:06:27.349 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54014.log 2024-09-22T04:06:27.349 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.34469.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.34469.log.gz 2024-09-22T04:06:27.349 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55713.log 2024-09-22T04:06:27.349 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.54014.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.54014.log.gz 2024-09-22T04:06:27.349 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45315.log 2024-09-22T04:06:27.349 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.55713.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.55713.log.gz 2024-09-22T04:06:27.350 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68019.log 2024-09-22T04:06:27.350 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.45315.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45315.log.gz 2024-09-22T04:06:27.350 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49495.log 2024-09-22T04:06:27.350 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.68019.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.68019.log.gz 2024-09-22T04:06:27.350 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37433.log 2024-09-22T04:06:27.350 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.49495.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.49495.log.gz 2024-09-22T04:06:27.350 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44200.log 2024-09-22T04:06:27.350 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.37433.log: 47.6% -- replaced with /var/log/ceph/ceph-client.admin.37433.log.gz 2024-09-22T04:06:27.350 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43842.log 2024-09-22T04:06:27.350 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.44200.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.44200.log.gz 2024-09-22T04:06:27.350 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47666.log 2024-09-22T04:06:27.350 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43842.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.43842.log.gz 2024-09-22T04:06:27.351 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58225.log 2024-09-22T04:06:27.351 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.47666.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.47666.log.gz 2024-09-22T04:06:27.351 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40126.log 2024-09-22T04:06:27.351 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.58225.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.58225.log.gz 2024-09-22T04:06:27.351 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38178.log 2024-09-22T04:06:27.351 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.40126.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40126.log.gz 2024-09-22T04:06:27.351 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56160.log 2024-09-22T04:06:27.351 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.38178.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.38178.log.gz 2024-09-22T04:06:27.351 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42477.log 2024-09-22T04:06:27.351 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.56160.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.56160.log.gz 2024-09-22T04:06:27.351 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56251.log 2024-09-22T04:06:27.351 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.42477.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42477.log.gz 2024-09-22T04:06:27.351 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56300.log 2024-09-22T04:06:27.352 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.56251.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.56251.log.gz 2024-09-22T04:06:27.352 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42199.log 2024-09-22T04:06:27.352 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.56300.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.56300.log.gz 2024-09-22T04:06:27.352 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68641.log 2024-09-22T04:06:27.352 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.42199.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42199.log.gz 2024-09-22T04:06:27.352 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49994.log 2024-09-22T04:06:27.352 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.68641.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.68641.log.gz 2024-09-22T04:06:27.352 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54490.log 2024-09-22T04:06:27.352 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.49994.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.49994.log.gz 2024-09-22T04:06:27.352 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51248.log 2024-09-22T04:06:27.352 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.54490.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.54490.log.gz 2024-09-22T04:06:27.352 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69193.log 2024-09-22T04:06:27.352 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.51248.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.51248.log.gz 2024-09-22T04:06:27.352 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53618.log 2024-09-22T04:06:27.353 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.69193.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.69193.log.gz 2024-09-22T04:06:27.353 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40502.log 2024-09-22T04:06:27.353 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.53618.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.53618.log.gz 2024-09-22T04:06:27.353 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59460.log 2024-09-22T04:06:27.353 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.40502.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40502.log.gz 2024-09-22T04:06:27.353 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55991.log 2024-09-22T04:06:27.353 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.59460.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.59460.log.gz 2024-09-22T04:06:27.353 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50362.log 2024-09-22T04:06:27.353 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.55991.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.55991.log.gz 2024-09-22T04:06:27.353 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69914.log 2024-09-22T04:06:27.353 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.50362.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.50362.log.gz 2024-09-22T04:06:27.353 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40413.log 2024-09-22T04:06:27.354 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.69914.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.69914.log.gz 2024-09-22T04:06:27.354 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50320.log 2024-09-22T04:06:27.354 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.40413.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40413.log.gz 2024-09-22T04:06:27.354 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53053.log 2024-09-22T04:06:27.354 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.50320.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.50320.log.gz 2024-09-22T04:06:27.354 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29882.log 2024-09-22T04:06:27.354 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.53053.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.53053.log.gz 2024-09-22T04:06:27.354 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54395.log 2024-09-22T04:06:27.354 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.29882.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29882.log.gz 2024-09-22T04:06:27.354 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32891.log 2024-09-22T04:06:27.355 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.54395.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.54395.log.gz 2024-09-22T04:06:27.355 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67530.log 2024-09-22T04:06:27.355 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.32891.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.32891.log.gz 2024-09-22T04:06:27.355 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37631.log 2024-09-22T04:06:27.355 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.67530.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.67530.log.gz 2024-09-22T04:06:27.355 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44687.log 2024-09-22T04:06:27.355 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.37631.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.37631.log.gz 2024-09-22T04:06:27.355 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63110.log 2024-09-22T04:06:27.355 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.44687.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44687.log.gz 2024-09-22T04:06:27.355 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59939.log 2024-09-22T04:06:27.355 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.63110.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.63110.log.gz 2024-09-22T04:06:27.355 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58411.log 2024-09-22T04:06:27.355 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.59939.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.59939.log.gz 2024-09-22T04:06:27.356 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54232.log 2024-09-22T04:06:27.356 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.58411.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.58411.log.gz 2024-09-22T04:06:27.356 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43624.log 2024-09-22T04:06:27.356 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.54232.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.54232.log.gz 2024-09-22T04:06:27.356 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69871.log 2024-09-22T04:06:27.356 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43624.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43624.log.gz 2024-09-22T04:06:27.356 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40551.log 2024-09-22T04:06:27.356 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.69871.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.69871.log.gz 2024-09-22T04:06:27.356 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63378.log 2024-09-22T04:06:27.356 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.40551.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40551.log.gz 2024-09-22T04:06:27.356 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46643.log 2024-09-22T04:06:27.356 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.63378.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.63378.log.gz 2024-09-22T04:06:27.356 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36788.log 2024-09-22T04:06:27.356 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.46643.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46643.log.gz 2024-09-22T04:06:27.357 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51640.log 2024-09-22T04:06:27.357 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.36788.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.36788.log.gz 2024-09-22T04:06:27.357 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37493.log 2024-09-22T04:06:27.357 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.51640.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.51640.log.gz 2024-09-22T04:06:27.357 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62593.log 2024-09-22T04:06:27.357 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.37493.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.37493.log.gz 2024-09-22T04:06:27.357 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63917.log 2024-09-22T04:06:27.357 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.62593.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.62593.log.gz 2024-09-22T04:06:27.357 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50411.log 2024-09-22T04:06:27.357 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.63917.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.63917.log.gz 2024-09-22T04:06:27.357 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53231.log 2024-09-22T04:06:27.357 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.50411.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.50411.log.gz 2024-09-22T04:06:27.357 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39458.log 2024-09-22T04:06:27.357 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.53231.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.53231.log.gz 2024-09-22T04:06:27.358 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35687.log 2024-09-22T04:06:27.358 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.39458.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.39458.log.gz 2024-09-22T04:06:27.358 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30876.log 2024-09-22T04:06:27.358 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.35687.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.35687.log.gz 2024-09-22T04:06:27.358 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35077.log 2024-09-22T04:06:27.358 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.30876.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.30876.log.gz 2024-09-22T04:06:27.358 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32575.log 2024-09-22T04:06:27.358 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.35077.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.35077.log.gz 2024-09-22T04:06:27.358 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55006.log 2024-09-22T04:06:27.358 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.32575.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.32575.log.gz 2024-09-22T04:06:27.358 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64759.log 2024-09-22T04:06:27.358 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.55006.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.55006.log.gz 2024-09-22T04:06:27.358 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41535.log 2024-09-22T04:06:27.358 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.64759.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.64759.log.gz 2024-09-22T04:06:27.359 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35867.log 2024-09-22T04:06:27.359 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.41535.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41535.log.gz 2024-09-22T04:06:27.359 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60197.log 2024-09-22T04:06:27.359 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.35867.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.35867.log.gz 2024-09-22T04:06:27.359 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62455.log 2024-09-22T04:06:27.359 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.60197.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.60197.log.gz 2024-09-22T04:06:27.359 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65582.log 2024-09-22T04:06:27.359 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.62455.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.62455.log.gz 2024-09-22T04:06:27.359 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48491.log 2024-09-22T04:06:27.359 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.65582.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.65582.log.gz 2024-09-22T04:06:27.359 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44954.log 2024-09-22T04:06:27.359 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.48491.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.48491.log.gz 2024-09-22T04:06:27.359 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39280.log 2024-09-22T04:06:27.360 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.44954.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44954.log.gz 2024-09-22T04:06:27.360 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32982.log 2024-09-22T04:06:27.360 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.39280.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39280.log.gz 2024-09-22T04:06:27.360 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28614.log 2024-09-22T04:06:27.360 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.32982.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.32982.log.gz 2024-09-22T04:06:27.360 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37135.log 2024-09-22T04:06:27.360 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.28614.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.28614.log.gz 2024-09-22T04:06:27.360 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55951.log 2024-09-22T04:06:27.360 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.37135.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.37135.log.gz 2024-09-22T04:06:27.360 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41277.log 2024-09-22T04:06:27.360 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.55951.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.55951.log.gz 2024-09-22T04:06:27.360 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70251.log 2024-09-22T04:06:27.360 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.41277.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41277.log.gz 2024-09-22T04:06:27.360 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43582.log 2024-09-22T04:06:27.361 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.70251.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.70251.log.gz 2024-09-22T04:06:27.361 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63856.log 2024-09-22T04:06:27.361 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43582.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.43582.log.gz 2024-09-22T04:06:27.361 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30050.log 2024-09-22T04:06:27.361 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.63856.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.63856.log.gz 2024-09-22T04:06:27.361 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34553.log 2024-09-22T04:06:27.361 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.30050.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.30050.log.gz 2024-09-22T04:06:27.361 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51486.log 2024-09-22T04:06:27.361 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.34553.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.34553.log.gz 2024-09-22T04:06:27.361 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30827.log 2024-09-22T04:06:27.361 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.51486.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.51486.log.gz 2024-09-22T04:06:27.361 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36432.log 2024-09-22T04:06:27.361 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.30827.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.30827.log.gz 2024-09-22T04:06:27.361 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60457.log 2024-09-22T04:06:27.362 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.36432.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.36432.log.gz 2024-09-22T04:06:27.362 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37353.log 2024-09-22T04:06:27.362 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.60457.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.60457.log.gz 2024-09-22T04:06:27.362 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29731.log 2024-09-22T04:06:27.362 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.37353.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.37353.log.gz 2024-09-22T04:06:27.362 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66238.log 2024-09-22T04:06:27.362 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.29731.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29731.log.gz 2024-09-22T04:06:27.362 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66149.log 2024-09-22T04:06:27.362 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.66238.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.66238.log.gz 2024-09-22T04:06:27.362 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48750.log 2024-09-22T04:06:27.362 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.66149.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.66149.log.gz 2024-09-22T04:06:27.362 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50040.log 2024-09-22T04:06:27.362 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.48750.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.48750.log.gz 2024-09-22T04:06:27.362 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64143.log 2024-09-22T04:06:27.363 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.50040.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.50040.log.gz 2024-09-22T04:06:27.363 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45993.log 2024-09-22T04:06:27.363 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.64143.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.64143.log.gz 2024-09-22T04:06:27.363 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40849.log 2024-09-22T04:06:27.363 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.45993.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.45993.log.gz 2024-09-22T04:06:27.363 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46013.log 2024-09-22T04:06:27.363 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.40849.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40849.log.gz 2024-09-22T04:06:27.363 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43533.log 2024-09-22T04:06:27.363 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.46013.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46013.log.gz 2024-09-22T04:06:27.363 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30008.log 2024-09-22T04:06:27.363 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43533.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43533.log.gz 2024-09-22T04:06:27.363 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51070.log 2024-09-22T04:06:27.363 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.30008.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.30008.log.gz 2024-09-22T04:06:27.363 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55055.log 2024-09-22T04:06:27.364 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.51070.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.51070.log.gz 2024-09-22T04:06:27.364 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36570.log 2024-09-22T04:06:27.364 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.55055.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.55055.log.gz 2024-09-22T04:06:27.364 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65840.log 2024-09-22T04:06:27.364 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.36570.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.36570.log.gz 2024-09-22T04:06:27.364 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46084.log 2024-09-22T04:06:27.364 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.65840.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.65840.log.gz 2024-09-22T04:06:27.364 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58858.log 2024-09-22T04:06:27.364 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.46084.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.46084.log.gz 2024-09-22T04:06:27.364 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49913.log 2024-09-22T04:06:27.364 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.58858.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.58858.log.gz 2024-09-22T04:06:27.364 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49097.log 2024-09-22T04:06:27.364 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.49913.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.49913.log.gz 2024-09-22T04:06:27.364 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39329.log 2024-09-22T04:06:27.365 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.49097.log: 48.0% -- replaced with /var/log/ceph/ceph-client.admin.49097.log.gz 2024-09-22T04:06:27.365 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60077.log 2024-09-22T04:06:27.365 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.39329.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39329.log.gz 2024-09-22T04:06:27.365 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36997.log 2024-09-22T04:06:27.365 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.60077.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.60077.log.gz 2024-09-22T04:06:27.365 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63338.log 2024-09-22T04:06:27.365 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.36997.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.36997.log.gz 2024-09-22T04:06:27.365 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38098.log 2024-09-22T04:06:27.365 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.63338.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.63338.log.gz 2024-09-22T04:06:27.365 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52080.log 2024-09-22T04:06:27.366 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.38098.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.38098.log.gz 2024-09-22T04:06:27.366 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48531.log 2024-09-22T04:06:27.366 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.52080.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.52080.log.gz 2024-09-22T04:06:27.366 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37918.log 2024-09-22T04:06:27.366 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.48531.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.48531.log.gz 2024-09-22T04:06:27.366 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31157.log 2024-09-22T04:06:27.366 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.37918.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.37918.log.gz 2024-09-22T04:06:27.366 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55104.log 2024-09-22T04:06:27.366 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.31157.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.31157.log.gz 2024-09-22T04:06:27.366 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38972.log 2024-09-22T04:06:27.366 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.55104.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.55104.log.gz 2024-09-22T04:06:27.366 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57884.log 2024-09-22T04:06:27.366 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.38972.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.38972.log.gz 2024-09-22T04:06:27.366 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59848.log 2024-09-22T04:06:27.367 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.57884.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.57884.log.gz 2024-09-22T04:06:27.367 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46125.log 2024-09-22T04:06:27.367 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.59848.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.59848.log.gz 2024-09-22T04:06:27.367 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32492.log 2024-09-22T04:06:27.367 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.46125.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.46125.log.gz 2024-09-22T04:06:27.367 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38714.log 2024-09-22T04:06:27.367 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.32492.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.32492.log.gz 2024-09-22T04:06:27.367 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32800.log 2024-09-22T04:06:27.367 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.38714.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.38714.log.gz 2024-09-22T04:06:27.367 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36877.log 2024-09-22T04:06:27.367 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.32800.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.32800.log.gz 2024-09-22T04:06:27.368 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38399.log 2024-09-22T04:06:27.368 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.36877.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.36877.log.gz 2024-09-22T04:06:27.368 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63298.log 2024-09-22T04:06:27.368 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.38399.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.38399.log.gz 2024-09-22T04:06:27.368 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69427.log 2024-09-22T04:06:27.368 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.63298.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.63298.log.gz 2024-09-22T04:06:27.368 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52438.log 2024-09-22T04:06:27.368 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.69427.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.69427.log.gz 2024-09-22T04:06:27.368 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41892.log 2024-09-22T04:06:27.368 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.52438.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.52438.log.gz 2024-09-22T04:06:27.368 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34768.log 2024-09-22T04:06:27.368 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.41892.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41892.log.gz 2024-09-22T04:06:27.368 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43086.log 2024-09-22T04:06:27.369 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.34768.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.34768.log.gz 2024-09-22T04:06:27.369 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58062.log 2024-09-22T04:06:27.369 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43086.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.43086.log.gz 2024-09-22T04:06:27.369 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62811.log 2024-09-22T04:06:27.369 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.58062.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.58062.log.gz 2024-09-22T04:06:27.369 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57405.log 2024-09-22T04:06:27.369 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.62811.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.62811.log.gz 2024-09-22T04:06:27.369 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41375.log 2024-09-22T04:06:27.369 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.57405.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.57405.log.gz 2024-09-22T04:06:27.369 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59718.log 2024-09-22T04:06:27.369 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.41375.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41375.log.gz 2024-09-22T04:06:27.369 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67172.log 2024-09-22T04:06:27.369 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.59718.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.59718.log.gz 2024-09-22T04:06:27.369 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62030.log 2024-09-22T04:06:27.369 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.67172.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.67172.log.gz 2024-09-22T04:06:27.370 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55853.log 2024-09-22T04:06:27.370 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.62030.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.62030.log.gz 2024-09-22T04:06:27.370 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54441.log 2024-09-22T04:06:27.370 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.55853.log: 47.6% -- replaced with /var/log/ceph/ceph-client.admin.55853.log.gz 2024-09-22T04:06:27.370 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46521.log 2024-09-22T04:06:27.370 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.54441.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.54441.log.gz 2024-09-22T04:06:27.370 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62553.log 2024-09-22T04:06:27.370 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.46521.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.46521.log.gz 2024-09-22T04:06:27.370 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32052.log 2024-09-22T04:06:27.370 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.62553.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.62553.log.gz 2024-09-22T04:06:27.370 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42724.log 2024-09-22T04:06:27.370 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.32052.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.32052.log.gz 2024-09-22T04:06:27.370 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57804.log 2024-09-22T04:06:27.371 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.42724.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42724.log.gz 2024-09-22T04:06:27.371 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35391.log 2024-09-22T04:06:27.371 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.57804.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.57804.log.gz 2024-09-22T04:06:27.371 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30618.log 2024-09-22T04:06:27.371 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.35391.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.35391.log.gz 2024-09-22T04:06:27.371 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64621.log 2024-09-22T04:06:27.371 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.30618.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.30618.log.gz 2024-09-22T04:06:27.371 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34573.log 2024-09-22T04:06:27.371 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.64621.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.64621.log.gz 2024-09-22T04:06:27.371 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44560.log 2024-09-22T04:06:27.371 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.34573.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.34573.log.gz 2024-09-22T04:06:27.371 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67788.log 2024-09-22T04:06:27.371 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.44560.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44560.log.gz 2024-09-22T04:06:27.371 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40889.log 2024-09-22T04:06:27.371 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.67788.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.67788.log.gz 2024-09-22T04:06:27.372 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29564.log 2024-09-22T04:06:27.372 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.40889.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40889.log.gz 2024-09-22T04:06:27.372 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42319.log 2024-09-22T04:06:27.372 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.29564.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29564.log.gz 2024-09-22T04:06:27.372 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60117.log 2024-09-22T04:06:27.372 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.42319.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42319.log.gz 2024-09-22T04:06:27.372 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67252.log 2024-09-22T04:06:27.372 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.60117.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.60117.log.gz 2024-09-22T04:06:27.372 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60377.log 2024-09-22T04:06:27.372 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.67252.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.67252.log.gz 2024-09-22T04:06:27.372 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65931.log 2024-09-22T04:06:27.372 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.60377.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.60377.log.gz 2024-09-22T04:06:27.372 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67571.log 2024-09-22T04:06:27.372 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.65931.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.65931.log.gz 2024-09-22T04:06:27.373 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.62398.log 2024-09-22T04:06:27.373 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.67571.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.67571.log.gz 2024-09-22T04:06:27.373 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65533.log 2024-09-22T04:06:27.373 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.0.62398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43444.log 2024-09-22T04:06:27.373 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.65533.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.65533.log.gz 2024-09-22T04:06:27.373 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57356.log 2024-09-22T04:06:27.373 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43444.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.43444.log.gz 2024-09-22T04:06:27.374 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59202.log 2024-09-22T04:06:27.374 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.57356.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.57356.log.gz 2024-09-22T04:06:27.374 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53876.log 2024-09-22T04:06:27.374 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.59202.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.59202.log.gz 2024-09-22T04:06:27.376 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56711.log 2024-09-22T04:06:27.376 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.53876.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.53876.log.gz 2024-09-22T04:06:27.385 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65464.log 2024-09-22T04:06:27.385 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.56711.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.56711.log.gz 2024-09-22T04:06:27.405 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51557.log 2024-09-22T04:06:27.405 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.65464.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.65464.log.gz 2024-09-22T04:06:27.414 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59411.log 2024-09-22T04:06:27.414 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.51557.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.51557.log.gz 2024-09-22T04:06:27.432 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65710.log 2024-09-22T04:06:27.432 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.59411.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.59411.log.gz 2024-09-22T04:06:27.441 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39636.log 2024-09-22T04:06:27.441 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.65710.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.65710.log.gz 2024-09-22T04:06:27.453 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66109.log 2024-09-22T04:06:27.453 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.39636.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.39636.log.gz 2024-09-22T04:06:27.469 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29117.log 2024-09-22T04:06:27.469 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.66109.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.66109.log.gz 2024-09-22T04:06:27.480 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45175.log 2024-09-22T04:06:27.480 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.29117.log: 66.9% -- replaced with /var/log/ceph/ceph-client.admin.29117.log.gz 2024-09-22T04:06:27.490 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36292.log 2024-09-22T04:06:27.490 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.45175.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45175.log.gz 2024-09-22T04:06:27.505 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36172.log 2024-09-22T04:06:27.505 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.36292.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.36292.log.gz 2024-09-22T04:06:27.524 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51288.log 2024-09-22T04:06:27.524 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.36172.log: 47.6% -- replaced with /var/log/ceph/ceph-client.admin.36172.log.gz 2024-09-22T04:06:27.533 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57964.log 2024-09-22T04:06:27.542 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.51288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54054.log 2024-09-22T04:06:27.546 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.57964.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.51288.log.gz 2024-09-22T04:06:27.551 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50901.log 2024-09-22T04:06:27.555 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.54054.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.57964.log.gz 2024-09-22T04:06:27.563 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46450.log 2024-09-22T04:06:27.564 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.50901.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.50901.log.gz 2024-09-22T04:06:27.564 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.54054.log.gz 2024-09-22T04:06:27.572 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53271.log 2024-09-22T04:06:27.582 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.46450.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29252.log 2024-09-22T04:06:27.582 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.53271.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.53271.log.gz 2024-09-22T04:06:27.582 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.46450.log.gz 2024-09-22T04:06:27.590 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40373.log 2024-09-22T04:06:27.599 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.29252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49455.log 2024-09-22T04:06:27.599 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.40373.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40373.log.gz 2024-09-22T04:06:27.603 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29252.log.gz 2024-09-22T04:06:27.608 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66696.log 2024-09-22T04:06:27.619 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.49455.log: 50.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35825.log 2024-09-22T04:06:27.619 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.66696.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.66696.log.gz 2024-09-22T04:06:27.620 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.49455.log.gz 2024-09-22T04:06:27.635 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68277.log 2024-09-22T04:06:27.635 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.35825.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.35825.log.gz 2024-09-22T04:06:27.646 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37393.log 2024-09-22T04:06:27.646 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.68277.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.68277.log.gz 2024-09-22T04:06:27.655 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64968.log 2024-09-22T04:06:27.668 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.37393.log: /var/log/ceph/ceph-client.admin.64968.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.37393.log.gz 2024-09-22T04:06:27.677 INFO:teuthology.orchestra.run.smithi037.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.64968.log.gz 2024-09-22T04:06:27.725 INFO:teuthology.orchestra.run.smithi037.stderr: 89.6% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-22T04:06:28.038 INFO:teuthology.orchestra.run.smithi037.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.0.30421.log.gz 2024-09-22T04:06:28.136 INFO:teuthology.orchestra.run.smithi037.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.0.38566.log.gz 2024-09-22T04:06:28.298 INFO:teuthology.orchestra.run.smithi037.stderr: 92.8% -- replaced with /var/log/ceph/ceph-client.0.54851.log.gz 2024-09-22T04:06:28.348 INFO:teuthology.orchestra.run.smithi037.stderr: 92.8% -- replaced with /var/log/ceph/ceph-client.0.46542.log.gz 2024-09-22T04:06:28.384 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2024-09-22T04:06:28.517 INFO:teuthology.orchestra.run.smithi037.stderr: 92.8% -- replaced with /var/log/ceph/ceph-client.0.62398.log.gz 2024-09-22T04:06:57.656 INFO:teuthology.orchestra.run.smithi098.stderr: 92.3% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-22T04:06:59.612 INFO:teuthology.orchestra.run.smithi037.stderr: 92.1% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-22T04:07:01.250 INFO:teuthology.orchestra.run.smithi037.stderr: 92.3% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-22T04:07:01.252 INFO:teuthology.orchestra.run.smithi037.stderr: 2024-09-22T04:07:01.252 INFO:teuthology.orchestra.run.smithi037.stderr:real 0m34.540s 2024-09-22T04:07:01.252 INFO:teuthology.orchestra.run.smithi037.stderr:user 1m12.761s 2024-09-22T04:07:01.252 INFO:teuthology.orchestra.run.smithi037.stderr:sys 0m2.694s 2024-09-22T04:07:01.293 INFO:teuthology.orchestra.run.smithi098.stderr: 92.2% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-22T04:07:01.295 INFO:teuthology.orchestra.run.smithi098.stderr: 2024-09-22T04:07:01.295 INFO:teuthology.orchestra.run.smithi098.stderr:real 0m34.545s 2024-09-22T04:07:01.295 INFO:teuthology.orchestra.run.smithi098.stderr:user 1m3.253s 2024-09-22T04:07:01.295 INFO:teuthology.orchestra.run.smithi098.stderr:sys 0m2.200s 2024-09-22T04:07:01.295 INFO:tasks.ceph:Archiving logs... 2024-09-22T04:07:01.295 DEBUG:teuthology.misc:Transferring archived files from smithi037:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-21_20:56:02-crimson-rados-main-distro-crimson-smithi/7914381/remote/smithi037/log 2024-09-22T04:07:01.296 DEBUG:teuthology.orchestra.run.smithi037:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-22T04:07:12.361 DEBUG:teuthology.misc:Transferring archived files from smithi098:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-21_20:56:02-crimson-rados-main-distro-crimson-smithi/7914381/remote/smithi098/log 2024-09-22T04:07:12.362 DEBUG:teuthology.orchestra.run.smithi098:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-22T04:07:22.249 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-22T04:07:22.270 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-22T04:07:22.270 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-22T04:07:22.273 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-22T04:07:22.351 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-22T04:07:22.359 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-22T04:07:22.359 DEBUG:teuthology.orchestra.run.smithi037:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-22T04:07:22.362 DEBUG:teuthology.orchestra.run.smithi098:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-22T04:07:22.376 INFO:teuthology.orchestra.run.smithi098.stderr:bash: line 1: ntpq: command not found 2024-09-22T04:07:22.376 INFO:teuthology.orchestra.run.smithi037.stderr:bash: line 1: ntpq: command not found 2024-09-22T04:07:22.380 INFO:teuthology.orchestra.run.smithi098.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-22T04:07:22.380 INFO:teuthology.orchestra.run.smithi098.stdout:=============================================================================== 2024-09-22T04:07:22.380 INFO:teuthology.orchestra.run.smithi098.stdout:^* hv01.front.sepia.ceph.com 3 6 377 64 -480us[ -521us] +/- 49ms 2024-09-22T04:07:22.380 INFO:teuthology.orchestra.run.smithi098.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 1 +962us[ +962us] +/- 58ms 2024-09-22T04:07:22.380 INFO:teuthology.orchestra.run.smithi098.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 1 -499us[ -499us] +/- 64ms 2024-09-22T04:07:22.380 INFO:teuthology.orchestra.run.smithi098.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-22T04:07:22.382 INFO:teuthology.orchestra.run.smithi037.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-22T04:07:22.382 INFO:teuthology.orchestra.run.smithi037.stdout:=============================================================================== 2024-09-22T04:07:22.382 INFO:teuthology.orchestra.run.smithi037.stdout:^* hv01.front.sepia.ceph.com 3 6 377 64 -499us[ -498us] +/- 49ms 2024-09-22T04:07:22.382 INFO:teuthology.orchestra.run.smithi037.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 64 +918us[ +918us] +/- 57ms 2024-09-22T04:07:22.382 INFO:teuthology.orchestra.run.smithi037.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 62 -524us[ -524us] +/- 63ms 2024-09-22T04:07:22.382 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-22T04:07:22.382 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-22T04:07:22.391 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-22T04:07:22.391 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-22T04:07:22.398 DEBUG:teuthology.orchestra.run.smithi037:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-22T04:07:22.512 DEBUG:teuthology.orchestra.run.smithi098:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-22T04:07:22.572 DEBUG:teuthology.orchestra.run.smithi037:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-22T04:07:22.603 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-22T04:07:22.603 DEBUG:teuthology.orchestra.run.smithi098:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-22T04:07:22.630 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-22T04:07:22.630 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-22T04:07:22.643 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-22T04:07:22.651 INFO:teuthology.task.internal:Duration was 1526.068851 seconds 2024-09-22T04:07:22.651 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-22T04:07:22.664 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-22T04:07:22.664 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-22T04:07:22.667 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-22T04:07:22.708 INFO:teuthology.orchestra.run.smithi037.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-22T04:07:22.709 INFO:teuthology.orchestra.run.smithi098.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-22T04:07:22.978 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-22T04:07:22.978 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi037.front.sepia.ceph.com 2024-09-22T04:07:22.979 DEBUG:teuthology.orchestra.run.smithi037:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-22T04:07:23.041 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi098.front.sepia.ceph.com 2024-09-22T04:07:23.042 DEBUG:teuthology.orchestra.run.smithi098:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-22T04:07:23.068 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-22T04:07:23.068 DEBUG:teuthology.orchestra.run.smithi037:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-22T04:07:23.084 DEBUG:teuthology.orchestra.run.smithi098:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-22T04:07:23.134 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-22T04:07:23.134 DEBUG:teuthology.orchestra.run.smithi037:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-22T04:07:23.153 DEBUG:teuthology.orchestra.run.smithi098:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-22T04:07:23.292 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-22T04:07:23.308 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-22T04:07:23.308 DEBUG:teuthology.orchestra.run.smithi037:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-22T04:07:23.334 DEBUG:teuthology.orchestra.run.smithi098:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-22T04:07:23.358 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-22T04:07:23.368 DEBUG:teuthology.orchestra.run.smithi037:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-22T04:07:23.376 DEBUG:teuthology.orchestra.run.smithi098:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-22T04:07:23.398 INFO:teuthology.orchestra.run.smithi037.stdout:kernel.core_pattern = core 2024-09-22T04:07:23.422 INFO:teuthology.orchestra.run.smithi098.stdout:kernel.core_pattern = core 2024-09-22T04:07:23.445 DEBUG:teuthology.orchestra.run.smithi037:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-22T04:07:23.479 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-22T04:07:23.479 DEBUG:teuthology.orchestra.run.smithi098:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-22T04:07:23.498 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-22T04:07:23.499 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-22T04:07:23.509 INFO:teuthology.task.internal:Transferring archived files... 2024-09-22T04:07:23.510 DEBUG:teuthology.misc:Transferring archived files from smithi037:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-21_20:56:02-crimson-rados-main-distro-crimson-smithi/7914381/remote/smithi037 2024-09-22T04:07:23.510 DEBUG:teuthology.orchestra.run.smithi037:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-22T04:07:23.555 DEBUG:teuthology.misc:Transferring archived files from smithi098:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-21_20:56:02-crimson-rados-main-distro-crimson-smithi/7914381/remote/smithi098 2024-09-22T04:07:23.555 DEBUG:teuthology.orchestra.run.smithi098:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-22T04:07:23.587 INFO:teuthology.task.internal:Removing archive directory... 2024-09-22T04:07:23.588 DEBUG:teuthology.orchestra.run.smithi037:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-22T04:07:23.592 DEBUG:teuthology.orchestra.run.smithi098:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-22T04:07:23.638 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-22T04:07:23.647 INFO:teuthology.task.internal:Not uploading archives. 2024-09-22T04:07:23.647 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-22T04:07:23.665 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-22T04:07:23.665 DEBUG:teuthology.orchestra.run.smithi037:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-22T04:07:23.667 DEBUG:teuthology.orchestra.run.smithi098:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-22T04:07:23.680 INFO:teuthology.orchestra.run.smithi037.stdout: 265324 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 22 04:07 /home/ubuntu/cephtest 2024-09-22T04:07:23.692 INFO:teuthology.orchestra.run.smithi098.stdout: 265972 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 22 04:07 /home/ubuntu/cephtest 2024-09-22T04:07:23.693 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-22T04:07:23.704 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-22T04:07:23.725 INFO:teuthology.run:Summary data: description: crimson-rados/thrash_simple/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore thrashers/simple thrashosds-health workloads/radosbench} duration: 1526.068850517273 flavor: crimson owner: scheduled_teuthology@teuthology success: true 2024-09-22T04:07:23.726 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-22T04:07:23.810 INFO:teuthology.run:pass